Cloud Big Data Engineer

Key Skills

HTML, Java Programming, Python Programming, MongoDB, Database, SQL, Git, Apache Hadoop, Apache Kafka, Apache Cassandra, NoSQL, Presto, Apache Hive, Apache Airflow, MySQL, Sqoop, SPARK Programming, HBase, Apache Oozie

Job Description

Cybersecurity is at the beating heart of our culture. Our diligence and expertise is what makes us the undisputed leader in electronic payments. We’ve made it our priority to create a top-tier Security Architecture team, poised to defend us against any potential cyber threats. CyberSecurity Architecture team is looking for a Data Engineer worked on on prem data lake like Hadoop and migrating to cloud experience. Candidate will be a part of the Visa Security Analytics Engineering team and involved with administering data ingestion via Kafka streaming and performing Data parsing by developing data parsers for Data Engineering activities. The position will be based at Visa's headquarters in Foster City, California.

The successful candidate will be working on cutting-edge technologies to perform statistical profiling, inference, classification, clustering and predictive analysis. As a key member of the Data Engineering team, you will be working on large datasets of Security Data and implement Data mining, Data parsing contributing to data availability building machine learning models to help derive new insights to defend against cyber-attacks.

You will be working with world-class operation teams including Cyber Defense team and Data Science team to create awesome analytics for security and other business units. You'll need to have excellent communication and cross-group collaboration skills, be able to make forward progress despite ambiguous circumstances, be a self-starter, a quick learner of new technologies and have experience in Data engineering to maintain DataQuality and Integrity.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office two days a week, Tuesdays and Wednesdays with a general guidepost of being in the office 50% of the time based on business needs.

Qualifications

Basic Qualifications:

• 2 or more years of work experience with a Bachelor’s Degree in Computer Science, Information Technology, Engineering, Computer Engineering or MIS or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)

Preferred Qualifications

• 3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)
• 4+ years in Spark, Scala, Python, Java, and Unix to filter/cleanse/map/aggregate data is a must.
• 2+ years' experience in one or more of the following: Kafka, Spark streaming, Sqoop, Oozie, Airflow, Control-M, Presto.
• 2+ years' experience in one or more of the following: SQL, NOSQL, MongoDB or Cassandra.
• Experience in migrating from On Prem Hadoop to Cloud (Azure/AWS/GCP/Databricks) is required.
• Ability to communicate complex technology solutions to clients, technical, business and management teams
• Proficiency in languages including, but not limited, to Java, Scala, Python, JavaScript, HTML.
• Experience with authoring utilities / automation tools using, Java, Python, Groovy, and more.
• Experience with highly distributed, scalable, concurrent, and low latency systems working with one or more of the following technologies: Druid, Elastic Search, Postgres SQL, NoSQL DB, MySQL.
• Experience with data visualization and business intelligence tools like Power BI, Tableau etc. is a plus.
• Experience in developing Restful APIs.
• Experience with setting up and operationalize Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Ansible.
• Experience working in an Agile and Test-Driven Development environment.
• Demonstrated intellectual and analytical rigor, strong attention to detail, team oriented, energetic, collaborative, diplomatic, and flexible style.
• Be able to work independently with minimal supervision.

Additional Information

• Visa has adopted a COVID-19 vaccination policy to safeguard the health and well-being of our employees and visitors. As a condition of employment, all employees based in the U.S. are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.
• Work Hours: Varies upon the needs of the department.
• Travel Requirements: This position requires travel 5-10% of the time.
• Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.