Principal Software Engineer - Spark, Big Data

Key Skills

MongoDB, DevOps, Big Data Technology, NoSQL, PySpark, SPARK Programming

Job Description

The Role

Veeva Company is seeking a talented and senior Engineer to join our Big Data Analytics Tools group in Israel.

This is an amazing opportunity to work with a world-class team and to hold responsibility for designing and implementing big data platforms and pipelines.

You will work with Engineers, Data Scientists, DevOps, and PMs and be in charge of designing and developing Apache Spark applications on AWS infrastructures that process large volumes of medical records securely while preserving patient privacy.

If you want to grow with us and work for a world leader company, now is the right time to join.

What You'll Do

• Be part of an engineering team that focuses on Crossix core technology and peripheral analytical tools
• Design and implement highly reliable and scalable Spark applications that efficiently process big data
• Collaborate with data scientists on the design and implementation of ML data pipelines using PySpark and Python
• Integrate with relational databases, MongoDB, and AWS services (e.g., EMR, S3, SQS)
• Work in an agile team to improve the development life cycle, development practices, and testing facilities

Requirements

• 8+ years of programming experience in server-side components/backend technologies
• 2+ years of experience in Big Data development
• 5+ years of experience with Java
• B.Sc. in Computer Science or equivalent
• Team player

Nice to Have

• Experience with Python and PySpark
• Deep understanding of NoSQL databases such as Elasticsearch and MongoDB
• Significant experience with both EMR and EMR Serverless, as well as other big data processing engines on cloud infrastructures

Veeva’s headquarters is located in the San Francisco Bay Area with offices in more than 15 countries around the world.

As an equal opportunity employer, Veeva is committed to fostering a culture of inclusion and growing a diverse workforce. Diversity makes us stronger. It comes in many forms. Gender, race, ethnicity, religion, politics, sexual orientation, age, disability and life experience shape us all into unique individuals. We value people for the individuals they are and the contributions they can bring to our teams.

If you need assistance or accommodation due to a disability or special need when applying for a role or in our recruitment process, please contact us at talent_accommodations@veeva.com.