Senior Big Data Developer with Python / Spark / AWS

Key Skills

Amazon Simple Storage Service (S3), Apache Airflow, Apache Kafka, AWS, Big Data Technology, Effective communication skills, Java Programming, Python Programming, Scala Programming, SPARK Programming

Job Description

Grid Dynamics, a global software services company driving enterprise-level digital transformation solutions for Fortune 1000 corporations, is looking for an for an experienced and technology-proficient Senior Big Data Engineer to join our team!

Our client is a global industrial technology company focused on smarter transportation and mobility. The project is about the development of the DWH and pipelines to store and process supply data, gathering metrics from scanners and iOT devices on manufactures to avoid and detect losses on Fuel Supply chain.

Responsibilities:

• Development of the DWH and pipelines
• Store and process supply data
• Build the consolidated data platform to be used as a single source of data to aggregate information from a wide range of internal sources
• Contribute to and promote good software engineering practices across the team
• Mentor and educate team members to adopt best practices in writing and maintaining production code
• Communicate clearly and effectively to technical and non-technical audiences

Required skills:

• 3+ years of solid experience working with Python
• Working experience with AWS Cloud (S3, EMR)
• Working experience with Apache Spark and Apache Kafka

Nice to have:

• Working experience with Scala, Java
• Working experience with Airflow
• Ability to work with not clear requirements
• Ability to work independently and prioritize work across multiple projects
• English level: Upper-Intermediate and higher

We offer:

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Medical insurance
• Benefits program
• Corporate social events

About us:

Grid Dynamics is a leading provider of technology consulting, agile co-creation and scalable engineering and data science services for Fortune 1000 corporations undergoing digital transformation. We help organizations become more agile and create innovative digital products and experiences using deep expertise in emerging technology, top global engineering talent, lean software development practices, and a high-performance product culture. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the US, Mexico, UK, Netherlands, Switzerland, India, and Central and Eastern Europe.

Join us and prepare to grow!