Big Data Engineer with Scala and Spark

Key Skills

Apache Hadoop, AWS, Bash scripting, Big Data Technology, Data Analytics, Data Mining, Infrastructure as code, JVM, Scala Programming, SPARK Programming, Unix Operating system

Job Description

Grid Dynamics, a global software services company driving enterprise-level digital transformation solutions for Fortune 1000 corporations, is looking for an experienced and technology-proficient Big Data Engineer to join our team!

Our customer is one of the world’s largest technology companies based in Silicon Valley with operations all over the world. In this project, we are working on the bleeding edge of Big Data technology to develop a high-performance data analytics platform, which handles petabytes datasets.

Responsibilities:

• Running big data analytics, and building large scale data infrastructure
• Detecting meaningful data patterns
• Assuring the integrity of our data
• Measuring fraud activity and its impact on campaign and user performance
• Analyzing the results of mitigations against fraud

Requirements:

• Strong knowledge of Scala
• In-depth knowledge of Hadoop and Spark, experience with data mining and stream processing technologies (Kafka, Spark Streaming, Akka Streams)
• Understanding of the best practices in data quality and quality engineering
• Ability to quickly learn new tools and technologies
• English languages are required

Will be a plus:

• Knowledge of Unix-based operating systems (bash/ssh/ps/grep etc.)
• Experience with JVM build systems (SBT, Maven, Gradle)
• AWS experience

We offer:

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits program
• Social package - medical insurance, sports
• Corporate social events
• Professional development opportunities

About us:

Grid Dynamics is a leading provider of technology consulting, agile co-creation and scalable engineering and data science services for Fortune 1000 corporations undergoing digital transformation. We help organizations become more agile and create innovative digital products and experiences using deep expertise in emerging technology, top global engineering talent, lean software development practices, and a high-performance product culture. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the US, Mexico, UK, Netherlands, Switzerland, India, and Central and Eastern Europe.

Join us and prepare to grow!