Senior/Lead Big Data Engineer (Python + GCP)

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

Big Data & Analytics Center of Excellence, data consulting, and data engineering branch of SoftServe. Starting as a group of 3 enthusiasts in 2013, almost 200 Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains across North America, EMEA, APAC, and LATAM.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like Snowflake, Confluent, Cloudera, Starburst, Collibra, Tableau, and others.

Together with the SEI and Carnegie Mellon University, we adapted ADD and ATAM architecture design methodologies to Big Data needs. We invented the Smart Decisions game to promote architecture design best practices in AI and Big Data.

YOU ARE

A Software Engineer focused on data pipeline creation and comfortable with batch processing, streaming processing, or both and used to leading a team or considering yourself ready to do it.

Experienced in

• SQL
• Python or Scala/Java programming languages (readiness to work with Python is important)
• Data solutions development in GCP
• Apache Spark, Cloud Dataflow, or Apache Beam
• Apache Airflow or Cloud Composer
• Apache Kafka or Cloud Pub/Sub
• Google Big Query
• Breaking down customer requirements into development tasks, estimation, leading a team of fellow data engineers

YOU WANT TO WORK WITH

• The team of data-focused engineers who learn, improve, and share the knowledge day by day
• The cutting-edge technology stack, including major cloud providers' services that are not generally available yet
• Customers from all over the world, from huge global corporations to crypto startups that are about to launch their first product
• Entire project lifecycle, from initial design through PoCs and MVP up to the full-scale implementation

TOGETHER WE WILL

• Help customers meet the goals of their analytics initiatives
• Design, implement or migrate data platforms and ETL pipelines implemented as a code
• Support your technical and personal growth – we have a dedicated career plan for all roles in our company
• Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Big Data Community

Your benefits

• Unlimited upskill opportunities with full access to Udemy learning courses
• Professional certifications are encouraged and covered by the company
• Assimilating best practices from experts, working in a team of top-notch Architects
• Working with world-leading companies
• A chance to address different business and technology challenges, and drive multiple projects and initiatives as a part of the Center of Excellence
• Attending and giving speeches at international events
• A variety of projects to join