Senior Big Data Engineer (Python + Azure)

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Apache Hadoop, Scala Programming, Machine learning techniques, Data science techniques, PyTorch, TensorFlow, MapReduce, R Programming

Job Description

WE ARE

Big Data & Analytics Center of Excellence, data consulting, and data engineering branch of SoftServe. Starting as a group of 3 enthusiasts back in 2013, almost 200 Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains across North America, EMEA, APAC, and LATAM.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like Snowflake, Confluent, Cloudera, Starburst, Collibra, Tableau, and others.

Together with the SEI and Carnegie Mellon University, we adapted ADD and ATAM architecture design methodologies to Big Data needs and invented the Smart Decisions game to promote architecture design best practices in AI and Big Data.

YOU ARE

A Software Engineer focused on data pipeline creation and comfortable with batch processing, streaming processing, or both.

Experienced in

• SQL and Python or Scala programming languages (at least one)
• Data solutions development in Azure
• Apache Spark, Databricks
• Azure Data Factory, ADLS Gen2, Azure SQL
• Apache Kafka or Azure Event Hub, IoT Hub, Azure Stream Analytics
• SQL Server, Azure Synapse, or Snowflake

YOU WANT TO WORK WITH

• Helping customers meet the goals of their analytics initiatives
• Implementing from scratch or migrating Data Lakes, Big Data platforms, streaming analytics solutions
• The cutting-edge technology stack, including major cloud providers' services that are not generally available yet
• Customers from all over the world, from huge global corporations to crypto startups that are about to launch their first product
• Entire project lifecycle, from initial design through PoCs and MVP up to the full-scale implementation

TOGETHER WE WILL

• Cooperate with the team of data-focused engineers who learn, improve, and share the knowledge day by day
• Support your technical and personal growth – we have a dedicated career plan for all roles in our company
• Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Big Data Community

And enjoy such benefits as

• Unlimited upskill opportunities with full access to Udemy learning courses
• Professional certifications, encouraged and covered by the company
• Assimilating best practices from experts, working in a team of top-notch Engineers and Architects
• Chance to address different business and technology challenges, drive multiple projects and initiatives as being a part of the Center of Excellence
• A variety of projects to join