Lead Big Data Engineer

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Apache Hadoop, Scala Programming, Machine learning techniques, Data science techniques, PyTorch, TensorFlow, MapReduce, R Programming

Job Description

WE ARE

Big Data & Analytics Center of Excellence, data consulting, and data engineering branch of SoftServe. Starting as a group of 3 enthusiasts back in 2013, almost 200 Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains across North America, EMEA, APAC, and LATAM.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like Snowflake, Confluent, Cloudera, Starburst, Collibra, Tableau, and others. Together with the SEI and Carnegie Mellon University, we adapted ADD and ATAM architecture design methodologies to Big Data needs and invented the Smart Decisions game to promote architecture design best practices in AI and Big Data.

YOU ARE

An expert with the following experience

• Excellent understanding of distributed computing technologies, approaches, and patterns
• Proficiency in Python language or ready to work with Python
• Hands-on expertise with Hadoop, NoSQL, MPP technologies, processing frameworks, or other Big Data technology areas: data ingestion, consolidation, streaming, or batching
• At least one of the processing and computation frameworks: Kafka Streams, Storm, Spark, Flink, Beam/DataFlow, Akka, etc.
• At least one of the RDBMS or NoSQL engines: PostgreSQL, MySQL, Cassandra, HBase, Elasticsearch, Redis, MongoDB, Impala, Kudu, etc.
• Implementing Data Lakes, Data Warehousing or analytics systems is a big plus point
• Cloud experience with AWS, GCP, or Azure is a big huge

YOU WANT TO WORK WITH

• The team of data-focused engineers who learn, improve, and share the knowledge day by day
• The cutting-edge technology stack, including major cloud providers' services that are not generally available yet
• Customers from all over the world, from huge global corporations to crypto startups that are about to launch their first product
• Entire project lifecycle, from initial design through PoCs and MVP up to the full-scale implementation

TOGETHER WE WILL

• Help customers meet the goals of their analytics initiatives
• Design, implement or migrate data platforms and ETL pipelines implemented as a code
• Support your technical and personal growth–we have a dedicated career plan for all roles in our company
• Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Big Data Community

And enjoy such benefits as

• Unlimited upskill opportunities with full access to Udemy learning courses
• Professional certifications are encouraged and covered by the company
• Assimilating best practices from experts, working in a team of top-notch Architects
• Working with world-leading companies
• Chance to address different business and technology challenges, drive multiple projects and initiatives being a part of the Center of Excellence
• Attending and giving speeches at international events
• Variety of projects to join