Lead, Data Engineer

Key Skills

Amazon RedShift, Apache Airflow, Apache Beam, Apache Cassandra, Apache Hive, Apache NiFi, AWS, Azure, C Programming, C# Programming, C++, Data pipelines, Data science techniques, Database, Effective communication skills, Elasticsearch, ETL frameworks, Google Cloud Platform (GCP), HBase, Java Programming, Luigi, Machine learning techniques, MongoDB, MySQL, NoSQL, Oracle, PostgreSQL, Python Programming, REDIS, Scala Programming, Snowflake, SPARK Programming, SQL, SQL Server, Teradata

Job Description

Working alongside our generalist consultants, Bain's Advanced Analytics Group (AAG) helps clients across industries solve their biggest problems using our expertise in data science, customer insights, statistics, machine learning, data management, supply chain analytics and data engineering. Stationed in our global offices, AAG team members hold advanced degrees in computer science, engineering, AI, data science, physics, statistics, mathematics, and other quantitative disciplines, with backgrounds in a variety of fields including tech, data science, marketing analytics and academia.

WHAT YOU’LL DO

As a member of the growing Cloud, Apps and Data Engineering team in Bain’s Advanced Analytics Group, you will:

• Partner with Data Science, Machine Learning, and Platform Engineering teams to develop and deploy production quality code
• Develop and champion modern Data Engineering concepts to technical audience and business stakeholders
• Implement new and innovative deployment techniques, tooling, and infrastructure automation within Bain and our clients.
• Travel is required (30%)

ABOUT YOU

• Master’s degree in Computer Science, Engineering, or a related technical field. 
• 3+ years at Senior or Staff level, or equivalent
• 3+ years of experience programming with Python, Scala, C/C++, Java, C#, Go, or similar programming language.
• 3+ years of experience with SQL or NoSQL databases: PostgreSQL, SQL Server, Oracle, MySQL, Redis, MongoDB, Elasticsearch, Hive, HBase, Teradata, Cassandra, Amazon Redshift, Snowflake.
• Experience in deploying serverless data pipelines through containerization and terraform orchestration 
• Industry level experience of working with public cloud environments (AWS, GCP, or Azure), and associated deep understanding of failover, high-availability, and high scalability
• Scaling and optimizing schema and performance tuning SQL and ETL pipelines in data lake and data warehouse environments.
• Strong computer science fundamentals in data structures, algorithms, automated testing, object-oriented programming, performance complexity, and implications of computer architecture on software performance.
• Data ingestion using one or more modern ETL compute and orchestration frameworks (e.g. Apache Airflow, Luigi, Spark, Apache Nifi, and Apache Beam).
• Version control and git workflows
• Strong interpersonal and communication skills, including the ability to explain and discuss complex mathematical and machine learning technicalities with colleagues and clients from other disciplines at their level of cognition 
• Curiosity, proactivity and critical thinking 

ABOUT US

Bain & Company is a global consultancy that helps the world’s most ambitious change makers define the future.

Across 64 cities in 39 countries, we work alongside our clients as one team with a shared ambition to achieve extraordinary results, outperform the competition, and redefine industries. We complement our tailored, integrated expertise with a vibrant ecosystem of digital innovators to deliver better, faster, and more enduring outcomes. Our 10-year commitment to invest more than $1 billion in pro bono services brings our talent, expertise, and insight to organizations tackling today’s urgent challenges in education, racial equity, social justice, economic development, and the environment. We earned a gold rating from EcoVadis, the leading platform for environmental, social, and ethical performance ratings for global supply chains, putting us in the top 2% of all companies. Since our founding in 1973, we have measured our success by the success of our clients, and we proudly maintain the highest level of client advocacy in the industry.

U.S. Compensation and Benefit Information:

Compensation for this role includes base salary, annual discretionary performance bonus, 401(k) plan with an annual employer contribution based on years of service and Bain’s best in class benefits package (details listed below).

Some local governments in the United States require a good-faith, reasonable salary range be included in job postings for open roles. The estimated annualized compensation for this role is as follows:

In New York City, the good-faith, reasonable annualized full-time salary range for this role is between $157,500 - $189,500; placement within this range will vary based on several factors including, but not limited to experience, education, licensure/certifications, training and skill level