Lead Data Engineer

Key Skills

Agile methodologies, Amazon Athena, Amazon EMR, Amazon RedShift, Apache Airflow, Apache Beam, Apache Kafka, API, AWS, AWS Glue, AWS Sagemaker, Big Data Technology, Cloudera, CloudWatch, Continuous Integration & Continuous Delivery - CI/CD, DevOps, ETL/ELT technologies, Leadership, MLOps tools, Presto, PySpark, Spark Core, Spark-SQL, SQL, Terraform

Job Description

Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with a digital transformation via assessments, migration, or modernization.

As a Lead Data Engineer, you have 8+ years of hands-on experience in Data Engineering. You work with business leads, analysts, and data scientists to understand the business domain and engage with fellow engineers to build data products that empower better decision-making. You are passionate about the data quality of our business metrics and the flexibility of your solution that scales to respond to broader business questions. 

If you love to solve problems using your skills, then come join the Team Mactores. We have a casual and fun office environment that actively steers clear of rigid corporate culture, focuses on productivity and creativity, and allows you to be part of a world-class team while still being yourself.

What you will do?

• Lead the project implementation from the technical perspective
• Write efficient code in the chosen technology for the project - For example - Spark, Apache Beam.
• Explore new technologies in Data lake modernization, Data warehouse migration, and ETL Migrations and learn new technologies to optimize the migration and operations process efficiently.
• Collaborate with many engineering and business teams to build better data products and services. 
• Deliver the projects along with the team collaboratively and manage updates to customers on time.
• Participate in the hiring process for Associate and Senior level data engineers and lead them on projects, mentor and define their technical career path by collaborating with them

What are we looking for?

• 4 + years of experience in Apache Spark.
• 4+ years of experience in any ETL tool
• 2+ years of experience in architecting ETL jobs using pySpark, and SparkSQL
• 6+ years of experience in SQL queries and stored procedures
• Have a deep understanding of all the Dataframe API with all the transformation functions supported by Spark 2.7+

You are preferred if you have

• Prior experience in working on AWS EMR, Apache Airflow
• Certifications - AWS Certified Big Data – Specialty Cloudera or Hortonworks Certified Big Data Engineer
• Understanding of DataOps Engineering

Life at Mactores

We care about creating a culture that makes a real difference in the lives of every Mactorian. Our 10 Core Leadership Principles that honor Decision-making, Leadership, Collaboration, and Curiosity drive how we work.

• Be one step ahead
• Deliver the best
• Be bold
• Pay attention to the detail
• Enjoy the challenge
• Be curious and take action
• Take leadership
• Own it
• Deliver value
• Be collaborative

We would like you to read more details about the work culture on https://mactores.com/careers

The Path to Joining the Mactores Team

At Mactores, our recruitment process is structured around three distinct stages:

Pre-Employment Assessment: 

You will be invited to participate in a series of pre-employment evaluations to assess your technical proficiency and suitability for the role.

Managerial Interview: The hiring manager will engage with you in multiple discussions, lasting anywhere from 30 minutes to an hour, to assess your technical skills, hands-on experience, leadership potential, and communication abilities.

HR Discussion: During this 30-minute session, you'll have the opportunity to discuss the offer and next steps with a member of the HR team.