Data Engineer (Senior)

Key Skills

Python Programming, Scala Programming, C++, Java Programming, Machine learning techniques, Data science techniques, SQL, Apache Hadoop, MapReduce, TensorFlow, PyTorch, R Programming

Job Description

Mactores is a team of emerging technologists, data engineers, and data scientists driven by excellence in technology to solve critical business problems. We help bridging complex business challenges with technical expertise. Specializing in AI, Fast Data, Industrial IoT and Cloud helps us collaborate with organizations that view technology as a strategic driver to success.

As a pySpark Data Engineer, you have 4 years of hands on experience in Data Engineering. You work with business leads, analysts, and data scientists to understand the business domain and engage with fellow engineers to build data products that empower better decision-making. You are passionate about the data quality of our business metrics and the flexibility of your solution that scales to respond to broader business questions. 
If you love to solve problems using your skills, then come join the Team Mactores. We have a casual and fun office environment that actively steers clear of rigid corporate culture, focuses on productivity and creativity, and allows you to be part of a world-class team while still being yourself.What you will do?

• Write efficient code in the chosen technology for the project - For example - Spark, Apache Beam.
• Explore new technologies and learn new techniques to solve business problems creatively.
• Collaborate with many teams - engineering and business, to build better data products and services. 
• Deliver the projects along with the team collaboratively and manage updates to customers on time.

What are we looking for?

• 4 to 7 years of experience in Apache Spark.
• 2+ years of experience in writing ETL jobs using pySpark, and SparkSQL
• 2+ years of experience in SQL queries and stored procedures
• Have a deep understanding of all the Dataframe API with all the transformation functions supported by Spark 2.7+

You are preferred if you have

• Prior experience in working on AWS EMR, Apache Airflow
• Certifications - AWS Certified Big Data – Specialty Cloudera or Hortonworks Certified Big Data Engineer
• Understanding of DataOps Engineering