Data Engineer (Mid-Level)

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

The largest brewery in the world has a vacancy open for Data Engineer (Mid-Level) at the Global team. We need a data engineer who will be able to design, implement and maintain data integrations and data pipelines (ETL) in our Google Cloud Platform (GCP) environment and always focus on quality, performance and security. It’s desired that the data engineer has skills or interest in Machine Learning models, as he will need to scale-up machine learning models to different markets.

Main Responsibilities:

• Support the GCP architecture design;
• Deploy and Configure GCP components;
• Build ETL routines and database modeling and maintain continuous improvement;
• Monitor the environment and the data pipelines (Environment Governance);
• Fix bugs and troubleshoot issues in the data pipelines;
• Data analysis to troubleshoot unexpected data values and create insights;
• Scale-up Machine Learning and Deep Learning algorithms;
• Collaborate with the project evolution with ideas and insights.

Experience & Skills:

• Advanced SQL;
• Python (PySpark desirable);
• ETL implementation (Data Pipelines);
• Airflow DAGs development;
• Google Cloud Platform components (BigQuery, Composer, Dataproc, etc.);
• Data Mining and Data Analysis skills;
• Diagnostic and Troubleshooting skills;
• Machine Learning and Deep Learning algorithms (desirable);
• Data Visualization (desirable);
• Marketing Industry (desirable);
• Advanced English;
• Bachelor’s degree in Computer Science, Computer Engineering, Statistics, Mathematics, or a related field.