Data Engineer -Specialist / Sr. Specialist

Key Skills

Agile methodologies, Apache Airflow, Apache Kafka, Big Data Technology, Data Engineering, Data pipelines, Data science techniques, Effective communication skills, Google BigQuery, Google Cloud Platform (GCP), Java Programming, NoSQL, Python Programming, RDBMS, SAP, Snowflake, SPARK Programming

Job Description

What role will you play as a member of the Colgate’s Information Technology team?

Data Engineers focus on expanding and optimizing our data, data pipeline architecture, data flow and collection for multi-functional teams. The Data Engineer will be an expert data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. You will support our software developers, data analysts and data scientists on data initiatives and will ensure efficient data delivery architecture is consistent throughout ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. You will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives. This team is a group of innovators and technologists that love to learn and collaborate!

Main Responsibilities

• You are excited at the prospect of leveraging technology to tacklesophisticatedx data problems
• Build data applications on Google cloud platform and integrate with different data sources/ tools.
• Design, develop, and maintain a world class data warehouse and analytics architecture to meet business analysis, reporting needs, and data science initiatives
• Work directly with supply chain business users and data scientists to assist in project analysis
• Participate in the development and maintenance of ETL jobs and data pipelines to aggregate data from various on premise, cloud platforms & external data sources
• Design and develop data marts for consumption by analytics tools and end users
• Develop code standards, guidelines to manage and ensure data quality and integrity
• Optimize and scale data warehouse and data processing infrastructure
• Evaluate new technologies and constantly work towards continuous improvements in data engineering, our platform, and the organization

Required Qualifications:

• Bachelor’s degree required, Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field is preferred
• At least 3 year of experience as a Data Engineer role.
• At least 1 year of experience in data warehousing & analytical tools like Tableau etc.
• Demonstrates ability in data modeling, ETL development, and Data warehousing
• Knowledge of data management fundamentals and data storage principles
• Experience with Python or similar big data programming languages
• Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Experience in CI/CD workflow approaches
• Knowledge of Terraform, docker kubernetes , cloud functions
• Experience with Git for version control
• Strong analytical, problem solving & conceptual skills

Preferred Qualifications

• Experience building and optimizing big data data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience with data warehousing platforms/storage platforms such as SAP BW/HANA
• Experience with SAP data extractors, SAP Integration tools like SLT, SDI & understanding of Supply chain processes is preferred
• Experience with cloud data warehousing/Big data environments like Snowflakes, Bigquery, Google cloud storage etc is a plus
• Experience with object-oriented/object function scripting languages: Python, Java, etc.
• Experience with data pipelines and streaming frameworks such as Pubsub, Spark, Airflow, Kafka etc
• Experience with RDBMS; NoSQL experience also encouraged
• Ability to embrace, learn, and apply new technologies and tools
• Familiarity with agile software development methodology
• Ability to communicate well with both technical and non-technical teams