Data Engineer

Key Skills

Amazon RedShift, AWS, Data Analytics, Data Engineering, Digital Marketing, GoLang, IBM Cognos, Informatica, MLflow, MongoDB, Python Programming, Risk Analytics, Scala Programming, SQL, Teradata

Job Description

Responsibilities:

• Develop, Construct, Test, and Maintain Data Pipeline, ETL and ELT workflows. Automate process including writing test automation, secure adequate documentation, enable sustainability through high quality development. Do Code reviews and be an active contributor in the team deliverables
• Support Business partners and peers from the Data Engineering and Analytics team as well as member of the Digital & Analytics community in the delivery of Digital Products. Support requirement collection through continuous iteration during the development phases. Constantly improve code quality through refactoring and technical debt reduction activities.
• Support Pipelines continuum by being active part of the monitoring and support process. Analyze unforeseen process termination and support the business continuity by reviewing and upgrading code and process to be error free and secure lowest maintenance efforts.

Requirements:

• Bachelor's Degree in Computer Information Science
• Bachelor's Degree in Engineering, Math.
• 3+ years’ experience in architecting, designing, and engineering data pipelines including integration topics (API).
• 3+ years in data exploration, visualization including delivering data driven digital products.
• 3+ years of experience in building data model and conceptual logical models and converting them into technical application designs
• 2+ years of experience in integration and interfacing across various systems (legacy and modern)
• 2+ years of experience in Big Data, Artificial Intelligence (AI) Knowledge and strong skills with SQL and no-SQL databases and application as Teradata, Redshift, MongoDB or equivalent
• Extensive knowledge and experience of DevOps, Agile practices, CI/CD
• Extensive knowledge of cloud-native solutions, microservices, cloud computing (AWS and Azure)
• Extensive knowledge of software development (Python, Scala, Golang, SQL) and Data solutions (Tableau, Cognos, Informatica)
• Strong knowledge of AI, ML, Cognitive services concepts