Technology Lead - Data Platform

Key Skills

Apache Airflow, AWS, Effective communication skills, Infrastructure as code, Leadership Skill, Machine learning techniques, Management, Planning and organization, Python Programming, Streaming APIs

Job Description

ShyftLabs is a growing data product company founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries by focusing on creating value through innovation.

Job Responsibilities:

Lead a team of engineers in developing and maintaining our distributed data ingestion platform, APIs, and self-service portals.

Instill engineering best practices for service development and data ingestion platforms.

Lead the coordination and development of tools and services to support our compliance commitments requirements for our ingestion pipeline.

Work with the team to manage data quality across our various ingestion sources.

Work with analytics, machine learning infra, and product teams to understand their evolving data requirements and influence the platform roadmap.

Guide, organize, and communicate the team's quarterly goals and accomplishments.

Hire and develop engineers and tech leads.

Qualifications:

5+ years of technical experience in data infrastructure, data engineering, or software development. Experience in long-term management of data platforms is a big plus

2+ years of experience in people management with a track record of building teams and growing talent

Extensive experience with AWS, Python, Airflow

Experience launching large-scale data ingestion pipelines

Experience in designing scalable architectures and processes

Experience working with senior stakeholders, both technical and non-technical, with cross-functional collaboration

Experience working with vendors, ideally in the retail industry

Experience with Apache Druid & Flink

We proudly offer a competitive salary and a strong healthcare insurance and benefits package. We pride ourselves on the growth of our employees, offering extensive learning and development resources.