Data Engineer

Key Skills

3D data processing, AWS, Big Data Technology, Data Engineering, Data Governance, Data Lake, Data pipelines, Data Warehousing, Design, ETL frameworks, Python Programming, SQL

Job Description

LTK is the largest influencer-driven platform used by millions of shoppers every month to find new styles and products curated by influencers all over the world. As a Data Engineer, you will be part of a growth-hungry, acceleration-minded team of problem-solvers and product-builders. This is an opportunity to grow with a fast-growing organization. We thrive in an extremely dynamic competitive environment. We focus relentlessly on the needs of our influencers, brands, and consumers. We seek thought-leaders who can collaborate effectively with product managers, designers, and engineers to identify actionable insights to help us grow.

How you will make an impact

• Contribute to the technical definition, prototyping, and production-ready enablement of LTK’s data lakehouse, optimizing efficiencies, performance, scale, and cost
• Support the governance of LTK’s data lakehouse
• Participate in the overall strategic direction of the data engineering technology stack
• Stay abreast of data engineering technical trends and emerging approaches
• Evaluate new technologies and/or custom solutions
• Facilitate on-time delivery of technical work products
• Effectively communicate and gain alignment both within team and with interdependent teams and stakeholders
• Produce high quality technical documentation and artifacts that are easily consumable by data teams and other engineering teams
• Build required infrastructure for optimal ETL/ELT processes for data from various data sources using AWS, SQL and orchestration technologies.
• Ensure the reliability and quality of data across the data lake (at rest) and in the pipelines (in motion)

What you will bring to LTK

• 2-5 years experience in building data pipelines, coding for data management, data warehousing, or other data environments, including, but not limited to Spark.
• Bachelor’s degree in information systems, computer science, or a related field; Master’s preferred
• Experience in system design and application architecture for data platforms;
• Experience driving end to end ETL data pipelines, from ingestion of data to consumption by business intelligence, analytics and other data consumer teams
• Experience in application design and implementation, using agile practices;
• Experience with Data management and Data governance processes and standards;
• Strong experience in Python programming at minimum, with demonstrated real-world experience building out data tools in Cloud environments
• Extensive knowledge in SQL fine tuning, optimizers and execution plans;
• Experience building complex data models to handle millions of transactions;
• Proven experience working with AWS cloud computing environment. Profound knowledge of AWS Data services (eg: Redshift, S3, EMR, Glue, RDS, Kinesis, etc.)

Demonstrated expertise in at least 2 of the following:

• Batch data ingestion
• Big data pipeline engineering and optimization
• Analytic/MPP data warehouse optimization
• Analytical data modeling
• Event streaming data processing
• Data pipeline metadata observability
• Data Platform Cost Optimization
• DataOps

Specialized experience designing and working with at least 2 of the following data domains:

• Retail product data
• Ecommerce data
• Consumer profile data
• Clickstream data
• Consumer event data
• Marketing channel/campaign data
• Affiliate data
• Retailer/Brand data

Preferred Qualifications

• AWS Certified Data Analytics - Specialty Certification
• Experience with multiple platform stacks and tooling (Databricks, Snowflake, DBT, Airflow Orchestration, etc.)

What we offer

• The opportunity to be part of the leading global company in creator commerce
• A remote-first, productivity-first environment
• Competitive compensation and benefits package to meet the needs of you and your family
• 401(k) with LTK company matching
• Medical Insurance, Vision Insurance, Dental Insurance
• Paid Maternity Leave and Paid Paternity Leave
• Summer Fridays and Flexible PTO