Data Engineer

Key Skills

AI Robotic systems, Amazon Athena, Amazon RedShift, Apache Airflow, Apache Hadoop, Apache Kafka, Argo, Autonomous vehicles, Avro, AWS, AWS Kinesis, Azure, Cloud computing, Docker, Google BigQuery, Google Cloud Platform (GCP), Kubernetes-K8s, Linux Operating system, MongoDB, Parquet, Presto, Python Programming, RabbitMQ, Snowflake, SPARK Programming, Terraform

Job Description

The Data Engineering team builds the apps and infrastructure to leverage data from our vehicles and operations. We are building the next generation data lake and pipelines as we scale our offerings. You will develop and implement the systems that power Luminar’s data-driven improvement and growth.

Responsibilities

• Designing, building, and maintaining the infrastructure that transforms data at scale into insights:
• Ingestion of real-world vehicle data.
• Automated labeling and data enrichment.
• Generation of ground truth information.
• Analysis of data quality.
• Partnering with engineering and ML teams to define data consumption patterns and establish best practices.
• Establishing robust data integrity and systems monitoring.

Minimum Qualifications

• 4+ years of relevant industry experience: 
• Building backend / data services at scale.
• Hands-on Big Data software and infrastructure development skills.
• Experience with NoSQL databases and/or Relational databases.
• Accomplished in at least one backend language, preferably Python.
• Strong communication skills, being able to collaborate with the wider software organization.
• Bachelor’s Degree (or higher) in Computer Science.

Preferred Qualifications

• Proficiency in Python.
• Experience with MongoDB.
• Experience with pipeline / workflow frameworks: Argo Workflows or Airflow.
• Hands-on experience with cloud computing: AWS / GCP / Azure / Alibaba Cloud.
• Experience with automation of data infrastructure: Docker / Kubernetes / Terraform / Linux.
• Experience with SRE practices - running services reliably in production environments:
• Incident management and root cause analysis.
• Performance Engineering.
• Previous experience in the Automotive / Robotics industry.

Nice To Have

• Proficiency in front-end development, preferably using React.
• Experience with processing frameworks like Spark / Hadoop.
• Experience with big data / data warehouse tools like Redshift, Presto/Athena, BigQuery and Snowflake.
• Experience with streaming and message queueing technologies: Kafka / Kinesis / RabbitMQ.
• Hands-on experience with data storage and transfer schemes like Avro, Parquet and Protobuf.
• Experience with rosbags.

Benefits and Perks

• Competitive Pay, 401k Matching and meaningful Equity from a publicly traded company
• Great Medical Benefits
• Tuition Assistance, Meals served in the office 
• No limit on PTO
• Flexible Work Schedule with some Work From Home flexibility as well 

Industry: Autonomous vehicles, automotive, product demonstration

Employment Type: Full-time

Job Functions: Engineering

At Luminar, your base pay is one part of your total compensation package. This role pays a base between $142,000 and $199,000* per year. Within this range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. You will also be eligible to receive other benefits including: equity in the form of restricted stock unit awards, comprehensive medical and dental coverage, 401k plan, life and disability benefits, flexible time off, paid parental leave, and tuition reimbursement for formal education related to advancing your career at Luminar. The specific programs and options available to an employee may vary depending on date of hire and schedule type.