Senior Software Engineer, Data

Key Skills

Amazon Simple Storage Service (S3), Apache Airflow, Apache Kafka, Artifactory, AWS, AWS Kinesis, Databricks, DynamoDB, ETL/ELT technologies, Github, Java Programming, Kubernetes-K8s, Lambda, Maven, Periscope, Python Programming, Scala Programming, Snowflake, SPARK Programming, SparkML

Job Description

Lark is the world's largest A.I. healthcare provider, contracted to manage 30M+ patients living with or at risk of chronic disease. Lark is a companion app on the user’s phone providing real-time coaching, guidance, and health insights to users. We are on a mission to disrupt the healthcare industry and make the world a healthier, happier place. Come join our team!

The Role

At the technical level, Data Engineers are skilled Backend engineers dealing with data at scale. In this role you will be responsible for all internal and external data products, which includes product reporting, invoicing, BI dashboards, and serving data for our Data Science team. Data Engineering maintains the library of all our data assets that we reference to learn how well our product is doing, and what insights we can leverage for enhancement.

If being part of a small dynamic, agile software engineering team practicing TDD with an emphasis on software quality, with a tremendous opportunity to make a big impact, this is the job for you! We are a collective of engineers dedicated to our craft, with a commitment to continuing education, peer mentorship, and collaboration. You will help drive and maintain a high-level of operational excellence in data engineering.

What You’ll Do

• Develop integrations to move data into the raw zone of the data lake
• Build ETL/ELT pipelines to transform data in the raw zone, and load it to the structured and consumer zones of the data lake, and to serving tiers
• Define and lead the best practices in security, data privacy, quality, and data governance
• Help lead and collaboratively define Lark's next generation data platform
• Help build online data validation to ensure the assumptions we’ve tested for in our code remain true
• Collaborate with teams across the company to help develop data products that drive company success
• Evaluate, integrate and build tools and infrastructure to accelerate Data Engineering, Data Science, Business Intelligence, Reporting and Analytics as needed
• Drive data literacy across business functions

What You’ll Need

• Know S.O.L.I.D. principles and practice them intuitively and appropriately
• Expertise in Scala, Python, and Java
• Fluency in data structures, algorithms, distributed computing, storage systems, and multiple consistency models
• In-depth knowledge of AWS (including EMR, DMS, Athena, RDS, Aurora, Lambda, Redshift, etc.)
• Expertise in stream data processing (e.g., DMS, Flink, Spark, Kinesis, Kafka)
• Data warehouse modernization, building data-marts, star/snowflake schema designs, ETL/ELT pipelines
• Building production-grade data backup/restore strategies, and disaster recovery solutions experience
• Advanced SQL skills
• Humility with an intrinsic positive drive
• Value, respect, and an enthusiasm for diversity, inclusion, and alternative perspectives
• Goal-oriented, with a desire to create an environment of psychological safety
• Ability to thrive in an environment promoting and enabling collaboration

Technologies we use in Data Engineering:

• Scala, sbt, Python, Pytest, tox, Java, Maven, Github, Code Artifact, Apache Spark (on EMR and Databricks), Airflow, AWS (DynamoDB, RDS, Kinesis, SQS, SNS, MWAA, S3, Lambda, Event Bridge, MSK, EKS, ECR, Kubernetes, Kafka, Delta Lake, SparkML, GraphX, Snowflake and Periscope (Sisense)

Working at Lark

Lark offers the option to work remotely in the United States. U.S. Salary Range: $143,000 - $216,000. The salary offered to a selected candidate will be based on several factors, including location, level, and will vary depending on confirmed job-related knowledge, skills, and experience. In addition to a comprehensive benefits package, candidates may be eligible for other forms of compensation, such as participation in a bonus and a stock award program, as applicable. The company is headquartered in Mountain View, CA.

Lark is an Equal Opportunity and Affirmative Action Employer. We believe that diverse teams foster innovation and add to our mission-driven culture. We strongly encourage people from underrepresented groups to apply.