Staff Software Engineer, Data Platform

Key Skills

Amazon RedShift, Apache Hive, Continuous Integration & Continuous Delivery - CI/CD, Data Analytics, Data science techniques, Design, ETL/ELT technologies, ExpressJS, GoLang, Google BigQuery, HIPAA, Infrastructure as code, Python Programming, Scala Programming, Snowflake, SPARK Programming

Job Description

The Role

Lark is seeking a talented Staff Software Engineer to act as a technical lead for our data and analytics engineering teams, which powers our data insights product for our business partners and enables us to offer Lark’s health coaching to patients. In this role, you will complement the Engineering Manager by providing the technical vision and oversight for a team of data engineers and analytics engineers. The overall team goal is to deliver our data products flexibly to meet the diverse needs of our external clients and internal colleagues in analytics. The Staff Software Engineer will ensure that engineers make the best technical decisions for the data platform and stakeholders. At Lark, we believe in a player-coach approach, where engineering leaders are not only strategic thinkers but also hands-on leaders, actively involved in scrum ceremonies and guiding the team toward excellence. Join us in shaping the future of health technology with innovation and leadership.

What You’ll Do

• Serve the needs of data consumers first and foremost (including business analysts, data scientists, and data products that serve external clients) to ensure they have accurate, accessible data

• Guide the team to making architectural choices that are appropriate for the current business needs and team size while setting us up for success for future growth

• Partner with leadership on technical strategy, with an emphasis on “disagree and commit” principle

• Collaborate with senior data engineers and analytics engineers to determine the best approach to ingest and transform new data sources in our tech stack, which includes DBT workflows, Databricks notebooks, and in-house Scala transformers

• Manage relationships with data vendors and keep costs within budget while ensuring we can continue to meet the needs of the team and our clients

• Coordinate project plans with Engineering Managers and Technical Program Managers

• Build a culture of engineering best practices, with an emphasis on observability, documentation, and risk management

• Mentor and develop team members from a technical perspective

What You’ll Need

• Deep experience developing data platform infrastructure and ETL/ELT design and implementation, including development of best practices in testing, logging, monitoring

• Expertise in SQL and at least one programming language (Python, Scala, Go)

• Background working with distributed big data technologies such as Spark, Presto, Hive, as well as data warehouse technologies including Snowflake, BigQuery, or Redshift

• Strong cross-functional communicator and collaborator who has extensive experience working across data and data consumer teams, including Analytics, Data Science, Product, Operations, and other third-party stakeholders

• Experience with implementing microservice architectures, event-based processing, and streaming pipelines, including expertise with Kafka and Spark Streaming

• Experience with managing healthcare data (e.g. HIPAA compliance, Safe Harbor)

• Experience mentoring data and analytics engineers with varying levels of expertise

• Familiarity implementing CI/CD practices and infrastructure as code (especially Terraform) as a foundation for developing data platforms from the ground up on cloud ecosystems

Working at Lark

Lark operates as a remote organization, requiring all employees to reside within the United States. The specific salary offered to a candidate will depend on various factors, including their location, job level, and verified job-related knowledge, skills, and experience. In addition to a comprehensive benefits package, candidates may be eligible for additional compensation, such as participation in a bonus program and stock awards, where applicable.

Lark is an Equal Opportunity and Affirmative Action Employer. We believe that diverse teams foster innovation and add to our mission-driven culture. We strongly encourage people from underrepresented groups to apply.