Lead Software Engineer - Data Exchange

Key Skills

Apache Kafka, AWS, Big Data Technology, DevOps, Django, Docker, Flask, Grafana, Jenkins, Kubernetes-K8s, Leadership, MySQL, Python Programming, RabbitMQ, REDIS, Software Development, Terraform

Job Description

Klaviyo operates a real-time data analytics platform coded primarily in Python that is built for massive scale and hosted on Amazon Web Services (AWS). Engineers come to Klaviyo with experience in a variety of languages and from a number of disciplines.

The Data Exchange team is responsible for designing and building software that enables data transmission in and out of the Klaviyo platform through a variety of protocols and delivery mechanisms. The team collaborates closely with internal stakeholders and has substantial exposure to Klaviyo's customers, including businesses, partners, and third-party developers. Data Exchange operates at the intersection of distributed systems, data pipelining, software architecture, scalability, and reliability. 

At Klaviyo, we love tackling tough engineering problems and look for employees who specialize in certain areas but are passionate about building, owning & scaling features end to end from scratch and breaking through any obstacle or technical challenge in their way. We push each other to move out of our comfort zone, learn new technologies, and work hard to ensure each day is better than the last. Klaviyo is growing fast and we have openings for all skill levels across all of our teams.

How you’ll make an impact

This team is a key contributor to the evolution of Klaviyo into a data platform , enabling hundreds of thousands of Klaviyo customers to effectively leverage and activate their data. Critical components of the data platform include data collection and data distribution, which must be both reliable and scalable as Klaviyo continues to expand its support for various methods of data import and export. As a Lead Software Engineer, you will define and own the architecture for data collection and distribution. You will contribute to the advancement of our data movement framework and play a key role in shaping Klaviyo's data platform evolution, aligning with our vision, mission, and strategy. You’ll work with a team of talented and experienced software engineers who are eager to grow fast and make an impact on the company.

What you’ll do

• Be independently responsible for the entire lifecycle of projects or features including design, development, and deployment, providing direction for others
• Work closely with Product and other Engineering leads to refine the strategy and make valuable contributions to the roadmap that align with company worldwide growth
• Be responsible for the technical/architectural evolution of your product area; identify and advocate for scalability, reliability, and maintainability needs
• Be responsible for technical quality, teach others technical expertise and help them develop skills they need to improve within the organization
• Establish expertise in multiple internal and industry practices, patterns, tools, languages, and processes; Contributes beyond the team to share new patterns, tools, etc.
• Master diverse internal and industry practices, tools, and processes. Share new insights and contribute beyond the team.

Who you are

• Passionate about building software effectively and for the long-term. Have experience building products that matter. Have proven expertise in applying relevant design patterns to implementing highly-scalable multi-tenant systems.
• Like working on small, autonomous agile teams. Enjoy shipping code early and often in an agile fashion, pairing with product management, business stakeholders, and other engineers to craft better software.
• Have in-depth knowledge and extensive experience working with distributed architectures, data processing systems, big data stack, and process control systems. Have understanding of domain-driven design and data management patterns.
• Motivated by having ownership and leading others, excited about taking the initiative to solve tasks in collaboration with others. Have experience leading projects and groups of engineers.
• Have expertise assessing risks and alternatives. Have solid understanding of prioritizing organizational, technical, and product needs.
• Promote shared understanding among leadership and considers others when making decisions. Regularly mentor fellow engineers, ensuring their skill development aligns with organizational growth.
• Love digging into performance, scalability, and reliability issues to drive breakthrough solutions. You recognize all problems can be solved and are capable of rallying others to address business needs.

Tech Stack

We are looking for a backend-focused engineer, experience with frontend development is preferred but not mandatory. Previous experience with Python is desirable. The tech stack you’ll be working with:

• Python, Django
• Apache Kafka, Apache Pulsar, RabbitMQ, and other tech from the big data stack
• MySQL, Redis
• Graphite, statsd, Grafana
• AWS, Terraform, Docker, Kubernetes, Jenkins, and other modern DevOps tools

Get to Know Klaviyo

We’re Klaviyo (pronounced clay-vee-oh). We empower creators to own their destiny by making first-party data accessible and actionable like never before. We see limitless potential for the technology we’re developing to nurture personalized experiences in ecommerce and beyond. To reach our goals, we need our own crew of remarkable creators—ambitious and collaborative teammates who stay focused on our north star: delighting our customers. If you’re ready to do the best work of your career, where you’ll be welcomed as your whole self from day one and supported with generous benefits, we hope you’ll join us.