AI Software Engineer - Data Platform - SF

Key Skills

Aartificial intelligence, Apache Flink, Databricks, Design, Docker, DynamoDB, Machine learning techniques, SPARK Programming

Job Description

We Are Hiring: Software Engineer – AI Data Platform

Perplexity is seeking an experienced Software Engineer to help build the next-generation AI Data Platform, revolutionizing how people search and interact online. In this role, you will develop Perplexity’s end-to-end AI data stack and flywheel, which powers all AI products, ML use cases, and language models.

Perplexity is rapidly scaling in both the number of use cases and users. Our data stack enables scalable, personalized, and fast answers for millions worldwide.

Tech Stack: Spark | AWS Data Stack (S3, RDS, DynamoDB, Docker, EKS, Kinesis) | PyTorch | Docker | Databricks | Snowflake

Responsibilities

• Collaborate with AI Product, Applied ML, Post-Training, and Data Science teams to design, build, and maintain scalable data pipelines and data lakes.
• Develop, deploy, and monitor the entire data lifecycle for ingestion, transformation, streaming, and storage at high scale.
• Implement tools and abstractions on top of data infrastructure for analytics, recommendations, AI products, and post-training use cases.
• Work closely with product and AI teams to develop reusable data resources and design patterns.

Qualifications

• Extensive programming and data engineering skills, with proficiency in open-source & distributed data processing (AWS, Spark, Flink, Iceberg).
• Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark Streaming, CDC).
• Strong quantitative and engineering skills with experience in estimating performance at high scale.
• Experience supporting ML/AI engineering teams in building scalable platforms to accelerate R&D for frontier models and AI products.
• Self-motivated with a strong sense of ownership of systems and designs.
• 5+ years of industry experience in distributed systems or AI infrastructure.

Compensation & Benefits

Salary: $200,000 - $280,000 (final offer depends on experience and expertise).

Equity: Equity is included as part of the total compensation package.

Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

About Perplexity

Since launching the world’s first fully functional conversational answer engine just over a year ago, Perplexity has seen tremendous growth. Our AI-powered search assistant has reached 10 million monthly active users as of early 2024, with over 1 million mobile app installs across iOS and Android. In 2023 alone, we served over 500 million queries from users worldwide.

To support our rapid expansion, we've raised significant funding from top technology investors. In January 2024, we secured $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. This was followed by a $62.7 million Series B1 round in April 2024, led by Daniel Gross, valuing Perplexity at over $1 billion.

Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.

Join us as we redefine search and knowledge discovery.