Staff Data Platform Engineer

Key Skills

Apache Airflow, AWS, Azure, B2B, Continuous Integration & Continuous Delivery - CI/CD, Data science techniques, Docker, Effective communication skills, ETL frameworks, Google Cloud Platform (GCP), Machine learning techniques, MLflow, Pandas, PySpark, R Programming

Job Description

Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.

We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!

The challenge

This is an exciting new opportunity for an experienced Senior/Staff data platform engineer! You will build and maintain scalable, rock solid data pipelines for analysts and machine learning engineers. You will collaborate closely with cross-functional teams across Adobe to enable efficiencies in various stages of data lifecycle from storage, processing to analysis and extraction of actionable insights. You will use your expertise in data engineering, machine learning solutions, and cloud platforms to deliver innovative solutions.

The role will be located in San Jose Bay Area, but our team is distributed across the United States and Europe. 

The ideal candidate will have a passion for simplifying and automating workflows, for researching unexplored domains and for being efficient and helping the team do more with less. 

What you will do

• Build and maintain data infrastructure on cloud platforms using AWS or Azure services.
• Ensure data quality and integrity by implementing data validation and cleansing process.
• Optimize data and processing pipelines for scalability, reliability and fault-tolerance by using data volume, velocity and variety metrics.
• Collaborate with data scientists and analysts to understand data requirements and translate them into scalable, high performant data ETL solutions.
• Mentor and provide technical guidance to junior data engineers promoting knowledge sharing across the team.
• Work with external partners to facilitate data access.
• Lead sophisticated, large-scale projects in an Agile environment using Git, Jenkins, Docker, Marathon, Mesos.

Required skills

• Master's degree in Computer science, Engineering or a related field.
• 8+ years of experience in data engineering, machine learning, and/or cloud tech.
• Strong analytical and problem solving skills. Think strategically and make data driven decisions.
• Proficient in Python, scripting, strong SQL and query optimization techniques.
• Hands-on experience with cloud platforms(AWS, Azure, GCP) and related services(S3, blob store, Databricks, ADLS Lake storage, Azure Data Explorer)
• Experience in a DevOps role, configuring and launching Docker containers, Jenkins for CI/CD, airflow for scheduling and orchestration
• Knowledge of machine learning pipelines and frameworks like MLFlow
• Strong leadership skills with the ability to mentor and inspire junior team members.
• Passion for continuous betterment (i.e. better workflows, automation, efficiency)
• Excellent in teamwork and communication skills

Preferred skills

• Experience and knowledge of Digital Analytics or Digital Marketing products
• Knowledge of statistics or experience with pandas, pyspark or R
• Experience in a B2B environment is a plus
• Staying up-to-date with industry trends and emerging technologies to drive continuous improvement.

Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $146,400 -- $275,000 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.

At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).

In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.

Adobe is proud to be an Equal Employment Opportunity and affirmative action employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more.