Senior Big Data Engineer

Key Skills

Aartificial intelligence, Apache Flink, Big Data Technology, Docker, ETL frameworks, Java Programming, Machine learning techniques, Scala Programming, SPARK Programming, SQL

Job Description

Our Recommendations team works on delivering recommendations at scale and in near real time to our buyers on our website and native app platforms. Recommendations are a core part of how our buyers navigate eBay’s vast and varied inventory. Our team develops state-of-the-art recommendations systems, including deep learning based retrieval systems for personalized recommendations, machine learned ranking models, as well as advanced MLOps in a high volume traffic industrial e-commerce setting.We are building cutting edge recommender systems powered by the latest ML, NLP, LLM and AI techniques. Some papers published by our research team lately:

Automatic Future Product Releases Extraction from Web Data

Personalized Ordering of Recommendation-Modules on an E-Commerce Homepage ​

Responsibilities:

Working with our AI/ML researchers and our Buyer Product group - Senior Big Data Engineer handles

• ETL data pipelines

• Model training

• Model deployment

• Analysis and monitoring

Need to manage integration points with the following groups:

• Researchers

• Product

• Platforms

• Data

• Application backend

This requires good written communication skills in English.

Required experience:

• Python - 6+ years

• Apache Spark (pyspark) 6+ years

• SQL

• model deployment

• dockers

Additional optional experience:

• Backend - Java/Scala

• Orchestration AirFlow/Jenkins

• Near Real Time processing - Apache Flink/ Spark Streaming

Please see the Talent Privacy Notice for information regarding how eBay handles your personal data collected when you use the eBay Careers website or apply for a job with eBay.

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at talent@ebay.com. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.