Senior Python Engineer

Key Skills

Apache Beam, Apache Flink, Data science techniques, Large scale data processing, Machine learning techniques, Python Programming, PyTorch, Rust, Spark Core, TensorFlow

Job Description

About Us

Union.ai is a Seattle-based startup founded by a team of former Lyft engineers. We contribute toFlyte, an open source platform for orchestrating massively scalable machine learning pipelines running on Kubernetes.

These pipelines power some of the most popular apps on your phone, as well as applications in diverse industries such as song sharing, vaccine research, early cancer detection, global map rendering, financial projecting, and piloting autonomous vehicles.

The Opportunity

Here at Union.ai, we are an open source first company! We provide infrastructure for our customers to build delightful Machine Learning driven products and deliver them in production. As the lead Python engineer, you will be working on our Flyte OSS product. Our ideal candidate will get immense satisfaction out of knowing and upholding the intricacies and nuances of the Python language. This person will guide us in setting best practices around how our community and team members write performant Python code and tooling.

In this role, you will:

• Lead the development of Python products at Union (e.g. flytekit, unionml, pandera)
• Advocate for best practices across the Python language
• Go deep. Implement a DSL that mirrors the Python core language
• Get satisfaction out of understanding and solving our users’ ML and data challenges
• Learn about new tools and libraries in the ML landscape, understanding their impact and use-cases, and implementing elegant integrations within Flyte

About You:

• 5+ years as a backend engineer with 2+ years of experience in Python
• Professional background in a Data science/engineering and ML
• Experience building Python libraries and compilers
• Bachelor’s Degree in Computer Science or related field, or equivalent experience
• Experience with ML Frameworks (Pytorch, Tensorflow, etc) or Data processing frameworks (Spark, Flink, Beam etc) a plus
• Open-source contributions in Python is a plus
• Knowledge of Rust and PyO3 is a plus

Benefits & Belonging

AtUnion.ai we know that employees who feel their best can build amazing things and we are proud to offer best in class benefits that will continually evolve and grow as the needs of our employees do. Benefits may vary based on country

• Excellent medical - We pay 100% of your premiums and 90% for your dependents
• Generous dental and vision plans- We pay 80% of the premiums for you and your dependents
• Meaningful equity in the form of options – all employees are owners here
• Unlimited PTO + 12 company holidays
• 401K match:Union.ai matches 100% of contributions up to the first 3%, and 50% up to 5%
• 12 weeks paid parental leave for primary and secondary caregivers
• Flexible work schedule at a remote friendly company

We believe that our differences are what bring us together to achieve truly special outcomes. We strive to be inclusive and focus on building teams that embody that quality too.Union.ai is an equal-opportunity employer and we encourage you to apply, even if your experience doesn’t align exactly with our job description.