Analytical and Problem solving, Ansible, Apache Kafka, Applied Machine Learning, AWS, Azure, Git, Google Cloud Platform (GCP), GPUs, Java Programming, Jenkins, Jupyter Notebook, Kubernetes-K8s, Puppet, Python Programming, PyTorch, Scala Programming, Shopify, SPARK Programming, Zookeeper
Bloombergs internal Data Science Platform was established to support development efforts around data-driven compute, machine learning, and business analytics. The proprietary solution aims to provide scalable compute, specialized hardware and first-class support for a variety of workloads such as Spark, PyTorch, and Jupyter. By using containerization, container orchestration and a cloud-native design, Bloomberg created a data science product with portable and composable infrastructure building blocks. This facilitated Bloomberg to rapidly evolve, scale and adapt to new challenges and opportunities in the data science space.
Being one of the most critical stages of machine learning, distributed ETL processing has contributed to the largest compute footprint within Bloomberg’s data science so, especially through its Apache Spark offering. To effectively manage Apache Spark on Kubernetes, the Spark Runtimes team uses its inhouse Spark expertise and standard methodologies around infrastructure management, scalability, and security to provide support for a powerful, flexible, and centralized Spark product.
As the needs of distributed compute, machine learning, data exploration and analysis advance, so does the need of the Spark runtime that underpins it. Our runtime is poised for continued growth to accommodate the endless number of products across Bloomberg that rely on a robust ETL offering. Highlights from our upcoming roadmap focus on: enabling pluggable batch scheduling capabilities, increased resiliency when running in a pre-emptive environment, deeper integration with cloud-based Spark environments, and enhanced dynamic allocation support.
The Role:
As a member of the Spark Runtimes team, you’ll make key technical decisions to keep this solution moving forward. Our team makes extensive use of open source (e.g. Spark, Kubernetes, Buildpacks, Kubeflow, Jupyter etc.) and is deeply involved in a number of upstream communities. We collaborate widely with the industry, contribute back to the open source projects, and present at conferences. While working on the runtime, the backbone for many of Bloomberg's upcoming products, you will have the opportunity to collaborate with engineers and mutually learn about the technology that delivers products from the news to financial instruments.
Well trust you to:
You'll need to have:
We'd love to see:
Interviewing with us:
We believe interviewing is a two way street. It's a way for us to get to know you and your skills, and also a way for you to learn more about the team, our technical challenges, and what you'd be working on. The content of each interview round will be tailored to the role and your background, but the general framework can be found here: https://www.bloomberg.com/careers/technology/engineering/software-engineering-experienced-hire
We want to ensure you can put your best foot forward throughout the process, so if you have any questions or need any accommodations to be successful, please let us know!
We have a lot of opportunities to choose from in Engineering, and it is important to us that your skills and experience aligns best with the team you are interviewing with. To help ensure you are placed on the right team, your application will be considered for all of our current vacancies in Engineering at the first stage of the interview process.
Bloomberg is an equal opportunity employer, and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Salary Range: 160,000 - 240,000 USD Annually + Benefits + Bonus
The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.
We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation [Exempt roles only], paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.
Bloomberg L.P. is a privately held financial, software, data, and media company headquartered in Midtown Manhattan, New York City. It was co-founded by Michael Bloomberg in 1981, with Thomas Secunda, Duncan MacMillan, Charles Zegar, and a 12% ownership investment by Merrill Lynch.
New York, NY, USA
2-4 year
New York, NY, USA
2-4 year
San Francisco, CA, USA
2-4 year
New York, NY, USA
0-2 year
New York, NY, USA
4-6 year
New York, NY, USA
4-6 year
New York, NY, USA
4-6 year
Tokyo, Japan
2-4 year
New York, NY, USA
6-8 year
New York, NY, USA
4-6 year
New York, NY, USA
4-6 year
New York, NY, USA
4-6 year
Princeton, NJ, USA
10-12 year
Princeton, NJ, USA
4-6 year
San Francisco, CA, USA
4-6 year