Senior Software Development Engineer, Big Data

Key Skills

Apache Airflow, Apache Hadoop, Apache Hive, Big Data Technology, Data science techniques, Java Programming, Machine learning techniques, Presto, Python Programming, Scala Programming, Software Development, SPARK Programming

Job Description

As a Senior Software Development Engineer in the Zillow Group Data Management team, you will play a central role for powering analytical and ML teams by providing validated high-quality property datasets that are a single source of truth across the organization. In addition, you will:

• Design, implement, and take ownership of mission-critical ETL pipelines
• Contribute to the architecture and development of near real-time/batch data products
• Work closely with business stakeholders, data analysts, data scientists, and machine learning engineers to productionalize analytic solutions
• Enable product engineering teams to onboard their data using data mesh principles and architecture.

About the Role

 As a Senior Software Development Engineer on the Zillow Group Data Management team, you will play a central role in empowering the ML and analytics teams by providing high-quality, validated property data sets that are a single source of truth. throughout the organization. Additionally, you must:

• Design, implement and take ownership of mission-critical ETL pipelines.
• Contribute to the architecture and development of near real-time/batch data products
• Work closely with business stakeholders, data analysts, data scientists and machine learning engineers to produce analytical solutions.
• Enable product engineering teams to ingest their data using data mesh principles and architecture.

This role has been categorized as a teleworker position. Teleworkers do not have a permanent corporate office workplace and, instead, work from a physical location of their choice which must be identified to the Company. Employees may live in any part of Mexico, but preferably in Mexico City, as we would encourage attendance for occasional in-office events.

In addition to a competitive base salary and benefits, this position is also eligible for equity awards based on factors such as experience, performance and location.

Who you are

• Have previously designed and built complex, highly scalable/reliable data pipelines, using the Big Data ecosystem (Hadoop/Hive/Spark/Presto/Airflow/Kinesis or equivalents)
• 5+ years of Software development experience with high proficiency in Python, Java, Scala or another language
• Must have SQL knowledge
• Must have a thorough knowledge of data structures and algorithms
• Must have prior experience working with customers to understand and capture requirements.
• Understands the concepts behind distributed databases, and both streaming and batch-processing systems

who are you

Have previously designed and built complex, highly scalable/reliable data pipelines, using the Big Data ecosystem (Hadoop/Hive/Spark/Presto/Airflow/Kinesis or equivalents).

More than 5 years of experience in software development with a high command of Python, Java, Scala or another language.

Must have knowledge of SQL

Must have in-depth knowledge of data structures and algorithms

Must have prior experience working with clients to understand and capture requirements

Understands the concepts of distributed databases and stream and batch processing systems.

Get to know us

Zillow is reimagining real estate to make it easier to unlock life’s next chapter.

As the most-visited real estate website in the United States, Zillow® and its affiliates help movers find and win their home through digital solutions, first class partners, and easier buying, selling, financing and renting experiences. Millions of people visit Zillow Group sites every month to start their home search, and now they can rely on Zillow to help make it easier to move. The work we do is helping people move from dreaming to transacting — and no matter what job you're in, you will play a critical role in making this vision a reality.

Our efforts to streamline the real estate transaction are supported by a deep-rooted culture of innovation, our passion to redefine the employee experience, and a fundamental commitment to Equity and Belonging. We’re also setting the standard for work experiences of the future, where our employees are supported in doing their best work and living a flexible, well-balanced life. But don’t just take our word for it. Read recent reviews on Glassdoor and recent recognition from multiple organizations, including: the 100 Best Companies to Work For in 2022 list, Glassdoor Employees’ Choice Award, honoring the Best Places to Work in 2022, Bloomberg Gender-Equality Index 2022, Human Rights Campaign (HRC) Corporate Equity Index and Best Place to Work for LGBTQ Equality 2022, and TIME 100 Most Influential Companies list.