Staff Software Engineer, Data

Key Skills

AWS, Big Data Technology, Data Analysis, Data Biuld Tool - dbt, ETL frameworks, Google BigQuery, Google Cloud Platform (GCP), Java Programming, Optimization, Python Programming, RESTful, SQL, XML-JSON

Job Description

The core metrics team is a new engineering team we are setting up in Viant. This team will own the metrics that are responsible for billable events that feed into reports, billing, and finance artifacts, and deal with data governance responsibilities including Accuracy, Auditability, Standardization, Compliance, Performance & Cost optimization etc. Our platform uses advanced machine learning techniques and the newest big data processing technologies, and is deployed in a distributed, multi-region, cloud-based infrastructure.

As a Staff engineer in the Core Metrics team, you will have the opportunity to work on the design and implementation of big data systems, working with petabytes of data and billions of transactions in real-time. As an individual contributor, you will be responsible for building core pieces of Viant’s billable metrics handling strategy. You will acquire a deep technical understanding of how data flows through Viant’s systems. You will work with other technical leads on the design and implementation of these interconnected services, ensuring that the system evolves to keep pace with the speed, scale and agility that modern day systems are expected to support.

THE DAY-TO-DAY

• Designing, developing, testing, debugging, and deploying applications using various cloud technologies in a hybrid cloud environment in GCP and AWS.
• Writing/Optimizing complex SQL queries.
• Write ELT jobs using various tools and programming languages.
• Proactively improve existing code and optimize existing ETL processes based on constraints of time and cost.
• Import and export large amounts of data in formats like CSV, JSON, Parquet, etc.
• Solving complex performance problems, architectural challenges, and production issues.
• Team work with product owners, fellow engineers, and operations team members.
• Mentor/Help team members as and when required.

MUST HAVE

• 8+ years of professional experience in the software industry, including 2+ on data-focused projects.
• Must have extensive experience in Big Data technologies.
• 2+ years experience with Google Big Query.
• Must have high proficiency in SQL.

GREAT TO HAVE

• Minimum B.S in computer science, mathematics, or related field.
• Experience performing requirements gathering and identifying the requirement gaps.
• Experience with building web services/ RESTful services/ microservices.
• Ability to perform data analysis on incoming data from 3rd parties and identify data issues by using SQL or other db technologies.
• Working experience with Java, Python or Go.
• Ability to effectively identify, troubleshoot and resolve potential production issues in a timely manner.

LIFE AT VIANT

• Investing in our employee’s professional growth is important to us, but so is investing in their well-being. That’s why Viant was voted one of the BEST PLACES TO WORK!
• Some our favorite employee benefits include fully paid health insurance, paid parental leave and unlimited PTO and more. View a list of our benefits here.

$180,000 - $220,000 a year

In accordance with California law, the range provided is Viant’s reasonable estimate of the compensation for this role. Final title and compensation for the position will be based on several factors including work experience and education.