Big Data Engineer, DevX

Key Skills

Apache Airflow, Apache Hadoop, Apache Hive, Apache Kafka, Argo, AWS, Big Data Technology, Continuous Integration & Continuous Delivery - CI/CD, Data Engineering, Data science techniques, Docker, Git, Java Programming, Kubernetes-K8s, Looker, PowerBI, Python Programming, SPARK Programming, SQL

Job Description

WHO WE ARE

Basis Technologies delivers software and services to automate digital media operations for more than 1,000 leading agencies and brands.

Our comprehensive ad tech platform, Basis, supports the planning, reporting, and financial reconciliation of direct, programmatic, search, and social media, all in one place.

We are deeply committed to building software that will change the ad tech industry for the better and are equally dedicated to building an inclusive culture of highly motivated individuals who create a positive and supportive environment together. We invest in our culture and support our employees so they can do their best work.

Basis Technologies is headquartered in Chicago, and our employees have the flexibility to work in an office location, completely remote, or a hybrid of the two. Please note, we are hiring on a remote working basis only in the U.S. and Canada.

ABOUT THE TEAM

Technology is at the core of what we do. Basis Technologies' innovative Engineering team designs and develops new features and integrations for Basis, our industry-leading, comprehensive software solution. Our platform processes over 300 billion events per day and uses AI and machine learning to automate and simplify the entire digital campaign process.

This team is all about data—and in order to create value from the massive amount of data we collect, engineering leverages their dynamic Data Engineering, Data Science, and Business Intelligence teams to create insights that benefit the industry as a whole.

WAYS YOU’LL CONTRIBUTE 

We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering organization. As a Big Data Engineer, DevX you will play a crucial role in creating the best developer experience for data and application engineers at Basis. You will design, implement and maintain deployment and ETL pipelines for data products. You will integrate with a multitude of products and APIs to ensure superior development, testing and release experience for developers. You will also contribute by:

• Integration: Integrate diverse data sources and vendor products, including databases, APIs, and third-party services to make data available for analytical and operational use.
• Automation: Automate repetitive and complex ETL deployment tasks to improve team efficiency and reduce manual intervention.
• Data Pipeline Design: Develop, deploy, and maintain scalable data pipelines for large volumes of data.
• Monitoring and Troubleshooting: Implement monitoring solutions to track data pipeline performance and quickly identify and resolve issues.

WHAT YOU BRING TO THE TABLE

• Strong computer science fundamentals
• Strong programming skills in Python or Java
• Proficiency with SQL and relational databases
• Proficiency with Snowflake and their services (development, performance tuning)
• Proficiency with workflow orchestration engines (Apache Airflow, Argo Workflows)
• Proficiency with CI/CD engines (Harness, Circle CI, Argo CI/CD, Jenkins)
• Proficiency with build management tools (Bazel)
• Proficiency with at least one of database versioning tool (Flyway, Sqitch or similar)
• Proficiency with source control systems (Git)
• Experience with containerization and orchestration tools (Docker, Kubernetes)
• Experience developing for BI tools (Looker, Thoughtspot, Power BI)
• Ability to work independently and manage multiple tasks

OUR TECH STACK

• Python, Scala
• Hadoop, Spark, Hive
• Snowflake
• Kubernetes, Docker, Harness
• Kafka
• Airflow, Oozie
• AWS

$5,000 - $6,900 a month

Our salary ranges are determined by role, level, and location. Individual salary is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your location during the hiring process. The total compensation package for this position may also include commission or bonus, company equity, and competitive benefits.

ANYTHING ELSE?

Don't think you have all the skills required for this role? That's okay, we recognize that experience can be built in many ways. If you have relevant skills that are not reflected in your resume, we welcome your candidacy and encourage you to share more in an optional cover letter, even if your experience doesn’t match our exact requirements. 

LIFE WITH BASIS TECHNOLOGIES

We take care of our people and believe that our success depends on the growth and well-being of each one of our team members.