Data Engineer III - Databricks

Key Skills

Apache Airflow, Cybersecurity, Data Modeling, Data pipelines, Data science techniques, Databricks, Design, ETL frameworks, Linux Operating system, Metadata, Oracle, PLSQL, Python Programming, Snowflake, SQL, Unix Operating system

Job Description

What you’ll be doing:

• Design, build and test end to end data pipeline including data ingestion (streaming, events, and batch), data integration, data curation
• Build and support data platform on the cloud
• Define and implement automation of jobs and testing
• Support mission critical applications and near real time data needs from the data platform
• Build and support reusable framework to ingest, integration and provision data
• Capture and publish metadata and new data to subscribed users
• Participate in design and code reviews
• Create physical data model

What you bring to the table:

• Ability to work collaboratively with product managers, data scientists as well as business partners and actively participate in design thinking sessions
• Ability to work with cybersecurity teams and infrastructure teams to secure and protect valuable data from inappropriate access or data loss
• Ability to determine the risk/potential for various configurations and options for data administration and communicate the issues to managers and team as required

Qualifications :

What’s needed- Basic Qualifications

• Bachelor’s degree in related field or equivalent work experience
• Minimum of 5 years of experience
• Experience with Apache Airflow
• Experience with Databricks
• Experience with Data Modelling, ETL

 What’s needed- Preferred Qualifications

• Experience with SQL Developer
• Experience with Snowflake
• Experience with Unix/Linux Shell Scripting, Oracle SQL/PLSQL Scripting
• Experience with Python

We Offer:

• Inclusive culture with associate-led Business Resource Groups
• Flexible PTO (22 days) and Holiday Schedule (7 observed paid holidays)

Online and Retail Discounts, Company Match 401(k), Physical and Mental Health Wellness programs, and more perks and benefits