Data Engineer- Costco Logistics BI

Key Skills

Apache Kafka, Azure, Azure COSMOS, Data Lake, ETL/ELT technologies, GraphQL, MySQL, NoSQL, SQL, Web APIs, XML-JSON

Job Description

The Data Engineer - Costco Logistics BI is responsible for the end to end data pipelines to power Costco Logistics reporting. This role is focused on data engineering to build and deliver automated data pipelines from a plethora of internal and external data sources. The Data Engineer will partner with product owners, engineering and data platform teams to design, build, test, and automate data pipelines that are relied upon across the company as the single source of truth.

If you want to be a part of one of the worldwide BEST companies “to work for”, simply apply and let your career be reimagined.

ROLE

• Develops and operationalizes data pipelines to make data available for consumption (Costco Logistics BI).

• Works with data architects and data/BI engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality, and orchestration.

• Designs, develops, and implements ETL/ELT processes using IICS (Informatica Cloud).

• Uses MySQL to improve and speed up delivery of our data products and services.

• Uses Azure services such as Azure SQL DW (Synapse), ADLS, Azure Event Hub, Azure Data Factory to improve and speed up delivery of our data products and services.

• Implements big data and NoSQL solutions by developing scalable data processing platforms to drive high-value insights to the organization.

• Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery.

• Identifies ways to improve data reliability, efficiency, and quality of data management.

• Communicates technical concepts to non-technical audiences both written and verbal.

• Performs peer reviews for other data engineer’s work.

REQUIRED

• 3+ years’ experience engineering and operationalizing data pipelines with large and complex datasets.

• 2+ years’ experience with Informatica PowerCenter.

• 2+ years’ experience with Informatica IICS.

• 2+ years’ experience working with Cloud technologies; such as ADLS, Azure Databricks, Spark, Azure Synapse, Cosmos DB, and other big data technologies.

• 2+ years’ experience with Data Modeling, ETL, and Data Warehousing.

• 2+ years’ experience implementing data integration techniques such as event / message based integration (Kafka, Azure Event Hub), ETL.

• 2+ years’ experience with Git / Azure DevOps.

• Extensive experience working with various data sources; SQL, Sql Server database, flat files (csv, delimited), Web API, XML.

• Advanced SQL skills; Understanding of relational databases, business data, and the ability to write complex SQL queries against a variety of data sources.

• Strong understanding of database storage concepts; Data Lake, Relational Databases, NoSQL, Graph, Data Warehousing.

• Able to work in a fast-paced agile development environment.

Recommended

• Microsoft Azure/similar certifications.

• Experience delivering data solutions through agile software development methodologies.

• Experience with PowerShell, Python or similar scripting language.

• Experience with UC4 Job Scheduler.

• Exposure to the retail industry.

• Excellent verbal and written communication skills.

• BA/BS in Computer Science, Engineering, or equivalent software/services experience.

Required Documents

• Cover Letter

• Resume

California applicants, please click here to review the Costco Applicant Privacy Notice. 

Pay Ranges:

Level 1 - $75,000 - $110,000

Level 2 - $100,000 - $135,000

We offer a comprehensive package of benefits including paid time off, health benefits - medical/dental/vision/hearing aid/pharmacy/behavioral health/employee assistance, health care reimbursement account, dependent care assistance plan, short-term disability and long-term disability insurance, AD&D insurance, life insurance, 401(k), stock purchase plan to eligible employees.

Costco is committed to a diverse and inclusive workplace. Costco is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or any other legally protected status. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to IT-Recruiting@costco.com

If hired, you will be required to provide proof of authorization to work in the United States. Applicants and employees for this position will not be sponsored for work authorization, including, but not limited to H1-B visas.