Data Engineer - BI and Analytics Ecom

Key Skills

Agile methodologies, Azure, Big Data Technology, Continuous Integration & Continuous Delivery - CI/CD, Data Architecture, Data Engineering, Data science techniques, Data Warehousing, DevOps, Effective communication skills, ETL/ELT technologies, Git, NoSQL, SQL, Writing

Job Description

Responsible for developing and operationalizing data pipelines to make data available for consumption (reports and advanced analytics). This includes data ingestion, data transformation, data validation / quality, data pipeline optimization, orchestration; and engaging with DevOps Engineer during CI / CD. The role requires a grounding in programming and SQL, followed by expertise in data storage, modeling, cloud, data warehousing, and data lakes. The Data Engineer works closely with Data Architects, Data Scientists and BI Engineers to design and maintain scalable data models and pipelines.

If you want to be a part of one of the worldwide BEST companies “to work for”, simply apply and let your career be reimagined.

ROLE

• Designs, develops, implements and operationalizes ETL/ELT processes using IICS (Informatica Cloud).
• Works in tandem with Data Architects and data/BI Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality, orchestration.
• Creates and maintains optimal data pipeline architecture.
• Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery.
• Implements big data and NoSQL solutions by developing scalable data processing platforms to drive high-value insights to the organization.
• Supports development of Data Dictionaries and Data Taxonomy for product solutions.
• Demonstrates strong understanding with coding and programming concepts to build data pipelines (e.g. data transformation, data quality, data integration, etc.).
• Builds data models with Data Architect and develops data pipelines to store data in defined data models and structures.
• Demonstrates strong understanding of data integration techniques and tools (e.g. Extract, Transform, Load (ETL) / Extract, Load, Transform (ELT)) tools and database architecture.
• Demonstrates strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
• Identifies ways to improve data reliability, efficiency and quality of data management.
• Conducts ad-hoc data retrieval for business reports and dashboards.
• Assesses the integrity of data from multiple sources.
• Manages database configuration including installing and upgrading software and maintaining relevant documentation.
• Monitors database activity and resource usage.
• Performs peer review for another Data Engineer’s work.
• Designs, develops, implements, and operationalizes ETL/ELT processes using IICS (Informatica cloud).
• Works in tandem with data architects and data/BI engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality, and orchestration.
• Uses Azure services such as Azure SQL DW (Synapse), ADLS, Azure Event Hub, Azure Data Factory to improve and speed up delivery of our data products and services.

REQUIRED

• 8+ years’ experience engineering and operationalizing data pipelines with large and complex datasets.
• 8+ years’ hands-on experience with Informatica IICS or PowerCenter.
• 5+ years’ experience with Data Modeling, ETL, and Data Warehousing.
• 2+ years’ experience working with Cloud technologies such as ADLS, Azure Databricks, Spark, Azure Synapse, Cosmos DB, and other big data technologies.
• Experience with digital ecommerce and clickstream data 
• Extensive experience working with various data sources (SQL, Oracle database, flat files (csv, delimited), Web API, XML.
• Advanced SQL skills. Solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
• Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
• Able to work in a fast-paced agile development environment.
• Scheduling flexibility to meet the needs of the business including weekends, holidays, and 24/7 on call responsibilities on a rotational basis.

Recommended

• BA/BS in Computer Science, Engineering, or equivalent software/services experience.
• Azure Certifications.
• Experience implementing data integration techniques such as event/message-based integration (Kafka, Azure Event Hub), ETL.
• Experience with Git / Azure DevOps.
• Experience delivering data solutions through agile software development methodologies.
• Exposure to the retail industry.
• Excellent verbal and written communication skills.
• Experience with UC4 Job Scheduler.
• Experience with Power BI.

Required Documents

• Cover Letter
• Resume

California applicants, please click here to review the Costco Applicant Privacy Notice. 

Pay Ranges: 

Level 2 - $100,000 - $135,000

Level 3 - $125,000 - $165,000

Level 4 - $155,000 - $195,000, Bonus and Restricted Stock Unit (RSU) eligible

We offer a comprehensive package of benefits including paid time off, health benefits - medical/dental/vision/hearing aid/pharmacy/behavioral health/employee assistance, health care reimbursement account, dependent care assistance plan, short-term disability and long-term disability insurance, AD&D insurance, life insurance, 401(k), stock purchase plan to eligible employees.

Costco is committed to a diverse and inclusive workplace. Costco is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or any other legally protected status. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to IT-Recruiting@costco.com