DevOps Data Engineer

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

This is an environment unlike anything in the high-tech world and the secret of Costco’s success is its culture. The value Costco puts on its employees is well documented in articles from a variety of publishers including Bloomberg and Forbes. Our employees and our members come FIRST. Costco is well known for its generosity and community service and has won many awards for its philanthropy. The company joins with its employees to take an active role in volunteering by sponsoring many opportunities to help others. In 2018, Costco contributed over $39 million to organizations such as United Way and Children's Miracle Network Hospitals.

Costco IT is responsible for the technical future of Costco Wholesale, the second largest retailer in the world with wholesale operations in twelve countries. Despite our size and explosive international expansion, we continue to provide a family, employee centric atmosphere in which our employees thrive and succeed. As proof, Costco consistently ranks in the top five of Forbes “America’s Best Employers”.

As a DevOps Data Engineer, your responsibilities will include the design and implementation of cloud based (Azure) data services, pipelines and infrastructure. You will partner with several teams (BI, Developers, Data Scientists, Project Managers, etc.) to understand their data use cases and/or requirements to provide solutions. You will be involved in the entire project lifecycle including architecture, design, development, deployment, and ongoing enhancements. You will be responsible for staying current on the latest technologies and industry best practices to ensure that business objectives are consistently being met using modern solutions.

If you want to be a part of one of the BEST “to work for” companies in the world, simply apply and let your career be reimagined.

ROLE

• Designs, develops, documents and implements complex data architectures.
• Builds deployment automation with configuration as code to provision data cloud services/infrastructure.
• Adopts engineering best practices to deliver higher quality and scalable solutions.
• Develops and documents standards and best practices, and mentors junior engineers.
• Interprets complex issues and clearly communicates them to others.
• Stays abreast of emerging DevOps and Data technologies/tools.
• Works in Agile environment, collaborates with Operations, Development, and QA functions to develop solutions and systems that are predisposed to scalability, security and simplified maintenance.

REQUIRED

• 3+ years’ experience using, managing and provisioning Azure Services: Azure SQL DW (Synapse), ADLS, Azure Event Hub, Azure Data Factory, etc.)
• 3+ years’ experience with Automation and Orchestration tooling/technology (Azure DevOps, Terraform, Jenkins, Git, etc.)

• Demonstrated experience with Continuous Integration/Continuous Delivery

• Experience supporting, maintaining and monitoring data pipelines (real time & batch)
• Solid understanding of Data Modeling, ETL & Data Warehousing
• Strong scripting skills (Powershell, Bash, Python etc.)
• Deep understanding of development/coding methodologies.
• Must have high integrity, accountability, a positive attitude, and be willing to do what it takes to make the team successful.
• Must be extremely responsive, able to work under pressure in crisis with a strong sense of urgency.
• Responsible, conscientious, organized, self-motivated and able to work with limited supervision.
• Must be detail-oriented and possess strong problem-solving skills and ability to analyze for potential future issues.
• Able to support off-hours work as required, including weekends, holidays, and 24/7 on call responsibilities on a rotational basis.

Recommended

• Azure certification(s).
• Experience with Databrick’s Delta Lake
• Experience with multiple coding languages (Python, Spark, Scala, R, Java, etc.)
• Experience with APIs & Webservices
• Experience with Reporting Tools (PowerBI, Tableau, Alteryx)
• Knowledge of Information Security best practices & principles (certificates, encryption, etc.)
• Knowledge of BigData (HDFS/Hadoop)
• Knowledge of Agile Methodologies (scrum, kanban)