data engineer sr

Key Skills

Agile methodologies, Apache Hadoop, Apache Hive, AWS, Azure, Continuous Integration & Continuous Delivery - CI/CD, Data Engineering, Data Governance, Data science techniques, Data Visualization, DevOps, NoSQL, Python Programming, REST API, Scala Programming, SoapUI, SPARK Programming, SQL, Tableau

Job Description

This position contributes to Starbucks success by building enterprise data services for analytic solutions. This position is responsible for design, development, testing and support for data pipelines to enable continuous data processing for data exploration, data preparation and real-time business analytics. Models and acts in accordance with Starbucks guiding principles.

Summary of Key Responsibilities

Responsibilities and essential job functions include but are not limited to the following:

• Work with data engineering and data science teams to support and optimize non-interactive (batch, distributed) & real-time, highly available data, data pipeline and technology capabilities
• Translate business requirements into technical requirements to ensure solutions meet business needs
• Work with infrastructure provisioning & configuration tools to develop scripts to automate deployment of physical and virtual environments; to develop tools to monitor usage of virtual resources. 
• Define & implement data retention policies and procedures 
• Define & implement data governance policies and procedures 
• Identify improvements in team coding standards and help in implementation of the improvements. 
• Leverage subject matter expertise to coordinate issue resolution efforts across peer support groups, technical support teams, and vendors 
• Develop and maintain documentation relating to all assigned systems and projects 
• Perform systems and applications performance characterization and trade-off studies through analysis and simulation 
• Perform root cause analysis to identify permanent resolutions to software or business process issues 

Basic Qualifications

• Education (minimum education level, degree or certification necessary): Bachelor’s degree in computer science, management information systems, or related discipline 
• 4+ years of professional industry experience with software development

Preferred Qualifications

Skills (minimum skills required): 

• 3+ years Hadoop, Hive, Spark
• 3+ years Python or Scala
• 2+ years SQL Platform
•  2+ years Data platform implementation on Azure or AWS
•  2+ years CI/CD experience
•  2+ years implementing data governance solutions
• 1+ Exposure to MPP solutions is a plus 

• Ability to apply knowledge of multidisciplinary business principles and practices to achieve successful outcomes in cross-functional projects and activities 
• Effective communication skills
• Excel at problem solving 
• Strong working knowledge of Python or Scala
• Strong working knowledge of SQL and No-SQL Platforms 
• Proficiency in debugging, troubleshooting, performance tuning and relevant tooling 
• Strong working knowledge of Hadoop, YARN, MapReduce, Hive, Spark
• Proven ability to productionalize big data implementations 
• Experience using one of the public cloud (AWS or Azure preferred) for data applications 
• Proficiency in shell scripting 
• Solid understanding of data design patterns and best practices 
• Proficiency in CI/CD tools
• Proficiency in logging and monitoring tools, patterns & implementations 
• Understanding of enterprise security, REST / SOAP services, best practices around enterprise deployments
• Proven ability and desire to mentor others in a team environment 
• Working knowledge of data visualization tools such as Tableau is a plus
• Practice agile and DevOps