Sr. Data and ML Engineer

Key Skills

Amazon Elastic Compute Cloud-EC2, Amazon Simple Storage Service (S3), Apache Hadoop, Apache Kafka, AWS, AWS Kinesis, Big Data Technology, CSS, Effective communication skills, Elasticsearch, HTML, Lambda, Machine learning techniques, RDBMS, Spark Core, SQL

Job Description

If you have a passion for Machine Learning and data engineering, a position within Comcast Applied AI & Discovery is the role for you. You will be responsible for creating and maintaining data pipelines and systems that support data analysis and machine learning. You will ensure that the data is high-quality, reliable, secure, scalable and performant. You will also contribute to the design and development of web application for data labeling and annotation. You will work closely with other engineers, product managers, and designers to deliver software solutions that meet the needs of our customers. This role requires strong skills and experience in working with various data sources, such as databases, APIs, streaming data, etc., and harmonizing them into a common and coherent format that can be easily accessed and processed by Machine Learning researchers for Natural Language Processing tasks.

Core Responsibilities

• Extracting data from various sources, such as SQL and noSQL databases, APIs or files.
• Work as part of a team responsible for the tools used to generate data for training the Machine Learning models that support our flagship products like Xfinity Voice Remote, Sky Voice Remote and the Xfinity Assistant.
• Optimizing and scaling data pipelines and systems to handle large volumes and velocities of data. 
• Creating and testing web applications for annotating high volumes of data.
• Ensuring that any updates in the data are propagated throughout the system with minimal delay.
• Applying data security and privacy mechanisms to safeguard data that is sensitive or confidential.
• Communicate effectively and act as a technical contact and liaison for our internal customers and product managers. Collaborate with stakeholders to understand product requirements and create suitable solutions.
• Guides the successful completion of programs that identify patterns and make decisions with minimal human intervention. Determines the technical objectives of an assignment. Leads the design of prototypes, partnering with the product team and other stakeholders through development. Conducts studies to support product or application development.
• Designs and implements end-to-end solutions using optimization and other advanced computer science technologies and owns live deployments. Aggregates huge amounts of data and information from large numbers of sources to discover patterns and features necessary to automate analytical models.
• Researches, writes and edits documentation and technical requirements, including evaluation plans, confluence pages, white papers, presentations, test results, technical manuals, formal recommendations and reports. Contributes to the company by creating patents, Application Programming Interfaces (APIs) and other intellectual property.
• Presents papers and/or attends conferences, as well as displaying leadership in these areas.
• Tests and evaluates solutions presented to the Company by various internal and external partners and vendors. Completes case studies, testing and reporting.
• Collaborates with teams outside of immediate work group. Represents the work team in providing solutions to technical issues associated with assigned projects.
• Mentor a diverse team of junior engineers in machine learning techniques, tools and concepts. Provides guidance and leadership to more junior engineers.
• Consistent exercise of independent judgment and discretion in matters of significance.
• Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) and overtime as necessary.
• Other duties and responsibilities as assigned.

Required Skills

• Ability to translate product requirements into production-ready applications.
• Proficiency in SQL and Python, which are widely used for querying and manipulating data.
• Familiarity with Spark, Hadoop, Kafka and other big data frameworks and tools that enable scalable and distributed data processing.
• Experience with AWS and other cloud platforms that offer various services and solutions for data engineering.
• Ability to design and implement data pipelines that ensure data quality, reliability and efficiency.
• Knowledge of data modeling and architecture principles that support the business needs and objectives.
• Knowledge of RDBMS and NoSQL databases.
• Communication and collaboration skills that enable working with other data professionals and stakeholders.

Employees at all levels are expected to:

• Understand our Operating Principles; make them the guidelines for how you do your job.
• Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
• Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
• Win as a team - make big things happen by working together and being open to new ideas.
• Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
• Drive results and growth.
• Respect and promote inclusion & diversity.
• Do what's right for each other, our customers, investors and our communities.