Senior Data Engineer, CAT Digital

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

Cat Digital is the digital and technology arm of Caterpillar Inc., responsible for bringing world class digital capabilities to our products and services. With almost one million connected assets worldwide, we're focused on using IoT and other data, technology, advanced analytics and AI capabilities to help our customers build a better world.

Cat Digital’s Advanced Data Quality team is looking for a talented and motived Senior Data Quality Engineer to improve platform data quality by identifying quality issues as well as developing and delivering ML/AI models to address the most challenging ones. As a Senior Data Engineer, you will apply machine learning and other analytics techniques on a very large set of diverse data from IoT connected assets and our integrated network of dealers. You will also use analytics and visualization methods to solve problems for Caterpillar internal customers. This role will engage in projects of medium to high complexity with direct business impact.

JOB DUTIES

As a Senior Data Engineer, you will contribute to design, development, deployment and quality of Caterpillar’s state-of-the-art digital platform’s by creating advanced Data Quality methods and models:

• Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
• Works directly on complex application/technical problem identification and resolution, including responding to off-shift and weekend support calls.
• Works independently on complex systems or infrastructure components that may be used by one or more applications or systems.
• Drives application development focused around delivering business valuable features
• Mentor and assist software engineers, providing technical assistance and direction as needed
• Maintains high standards of software quality within the team by establishing good practices and habits
• Identifies and encourage areas for growth and improvement within the team
• Guide the team to develop a structured application/interface code, new program documentation, operations documentation and user guides in a casual, flexible environment
• Communicate with end users and internal customers to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness
• Performs integrated testing and customer acceptance testing of components that requires careful planning and execution to ensure timely, quality results.
• Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.

Basic qualifications:

• BS or MS degree in quantitative discipline such as data science, data analytics, computer science, engineering, statistics, mathematics, finance or other related degree
• 7+ years of software development experience or 5+ years of experience with master’s degree
• 5+ years of experience in designing and implementing data processing and machine learning frameworks
• 5+ years of experience with Python, NoSQL and relational databases

Top candidates will also have:

• MS degree in a quantitative discipline such as data science, data analytics, computer science, engineering, statistics, mathematics, finance or other related degree
• Proven experience in some of the following:
  • Compiling and standardizing diverse, non-sanitized datasets.
  • Working with structured and unstructured data.
  • Developing classification and regression models.
  • Unsupervised learning algorithms.
  • Experience integrating analytical models with existing data pipelines.
• Solid knowledge of statistical approaches, quantitative analytic methods, data management techniques, and/or related digital technologies, and the ability to handle complex issues.
• Proven experience with AWS full-stack development and services such as Athena, DynamoDB, EC2, EMR, RDS, S3, SageMaker
• Experience with Snowflake
• Experience visualizing data using BI software such as Tableau and MS Power BI
• Good organizational skills and an aptitude for complex analytical and detailed work; ability to prioritize among multiple concurrent projects in order to meet deadlines in a timely manner.
• Experience gathering information systematically
• Ability to consider a broad range of issues or factors, grasp complexities and perceive relationships among problems or issues, and use accurate logic in analysis
• Exceptional verbal and written communication skills and ability to engage effectively at all levels of the organization, to both technical and non-technical audiences.
• Ability to work independently or collaboratively in a complex, rapidly changing, and culturally diverse environment.
• Ability to learn and comply with company policies and procedures
• Passion for technology and an eagerness to contribute to a team-orientated environment

Visa sponsorship available for eligible applicants.