Big Data Engineer

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

Everstream Analytics is looking for a Data Engineer to join our Data Science team. This position will report directly to the Chief Data Scientist. As a member of Data Science, you will join a dynamic team of people focused on our next generation product. We have an exciting opportunity to help shape how we use data to build models and generate actionable insights to give our customers a risk aware supply chain which will advance outcomes for the business and the industry. This role will partner closely with Product Development, Product Management, Intelligence Solutions, and Marketing.

POSITION OVERVIEW

In this role, you will work closely with our Data Science and Product Development teams on projects to capture, analyze, and transform world-scale datasets. You will write code that can scale to help produce novel insights and construct APIs to deliver our product vision. You will build data pipelines to support product analytics, data science, and DevOps. This role requires practical technology applications skills involving the cleaning, integration, extraction, analysis and delivery of structured and unstructured data.

Location: 100% remote / work from home

Principal Accountabilities

• Build and maintain a data infrastructure, including data lakes, data bases, and data pipelines
• Identify, retrieve, validate, manipulate, relate and/or exploit multiple structured data and unstructured data sets to meet product requirements
• Identify, design, and implement infrastructure changes to improve scalability and data processing
• Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs
• Present pipeline designs, data quality analysis, and pipeline performance metrics to stakeholders

Knowledge, Skills and Experience

• BS or MS degree in Computer Science, Data Science, or equivalent experience
• 2+ years of real-world professional experience writing back end or data-driven software
• Excellent ability to build processes supporting data transformation, data structures, metadata, dependency and workload management
• Minimum 1 years experience with Python and Machine Learning toolsets (Scikit-learn, Numpy, Pandas)
• Minimum 1 years experience with container technologies like Docker and Kubernetes
• Minimum 1 years experience with AWS cloud services such as S3, Athena, Cloudwatch, Sagemaker, and Lambda
• 2+ years experience of both SQL and NoSQL databases as well as Elasticsearch
• Graph database experience gives the candidate is a significant advantage
• Self-starter with a curious attitude and a willingness to learn and master new technologies
• Ability to act easily in a global environment, with understanding of cultural differences and behavior
• Oral and written English proficiency, with ability to clearly communicate technical design to both technical and non-technical audience