Data Engineer

Key Skills

Python Programming, Big Data Technology, Machine learning techniques, Data Visualization, Jupyter Notebook, NoSQL, Tableau, R Programming, MySQL, Lambda, Statistical modeling, Bitbucket

Job Description

Transforming the Future with Convergence of Simulation and Data

Data Engineer

Job Summary:

Our client in Auburn Hills, Michigan is looking for an Data Engineer. This is a contract position.

What You Will Do:

The Data Engineer will establish the organization’s data infrastructure, promoting engineering best practices on data management, and keeping the high bar for data quality. Responsibilities include but not limited to:

• Design and implement secure, scalable, high-performance and robust data services for connected vehicle data in distributed data processing platforms using modern Big Data technologies.
• Design, extend, and review data architecture, model, flow, and integration – be hands on and involved with every stage of the software development life cycle.
• Partner with software engineers and data scientists to meet the need of upstream and downstream dependencies.
• Work with external carrier stakeholders and internal partner teams to ingest connectivity data for data processing.
• Develop state of the art code – influence/establish the software development culture of the team. Establish standards and best practice for instrumentation within software engineering.
• Keep up to date with the evolving Big Data technology, share the knowledge across the organization by enabling best practices, standards, governed processes and relevant technologies.
• Comprehensive knowledge of relational database concepts, including; data architecture, operational data stores, Interface processes, Multidimensional modeling, master data management, and data manipulation
• Expert knowledge and experience with custom ETL design, implementation and maintenance
• Comprehensive experience designing, implementing, and iterating data pipelines using Big Data technologies
• Experienced working on cross-functional teams and leading efforts to build data services from ground up
• Excellent communication skills with the ability to understand complex business problems and provide solutions.

Basics:

• BA/BSc in Computer Science, Engineering, Mathematics, or a related technical discipline required
• 2+ years of experience in the data engineering and software development life cycle.
• 2+ years of hands-on experience in building and maintaining production data applications, current experience in both relational and columnar data stores.
• Experience with more than one coding language.
• Experience with one or more functional languages such as F#, Scala or Haskell
• Experience working with cloud Big Data platforms (i.e. Spark, Google BigQuery, Azure Data Warehouse, etc.)
• Familiarity with time series database, data streaming applications, Kafka, Flink, and more
• Experience with workflow management engines (i.e. Airflow, Luigi, Azure Data Factory, etc.)
• Understand how to work with Hive metastores
• Experience with continuous integration tools like Jenkins
• Experience with creating containerized applications using Docker running them on Kubernetes.

Preferred:

• Experience with designing and implementing real-time pipelines.
• Experience with data quality and validation.
• Experience with SQL performance tuning and E2E process optimization.
• Experience with notebook-based Data Science workflow.
• Experience with Airflow.
• Experience using Spark, Presto, Hive, etc.
• Experience using Cats or ZIO
• Familiarity with modern data science and product analytics tools and techniques such as R, Machine Learning, and advanced statistics is a plus

How You Will Be Successful:

• Envision the Future
• Communicate Honestly and Broadly
• Seek Technology and Business “First”
• Embrace Diversity and Take Risks

What We Offer:

• Competitive Salary
• Comprehensive Benefit Package
• 401(k) with matching contributions
• Paid Time Off
• Employee Discounts
• Free training on all Altair products

Why Work with Us:

Altair is a global technology company providing software and cloud solutions in the areas of data analytics, product development, and high-performance computing (HPC). Altair enables organizations in nearly every industry to compete more effectively in a connected world, while creating a more sustainable future. With more than 3,000 engineers, scientists, and creative thinkers in 25 countries, we help solve our customer’s toughest challenges and deliver unparalleled service, helping the innovators innovate, drive better decisions, and turn today’s problems into tomorrow’s opportunities.

Our vision is to transform customer decision making with data analytics, simulation, and high-performance computing.