Data Engineer (Python, Spark, databricks)

Key Skills

Aartificial intelligence, Algorithms, Data Engineering, Data science techniques, Databricks, ETL frameworks, Machine learning techniques, Python Programming, SPARK Programming

Job Description

What will your daily life look like?

• Design, write and deploy high-volume data applications to integrate, transform and store data for use in machine learning models and reports.
• Analyze and improve the efficiency, scalability, reliability and performance of our data platforms and systems infrastructure.
• Translate business and analytical requirements into technical solutions.
• Write and deploy applications and ETL scripts to a range of data sources and stores.
• Practice disciplined software engineering (e.g. automated testing, code reviews, and writing pragmatic code).
• Actively contribute to team and company standards.

  What you need to succeed

• University degree in computer science or computer engineering with more than 10 years of professional experience.
• More than 5 years of professional experience as a data engineer;
• Databricks expertise and excellent knowledge of AWS cloud services;
• Have contributed and have experience in machine learning, data science, computer vision, AI, statistics and, or applied mathematics.
• Knowledge of data and analytics concepts, such as dimensional modeling, ELT, reporting tools, data governance, data warehouses, structured and unstructured data;`
• Strong understanding of agile methods, experience as a data engineer in multifunctional agile teams, an asset;
• Bilingualism

  What awaits you

• Deferred Compensation Leave Program
• Daycare for young children
• Career advancement and education programs
• Flexible hours
• Leadership programs and training
• Range of benefits, savings plan and retirement plan
• Financial assistance program for parental leave
• Recognition and reward program

Diversity and inclusion

The masculine generic is used without discrimination and only for the purpose of lightening the text. P&WC subscribes to the principle of employment equity and is committed to encouraging diversity and inclusion. We are pleased to consider applications for employment from all qualified applicants without regard to race, color, religion, sexual orientation, gender, national origin, age, disability, veteran status or any other status. protected by law.

********************************************************************************

Who we are

At Pratt & Whitney, we believe that powered flight has transformed – and will continue to transform – the world. That’s why we work with an explorer’s heart and a perfectionist’s grit to design, build, and service the world’s most advanced aircraft engines. We do this across a diverse portfolio – including Commercial Engines, Military Engines, Business Aviation, General Aviation, Regional Aviation, and Helicopter Aviation – and as a way of turning possibilities into realities for our customers. This is how we at Pratt & Whitney approach our work, and this is why we are inspired to go beyond.

What are our expectations?

We are seeking a highly motivated data engineer to join The Analytics and information management (AIM) team of Pratt and Whitney Canada. You will be working collaboratively to deliver strategics data driven initiatives in respect of best-in-class data and analytics principles. You will play an active role in designing and building big data pipelines and enabling the technologies to create the efficient data flows required by various data models of both transactional and analytics solutions in a wide variety of areas across the business.

This role requires a deep understanding of Databricks, AWS Cloud services with hands-on implementation experience in batch and streaming architectures and Software Engineering best practices

What your day to day will look like

• Design, Write and deploy high volume data applications to ingest, transform, and store data to be used in Machine Learning Models and reporting
• Analyze and improve efficiency, scalability, reliability and performance of our Data platforms and systems infrastructure
• Translate business and analytics requirements into technical solutions
• Write and deploy ETL applications and scripts across a range of data sources and stores
• Practice disciplined software engineering (e.g. automated testing, code reviews, and writing beautiful, pragmatic code)
• Actively contribute to team and company standards

  The tools you need to be successful

• Bachelor’s degree or M.S. in Computer Science, Computer Engineering with over 10 years of total professional experience.
• 5+ years of experience working in data engineering.
• Expertise with Databrick and knowledge of the AWS technologies.
• Contributions and experiences to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics
• Conceptual knowledge of data and analytics, such as dimensional modeling, ELT, reporting tools, data governance, data warehousing, structured and unstructured data
• Strong understanding of agile methodologies, experience as a Data Engineer in a cross-functional agile team preferred
• Bilingual

  What we offer

• Long-term deferred compensation programs
• Daycare for young children
• Advancement programs to enhance education skills
• Flexible work schedules
• Leadership and training programs
• Comprehensive benefits, savings and pension plans
• Financial support for parental leave
• Reward programs for outstanding work