Principal Engineer-Databricks

Key Skills

Aartificial intelligence, Data Engineering, Databricks, DevOps, Git, PySpark, Python Programming, Spark-SQL, SQL

Job Description

What's the opportunity?

We are seeking a Data Engineering leader to drive the development of Data engineering solutions on RBC’s Enterprise Data and AI Hybrid Multi-cloud Platforms, that meet the strategic data objectives of the Capital Markets business. The successful candidate will be responsible for leading the design, development, and implementation of data solutions, as well as lead, mentor, and grow a team of talented data engineers. This role requires a thorough understanding of the capital markets industry, including its various segments, products, and services. This expertise should encompass the inner workings of the Capital markets organization like Investment Banking, including its operations, risk management, and regulatory requirements.

Your responsibilities include:

This role will encompass an end-to-end Data Integration view from data sourcing, lineage, transformation, and storage to support complex advanced analytics and AI, and require extensive collaboration with Business architecture, System architecture, Business SME and Data Stewards.

• Work with the Business SMEs and Platform leads to understand and determine best mix of development and technical data solutions to meet business requirements and project objectives;

• In depth understanding of the Capital markets infrastructure on-premises and in the public cloud, as well as tools used in data management, analysis, and reporting;

• Lead the build of batch and real-time data pipelines (inbound, outbound);

• Integrate data with Cloud based platforms and publish curated data products for consumption;

• Participate in Data management requirements and support Data and AI needs of business and technology stakeholders;

• Work in an agile team of Data Engineers, Developers and RBC business stakeholders;

• Collaborate with data scientists, process engineers and business stakeholders on requirement gathering and assist with prescriptive and predictive analytics through consolidated data pipelines.

You're our ideal candidate if you have:

• Bachelor’s degree in computer science or related technical field involving coding (e.g., physics or mathematics), or equivalent technical experience;

• 10+ years of hands-on experience in data engineering and technologies – Snowflake, Databricks (Capital Markets Aperture data Platform);

• 10+ years of Python development experience;

• 10+ years of SQL experience (Spark and Databricks-specific SQL is a plus);

• 10+ years of experience with schema design, dimensional data modeling, and scalable data architecture;

• Strong knowledge of algorithms and data structures;

• Working knowledge of the Data Engineering Tech Stack: Python, PySpark, Databricks, Airflow, Kafka, Snowflake, API: Node.JS, Apigee, Portal/analytics solutions: Angular, Security frameworks: LDAP, Kerberos, OAuth 2.0, Vault integration.

Nice to have:

• Master’s degree in computer science or equivalent experience;

• Automation/DevOps: GtiActions, Selenium and similar technologies;

• Source code control: GIT;

• Experience working in agile/SaFe environment.

What's in it for you?

• Become part of a team that thinks progressively and works collaboratively. We care about seeing each other reach full potential;

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock options where applicable;

• Leaders who support your development through coaching and managing opportunities;

• Ability to make a difference and lasting impact from a local-to-global scale.

About RBC Borealis

RBC Borealis is the driving force behind Royal Bank of Canada’s AI and data innovation. As part of Canada’s largest financial institution, we bring together a team of architects, engineers, scientists, and product experts on a mission to revolutionize finance through world-class research, solutions, and a resilient data platform. With locations across Toronto, Waterloo, Montreal, Calgary, and Vancouver, we’re at the forefront of AI research and platform development. With a focus on cutting-edge research in areas like time series forecasting, causal machine learning, and responsible AI, we are seamlessly integrating AI research and data engineering, to solve critical challenges in the financial industry. We are building intelligent, and scalable, data-driven solutions that will help communities thrive and drive innovation for our customers across the bank.

Inclusion and Equal Opportunity Employment

RBC is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veterans status, Aboriginal/Native American status or any other legally-protected factors. Disability-related accommodations during the application process are available upon request.