Director II, Responsible AI & Data Science Fundamentals

Key Skills

Aartificial intelligence, Algorithms, Data science techniques, Generative AI, Large Language Models - LLMs, Machine learning techniques, MLOps tools

Job Description

If I told you this job description was not written by ChatGPT... would you believe me?

Could you prove it? Is there an analysis to show the likelihood this text was generated by a human, versus a generative Large Language Model? Could you explain this algorithm to a lawyer, and would they believe you?

How many job descriptions... from Liberty or otherwise... do you think are currently written with GenAI? Is this a problem? What should be the message to our Talent Advisors... what types of review processes should we put in place to ensure this new tool is used appropriately in a sensitive field? On the other hand, how should we engage our Data Scientists to succeed at driving value with these new tools? Can we investigate tools to better track our successes in Prompt Engineering, or otherwise build up a better MLOps practice for LLM’s and GenAI?

You are the kind of scientist who puts integrity first, and wants to help an entire enterprise succeed. You want to help create tools and techniques that make our models more reliable, and don’t just slow innovation via excessive governance. You create best practices to help DS get to market quickly. You find ways of measuring talent and tech debt, and you are excited to build a culture around continuous improvement with your colleagues. You don’t just see a problem in code, you see a technique to avoid it, a process to prevent it, and a talent development program to carry the torch forward.

We are the Office of Data Science in Liberty Mutual, a central group whose mandate is to make it easy for our DS talent to excel across all markets. We help build advanced AI solutions, create a culture of learning and collaboration, and curate the ecosystem of tools used by all of our scientists. We work cross-functionally with business leads, compliance, and platform developers to bring the whole enterprise to bear on Liberty’s most challenging data and predictive challenges.

If you want to be at the center of an enterprise whose life blood is predictive analytics and machine learning, and you strive to make things better... join us! As Director of Responsible AI & Data Science Fundamentals, you will be responsible for vision and strategy for many of our initiatives across talent development, risk management, and operational excellence for data scientists. You will collaborate with or lead cross-functional teams of scientists, platform architects, lawyers, policy experts, and business leads. This is a highly exciting, challenging, and impactful role at the intersection of some of the most important issues facing the world today.

Responsibilities

• Broadly set vision and act as technical/scientific advisor for how to improve our Enterprise DS practice, driving more value from data, via a combination of development programs, risk management processes, community culture, streamlining best practices, and similar initiatives
• In partnership with Enterprise Risk Management, Global Compliance, and key DS leaders, create a value-add Model Risk Management program to identify our current AI footprint, and identify opportunities for further risk mitigation
• Help assess risk and opportunities for Generative AI applications, and create programs to ensure we experiment with integrity and speed.
• Help define and measure technical capabilities such as Machine Learning Operations (MLOps), High Performance Engineering, etc., and create programs and practices to drive adoption of best practices.
• Help collect, curate, and refine best scientific practices across the enterprise, developing common documentation, knowledge sharing programs, training curricula, and development programs.
• Create and maintain a culture of continuous learning and collaboration across DS teams.
• In partnership with Legal and Compliance, craft strategies to help DS stay on top of emerging legislation, and ensure we are best positioned to succeed in new regulatory environments.
• In partnership with our Data Offices and Legal counsel, help drive strategy for advanced privacy protection using novel technologies, including Privacy Preserving Analytics, Synthetic Data, Federated Learning, Multiparty Communication, and other techniques to help us better protect our customers’ data while driving powerful insights.
• Work with business units across Liberty to educate DS, executives, and business users on ethical considerations around AI, including proper usage of AI, algorithmic bias, and risk management.

Qualifications

• Broad experience with hands-on modelling and DS lifecycle activities, and ability to communicate at a high level with DS and non-technical leaders
• Demonstrated ability to build trust with stakeholders
• Demonstrated experience leading DS projects
• Proven ability to lead and drive high profile cross-functional projects and teams
• Broad understanding of emerging scientific trends and techniques in MLOps, privacy, interpretability, explainability, risk management, bias and fairness, hallucinations, etc.
• Competencies typically acquired through an advanced degree (in Statistics, Mathematics, Data Science or other relevant field of study) and 8 years of relevant experience or may be acquired through a Bachelor’s degree (scientific field of study) and 10 years of relevant experience.