Staff Software Engineer-Machine Learning

Key Skills

Aartificial intelligence, Agile methodologies, Algorithms, Analytical and Problem solving, Automation, Data structuring, Debugging, Effective communication skills, Java Programming, Machine learning techniques, Python Programming, SDLC, Software Development, Statistics, Unix Operating system

Job Description

What you get to do in this role:   

The Advanced Technology Group (ATG) Quality Engineering team at ServiceNow is responsible for the quality of our artificial intelligence solutions, including generative AI. We are looking for a team-oriented problem solver with working knowledge in machine learning to champion quality of AI powered products that elevate customer experience.

Job responsibilities

• Create test plans, test cases and other testing artifacts to validate innovative AI/ML capabilities with high quality and scalability in mind
• Lead and coordinate cross functionally with Product, Design, ML Engineers, Data Scientists, and ML Quality Engineers to develop AI validation strategy and execute according to plan
• Curate, maintain, and continuously enhance evaluation data
• Design and maintain test automation frameworks for machine learning models
• Establish test effectiveness and efficiencies in the validation pipeline
• Establish and improve metrics collection and reporting from automated and manual tests to identify strengths and weakness of AI
• Incorporate research of industry trends and apply best practices in quality engineering practices used in evolving machine learning techniques

Qualifications

To be successful in this role you have:

• 6+ years of experience with software quality assurance and Java and Python programming
• Understanding of machine learning techniques, data structures, algorithms, statistics
• Experience evaluating quality in AL/ML pipelines
• Experience in collecting and maintaining data according to test plans and test cases
• Experience in designing and developing scalable and maintainable automation pipelines and frameworks for verification of machine learning models
• Experience with fine tuning and validating large language models is strongly preferred
• Understanding of testing techniques (e.g. functional, integration, performance), their strengths and weakness, and ability to use them to best effect
• Ability to use tools (such as IDE, debugger, build tools, source control, ServiceNow instances, profilers, system administration/Unix tools) to assist with daily tasks
• Experience in an agile environment and in standard SDLC
• Strong written and verbal communications skills
• Strong analytical and problem solving skills

For positions in California (outside of the Bay Area), we offer a base pay of $123,750 - $216,450, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs (subject to eligibility requirements). Compensation is based on the geographic location in which the role is located, and is subject to change based on work location. For individuals who will be working in the Bay Area, there is a pay enhancement for positions located in that geographical area; please contact your recruiter for additional information.

Additional Information

ServiceNow is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status or any other category protected by law.

Company Description

At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can’t wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make that possible. We dream big together, supporting each other to make our individual and collective dreams come true. The future is ours, and it starts with you. 

Unsure if you meet all the qualifications of a job description but are deeply excited about the role? We still encourage you to apply! At ServiceNow, we are committed to creating an inclusive environment where all voices are heard, valued, and respected. We welcome all candidates, including individuals from non-traditional, varied backgrounds, that might not come from a typical path connected to this role. We believe skills and experience are transferrable, and the desire to dream big makes for great candidates.