Staff Software Engineer - Full Stack - Big Data/AIML

Key Skills

Aartificial intelligence, Apache Cassandra, Apache Flink, Apache Hadoop, Apache Kafka, API, AWS, Azure, Big Data Technology, Containerization, Data Governance, Data pipelines, Data Privacy, Data security, Docker, Effective communication skills, ETL frameworks, Google Cloud Platform (GCP), HBase, Java Programming, Kubernetes-K8s, Machine learning techniques, Python Programming, PyTorch, Scala Programming, Scikit-learn, Spark Core, TensorFlow

Job Description

You will be part of the ServiceNow Cloud Services Big Data Team. The Big Data team is building the next-generation platform that collects, stores and provides real-time access to large amounts of data.

You will also build real-time analytic tools and reporting capabilities for various purposes including:

• Monitoring, alerting and troubleshooting
• Anomaly detection
• Capacity planning
• Data analytics

What you get to do in this role:

We are seeking a highly skilled and motivated Big Data Spark Engineer with expertise in Artificial Intelligence (AI) and Machine Learning (ML). As a member of our dynamic team, you will play a crucial role in developing and implementing cutting-edge data solutions that leverage the power of Spark and advanced AI/ML techniques.

Responsibilities:

• Design, develop, and optimise big data processing pipelines using Apache Spark.
• Collaborate with data scientists and domain experts to understand business requirements and translate them into scalable data solutions.
• Apply AI/ML algorithms and techniques to extract meaningful insights from large datasets.
• Develop and deploy machine learning models for predictive analytics, recommendation systems, and other data-driven applications.
• Identify and address performance bottlenecks, scalability issues, and data quality problems in the Spark ecosystem.
• Conduct thorough testing and debugging of Spark applications to ensure accuracy and reliability.
• Stay up-to-date with the latest advancements in Big Data technologies, AI, and ML, and contribute to the continuous improvement of our data engineering practices.
• Provide technical guidance and mentorship to junior team members.

If you are a passionate Big Data Spark Engineer with a strong background in AI/ML and enjoy working on challenging projects, we would love to hear from you. Join our team and help shape the future of data-driven insights and intelligent decision-making.

Qualifications

To be successful in this role you have:

Requirements:

• 10+ years of experience in Bigdata, Hadoop, AI/ML
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Strong proficiency in Apache Spark, including Spark Core, Spark Streaming, and Spark SQL.
• Extensive experience in designing and implementing distributed big data processing pipelines using Spark.
• Solid understanding of AI/ML concepts and hands-on experience with popular AI/ML frameworks and libraries such as TensorFlow, PyTorch, scikit-learn, or Keras.
• Proficiency in programming languages such as Python, Scala, or Java.
• Experience with data extraction, transformation, and loading (ETL) processes and tools.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud, and their big data services.
• Build the next-generation libraries, APIs and data pipelines
• Develop data engineering components and applications and entities to empower self-serve for big data products
• Lead complex and technically challenging projects from concept to completion
• Strong problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment.
• Excellent communication and interpersonal skills.

Preferred qualifications:

• Experience with distributed computing frameworks such as Hadoop, HBase, or Cassandra.
• Knowledge of stream processing frameworks such as Apache Kafka or Apache Flink.
• Experience with containerization technologies such as Docker and orchestration tools like Kubernetes.
• Understanding of data governance, data privacy, and security principles in big data environments.
• Publications or contributions to the AI/ML community.

Additional Information

At ServiceNow, we lead with flexibility and trust in our distributed world of work. Click here to learn about our work personas: flexible, remote and required-in-office.

If you require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact us at talent.acquisition@servicenow.com for assistance.

Company Description

At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can’t wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make that possible. We dream big together, supporting each other to make our individual and collective dreams come true. The future is ours, and it starts with you.

Unsure if you meet all the qualifications of a job description but are deeply excited about the role? We still encourage you to apply! At ServiceNow, we are committed to creating an inclusive environment where all voices are heard, valued, and respected. We welcome all candidates, including individuals from non-traditional, varied backgrounds, that might not come from a typical path connected to this role. We believe skills and experience are transferrable, and the desire to dream big makes for great candidates.