Sr. Engineering Manager, Big Data

Key Skills

Aartificial intelligence, Big Data Technology, Data science techniques, Generative AI, GoLang, Java Programming, Machine learning techniques, NoSQL, OLAP, Python Programming, UX design

Job Description

Please note, this team is hiring across all levels and candidates are individually assessed and appropriately leveled based upon their skills and experience.

The Data Engineering team builds distributed systems for efficient data ingestion, processing, storage and query. We work closely with engineers, machine learning team, and the product team to build highly scalable systems that tackle real-world data problems and provide our customers with accurate, real-time, fault tolerant solutions to their ever-growing data needs. We support various OLTP, Analytics and Machine learning use cases for our customers.

As the Senior Engineering Manager you will be driving teams responsible for designing, developing, testing and operating highly reliable and scalable data pipeline and cloud services.

What’s in it for you

• Manage a high caliber globally distributed engineering team.
• Work in a hot interdisciplinary space of GenAI, Big Data & Security.
• Opportunity to delve into greenfield problems in the GenAI space.
• Opportunity to collaborate with cross functional groups like product management, machine learning and UX to launch high impact features and functionalities.
• Use modern development, testing and deployment methodologies to deliver software services to our customers.

What you will be doing

• Provide hands-on leadership to drive cross functional scrum teams consisting of data, backend, machine learning and UI engineers.
• Develop long term engineering vision of the product areas owned.
• Review technical design and architecture on an ongoing basis.
• Maintain a high bar for engineering excellence and accountability.
• Collaborate with the Product Management, Machine Learning, UX and peer engineering teams to build new features.
• Hire, train and assess the performance of direct reports across different levels.
• Assist in the growth of employees through coaching, training and career development activities.
• Handling customer escalations, performing root cause analysis and driving customer issues to closure.

Required skills and experience

• At least 15+ years of relevant software engineering experience.
• At least 5 yrs of experience managing high performing engineering teams.
• Prior experience in data engineering is mandatory.
• Experience in leading at least one customer facing cloud service end to end is mandatory.
• Prior experience in building AI/ML/GenAI systems is preferred.
• Prior experience working in Product organizations and ability to collaborate with UX, Data Science, Product Management and other engineering teams.
• Experience in participating in product grooming, scoping, planning and delivery of complex software products and features.
• Demonstrated ability to bootstrap teams for greenfield initiatives, set processes and guidelines (eg : shift left quality, CI/CD).
• Comfortable using frameworks like OKR, DORA to measure the productivity of the team and hold them accountable.
• Prior experience in backend programming languages like Java / Python / Golang is required.
• Demonstrable experience in guiding modern software engineering teams building microservices.
• Prior experience in distributed systems,data systems, experience of operating at least one database system (OLAP, NoSQL or GraphDB) at planet scale is mandatory.
• Familiarity in building event driven architecture on Kubernetes.
• Prior experience in building batch and stream data pipelines using Spark, Flink, Kafka Streams will be preferred.
• Familiarity with RAG architecture and Vector DB will be an added advantage.
• Prior experience of building and operating services in public clouds like GCP or AWS will be a huge plus.
• Strong written and verbal communication skills, and the ability to communicate in an open, transparent , collaborative and in a consistent manner with other teams and your co-workers.
• Strong people skills with prior experience of hiring, coaching, retaining and performance management of engineers at different levels of experience.
• Prior experience of synthesizing data and presenting the work done by teams to the senior leadership team.

Education

• BSCS or equivalent required, MSCS or equivalent strongly preferred