Senior Staff Software Engineer, Data Platform

Key Skills

Aartificial intelligence, Agile methodologies, Algorithms, Amazon Athena, Amazon RedShift, Amazon Simple Storage Service (S3), Analytical and Problem solving, Apache Kafka, AWS, Big Data Technology, Data pipelines, Data Warehousing, Databricks, Design, Infrastructure as code, Java Programming, Machine learning techniques, Presto, Python Programming, Scala Programming, Snowflake, SPARK Programming, SQL

Job Description

About you

You're an analytical problem-solver ready to put your skills toward purposeful work that has a global impact. You want to lead the way in innovation, exploring the latest technologies and finding new solutions. You thrive in a collaborative environment and are eager to work with and learn alongside the best in Product, Design, and Engineering.

About this role

Are you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy's groundbreaking AI, ML, and data products? Udemy's Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing online education.

We are building highly available, scalable data infrastructure, services, tools, and libraries to serve critical data discovery, ML/data pipeline development & deployment, data security & compliance, and self-healing data operation needs.

What you'll be doing

• Design, build, enhance, and support self-service data infrastructure as a platform, which would be used for Udemy's data mesh.
• Build robust, scalable, cloud-native, cost-optimized real-time and batch data integration pipelines in AWS with Airflow, Kafka, Databricks, Delta Lake, AWS services like S3, EMR, Athena, RDS, Redshift, EKS, etc., and Snowflake.
• Contribute towards Udemy's comprehensive data quality initiatives like data contracts, data validation, observability, and alerting
• Support data platform privacy with RBAC and encryption
• On-call rotation business hours

What you'll have

• 8+ years of experience in building distributed systems with Java, Scala, or Python
• 5+ years of experience managing big data platforms with storage (AWS S3), compute (AWS EMR or Databricks with Spark, AWS Athena or Presto), data warehouses (Redshift or Snowflake), streaming (Kafka or AWS Kinesis)
• 5+ years of experience in agile development methodologies & test-driven development (TDD)
• 5+ years of experience building and maintaining resilient real-time & batch data pipelines.
• Experience in building or using any one of the data quality tools (in-house built, SODA SQL, Anomalo, Monte Carlo, Great Expectations, or any other)
• Expertise in cloud data privacy tools in the area of authentication (AWS IAM/OKTA), encryption (AWS KMS/Safenet), authorization (Apache Ranger/Privacera)
• Strong grasp of object-oriented design patterns, algorithms, and data structures

We understand that not everyone will match each of the above qualifications. However, we also realize that everyone has unique experiences that can add value to our company. Even if you think your background might not perfectly align, we'd love to hear from you!

Life at Udemy

We aspire to be as vibrant and dynamic as the communities we serve, as inquisitive as those who use our platform, and as revolutionary as the future we strive to open for everyone. Here are some of the things we love about life at Udemy:

We're invested in creating an inclusive environment that welcomes a diverse range of backgrounds and experiences. From creating employee resource groups, ensuring we're a Fair Pay Workplace, and building a flexible work culture, our belonging, equity, diversity, and inclusion (BEDI) initiatives always put our people first. We want you to be able to bring your authentic self to work because when we all do, we're better for it.

• Learning is what we do - inside and out. Our Learning & Development team is second to none, helping ensure your journey is one of continuous progression. You'll also have unlimited access to Udemy courses, monthly UDays (meeting-free professional development days), and a generous annual professional development stipend.
• Our reason to exist is to revolutionize learning - that calls for taking risks and learning from failures. Whether it's our hackathons (a company-wide effort to envision new possibilities for our product) or sharing our prototypes, we see experimentation as a crucial step on the path to success.
• We're committed to creating world-class employee experiences and are proud of the recognition of this by Great Place to Work.

Of course, the best thing about being part of Udemy is knowing your work makes a difference for people and organizations around the world. You've got the skills; why not use them to help others develop theirs?

At Udemy, we value diversity and inclusion and consider qualified applicants without regard to race, color, religion, sex, national origin, ancestry, age, genetic information, sexual orientation, gender identity, marital or family status, veteran status, medical condition, or disability.

Our Benefits Start With U

Our benefits package at Udemy starts with U and is grounded in mission-driven benefits that intentionally align with our core values. Here's a sneak peek at just a few highlighted benefits if you're a full-time Udemate based in the India:

• Core Benefits: Comprehensive medical, life and income protection coverage
• Parental Benefits: Financial assistance for fertility (including egg-freezing), adoption, and surrogacy expenses; twelve weeks of paid family bonding for birth, surrogacy, adoption, and foster placement. 26 weeks paid maternity leave for birthing parents as well as a two-week ease-back program that enables parents to return part-time at full pay
• Whole U: Fully paid memberships for meditation/mindfulness, therapy/coaching visits, financial planning, fertility and family building, maternity and newborn care, parenting and pediatrics, menopause care, breastmilk shipping, and caregiving support
• Learning: Free access to Udemy and Udemy Business plus a yearly stipend to spend on professional development
• Retirement: 12% of your base salary or INR 1,800 per month
• Charitable Giving: Corporate charitable match for eligible nonprofits and charities
• Holidays: 25 paid holidays throughout the year plus bank holidays

About our APAC region

When you join Udemy in our Asia Pacific (APAC) region, you'll have the chance to help our globally established business grow locally. We have a solid foundation and a great reputation - and you can be part of the next stage of our journey.

Our investment in the region is significant, with offices in Australia and India and an expanding presence in Singapore, Indonesia, Japan, and beyond. It comes with countless opportunities to make learning more accessible to millions. You'll work with various cultures with unique needs, affording you the chance to learn and progress in your career. And that progression doesn't come at the cost of work-life balance; people are at the heart of our mission, which is why we're committed to looking after ours.