Director, Data Engineering

Key Skills

Java Programming, Python Programming, MongoDB, SQL, Azure, AWS, Apache Kafka, Machine learning techniques, Data science techniques, Jenkins, A/B Testing, Apache Cassandra, Apache Airflow, Google Cloud Platform (GCP), Nginx, R Programming, MySQL, Linear Algebra, Amazon RedShift, SPARK Programming, RabbitMQ, Numerical Computing, ElastiCache

Job Description

Our tech stack is hosted on AWS and is built on Cloudfront / AWS API Gateway, NGINX, / Java, Redis / ElastiCache and MySQL / Cassandra as our end to end stack. Besides these, we heavily use MongoDB, Kinesis, Kafka, RabbitMQ, Spark, Redshift and other cutting edge techs to keep improving Dream11's performance. As a data-driven team, we also use R, Python and other big data technologies for Machine Learning and Predictive Analytics.

Your Role:

• Building and maintaining self-service Data Platform for Dream Sports
• Reviewing existing implementations and propose cost effective solutions
• Interacting with business stake holders and proposing/implementing solutions to solve business problems
• Working with like minded team of Data Engineers with expertise on working at large scale
• Building scalable data processing platform and frameworks for serving Analytics and Data Science use cases
• Building and managing a high performing team and supporting them through executing company's objectives

Must Have:

• 8+ years of experience in Dimensional Modelling and large scale Data Warehouse implementations
• Deep expertise in building real-time and batch analytics ETL solutions using big data technologies (Spark/ Kafka/KSql/Yarn/Hive/HDFS/Streaming etc) and NoSQL Stores
• Expert level programming experience in Java or Scala
• Strong SQL background, cloud based experience (AWS preferred) and proficient with scripting languages - python, shell etc
• Proven experience in managing stakeholders, mentoring teams and driving data platform projects

Good to Have:

• Have worked previously in a high-growth, fast paced tech startup
• Prior working experience in agile environment