Software Engineer, Data Engineering

Key Skills

Java Programming, MongoDB, SQL, Apache Kafka, Scala Programming, Apache Cassandra, NoSQL, Apache Hive, Apache Pig, Snowflake, HDFS, YARN, Elasticsearch, Amazon RedShift, SPARK Programming, HBase, KSql

Job Description

Our tech stack is hosted on AWS and is built on Cloudfront / AWS API Gateway, NGINX, / Java, Redis / ElastiCache and MySQL / Cassandra as our end to end stack. Besides these, we heavily use MongoDB, Kinesis, Kafka, RabbitMQ, Spark, Redshift and other cutting edge techs to keep improving Dream11's performance. As a data-driven team, we also use R, Python and other big data technologies for Machine Learning and Predictive Analytics.

Your Role:

• Serving as a primary point responsible for the overall health, performance, and capacity of one or more of our data systems
• Gaining deep knowledge of our complex applications and assist in the roll-out and deployment of new product features and installations to facilitate our rapid iteration and constant growth
• Developing tools to improve our ability to rapidly deploy and effectively monitor data systems in a large-scale unix environment
• Working closely with development teams to ensure that data systems are designed with operability in mind

Must Have:

• Strong in troubleshooting/debugging systems, network and applications
• Strong coding in any programming languages like Python/Go/Perl/Ruby
• Strong in Unix/Linux operating systems and networking
• Working knowledge of open source technologies in monitoring, deployment and incident management

Good to Have:

• Experience in BigData technologies like Kafka/Hadoop/Airflow/Spark
• Experience in containers and orchestration layers like Kubernetes, Mesos/Marathon
• Experience in NoSQL/SQL technologies like Cassandra/MySQL/CouchBase etc
• Is a die-hard sports fan