Lead Data Engineer

Key Skills

Aartificial intelligence, Amazon RedShift, Apache Kafka, AWS, Azure, Azure COSMOS, Data Analytics, Data Engineering, Data Lake, Data pipelines, Data science techniques, Data Visualization, Data Warehousing, DevOps, ETL/ELT technologies, Google BigQuery, Google Cloud Platform (GCP), Leadership Skill, Machine learning techniques, PowerBI, Qlik Sense, QlikView, Snowflake, SPARK Programming, Splunk, Tableau

Job Description

Are you interested in solving complex business problems with the help of data and insights? Would you like business-focused data engineering experience in data & analytics? Do you want to be a part of the change transforming the business environment today? If yes, join us.

In this job, you will:

• experience working on large data volume data engineering problems.
• focus on business first and technology second.
• or might be required to travel to end-client sites. 

To join us, you should:

• lead the design, development, and maintenance of the data infrastructure for the enterprise.
• collaborate with data scientists, analysts, and other stakeholders to understand data needs and requirements. 
• develop and implement data pipelines to ingest, transform, and store data. 
• build and maintain data lakes and data warehouses. 
• ensure the data infrastructure is scalable, reliable, and secure. 
• mentor and coach team members to help them grow their skills and capabilities.
• Identify and address technical challenges and roadblocks in data engineering projects. 
• Communicate technical concepts and project progress to non-technical stakeholders. 
• Build and maintain relationships with key partners and stakeholders within the organization.

You must have the following:

• BTech/ Master’s degree or equivalent in Computer Science/Computer Engineering/IT, Technology, or related fields
• 5 to 8 years of experience in data engineering
• Excellent verbal and written communication skills 
• Experience in building and maintaining data pipelines using technologies such as Cloud Data Fusion, Cloud Dataflow, AWS, Azure Data Factory, Azure Stream Analytics, and Dell Boomi. (Any 2) 
• Experience in storing and processing data using technologies such as Big Query, Cloud Dataproc, AWS, Azure Synapse Analytics, Snowflake, Redshift, Cosmos DB. (Any 3) 
• Knowledge of managing data storage and access using technologies such as Cloud Storage, AWS, Azure Blob Storage, or Azure Data Lake Storage. (Any 1) 
• Knowledge of managing and deploying data infrastructure on GCP or Azure using technologies such as Cloud Composer, Azure Kubernetes Service, or Azure Container Instances (Any 2) 
• Knowledge of implementing security and access controls for data such as Cloud Identity and Access Management, AWS, Azure Active Directory, or Azure Private Link 
• Well-versed with data services, integration, ingestion, ELT/ETL, and data governance. 
• Experience in Security and Meta-driven Development. 
• Expertise on RDBMS (relational database management system) – writing complex SQL logics, DB/Query optimisation, Data Modelling, able to manage high data volume for mission critical applications. 
• Strong grip on programming using Python and PySpark. 
• Data pipeline lifecycle management and DataOps. 
• Expertise on using AWS, Azure DevOps or Google Cloud Build. (Any 1). 
• Preference to the candidates having Azure or GCP data engineer certification. (Any 1) 

Good to have:

• Application development understanding (Full Stack) 
• Experience in open-source tools like Kafka, Spark, Splunk, Superset etc. 
• Good understanding of analytics platform landscape that includes AI/ML 
• Experience in any Data Visualization tool like PowerBI / Tableau / Qlik /Quick Sight, etc.   

About us

Gramener is a design-led data science company. We build custom Data & AI solutions that help solve complex business problems with actionable insights and compelling data stories. We partner with enterprise data and digital transformation teams to improve the data-driven decision-making culture across the organization. Our open standard low-code platform, Gramex, rapidly builds engaging Data & AI solutions across multiple business verticals and use cases. Our solutions and technology have been recognized by analysts such as Gartner and Forrester and have won several awards.

We offer you:

• A first-hand experience with complex and interesting, purpose-driven data problems.
• An opportunity to make deep industry connections with data science experts, client teams, and domain champions and be part of the change that is transforming the business environment today.  
• A chance to try things, and take risks. 
• Meaningful problems you’ll be proud of solving. 
• People you will be comfortable working with. 

Key metrics for you will be:

• Timely delivery and quality of delivery 
• Customer satisfaction on engagements