Consultant - Data Engineering - Databricks

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range from Data Visualization, Data Management to Advanced analytics, Big Data and Machine Learning. Our uniqueness is in building Scalable Big Data Solutions on Onprem/GCP/Azure cloud in a very cost effective and easily scalable manner for our clients. We also come in with some strong IP and pre-built analytics solutions in data mining, BI and Big Data.

Job Summary

Role: Consultant - Data Engineering - Databricks:

Big Data Professionals Transformed to Databricks Experts

We are looking for an analytical, big picture thinker who is driven to enhance and further the mission of Tredence by delivering technology to internal business and functional stakeholders. You will serve as a leader to drive the IT strategy to create value across the organization. This Data Engineer will be empowered to lead the engagement to focus on implementing both low-level, innovative solutions, as well as the day-to-day tactics that drive efficiency, effectiveness and value

You will play a critical role in creating and analyzing deliverables to provide critical content to enable fact-based decision making, facilitation and achievement of successful collaboration with the business stakeholders. You will analyses, design, and develop best practices business changes through technology solutions.

Job Location

Bangalore / Chennai / Gurgaon / Pune

Roles & Responsibilities

If you ever wanted to be part of a project where you can upskill yourself, here is your chance.

If You Have:

• Minimum 3 to 5 years of experience delivering data driven applications, either on Cloud or On-Premises.
• 3+ years of experience working with any database platforms such as Oracle, Teradata, Snowflake, HIVE, Cassandra etc.
• 1+ years of experience in Python / Java / Spark programming
• Experience conducting rapid prototypes or proof of concept for a specific functional / non-functional requirement
• Strong enthusiasm for picking modern platforms like Databricks
• Proficiency in debugging complex code, analyzing and solving problems
• Demonstrated ability to quickly pick a new tool / technology / service and gain depth through self-learning and research
• Worked with modern ETL and Data Movement tools for different patterns – real-time, near real-time and batch
• Experience in delivering projects in a highly collaborative delivery model with teams at onsite and offshore 
• Ability to iteratively design and develop solutions from a concept / idea
• Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external organizations

Qualification & Experience

What You Will Learn: Big Data to Databricks (Training Provided)

• If you have experience in Big Data become an expert in Databricks by our expert team of trainers
• Experience in Big Data, Spark with some database knowledge are the pre-requisites needed for being a Databricks expert.
•  Design, Develop and deliver codebase in Databricks for ingestion, processing and provisioning Data to downstream applications or databases
•  Work with internal stakeholders and client teams in defining robust technology standards, guidelines and best practices
• Estimate cost of the platform and cost of ownership with some reasonable assumptions
• Optimize the data pipelines for performance and cost
• Rationalize design decisions with objective proof points
• Work with different stakeholders such as IT leadership on solution design and architecture

Mandatory Skills:

•  Oracle / Snowflake / Teradata

Some exposure to these skills will be helpful

•  Python / Spark / PySpark