Databricks Developer

Key Skills

AWS, Data Engineering, Data Warehousing, Databricks, Docker, Java Programming, Kubernetes-K8s, Machine learning techniques, Python Programming, RDBMS, SQL

Job Description

Roles & Responsibilities? ? Recognize the current application infrastructure and suggest new concepts to improve performance ? Document the best practices and strategies associated with application deployment and infrastructure support ? Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies ? Develop Data Engineering and ML pipelines in Databricks and different AWS services, including API, RDS instance, and Lambda to build serverless applications ? Work jointly with the IT team and other departments to migrate web applications to AWS ? Comfortable to work on tight timelines, when required. Skill Sets Required ? Good decision-making and problem solving skills ? Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse). ? Knowledge on medallion architecture and unity catalog. ? Experience in migrating data from on-prem to Databricks/AWS ? Understanding of core AWS services, uses, and AWS architecture best practices ? Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc. ? Solid knowledge on CI/CD pipeline in AWS technologies ? Application migration of RDBMS, java/python applications, model code, elastic etc. ? Solid programming background on scala, python ? Experience with Docker and Kubernetes is a plus

BTech