Senior Databricks Engineer

Key Skills

Agile methodologies, Azure, Big Data Technology, Business Intelligence, Cloud computing, Data Lake, Data pipelines, Data security, Data Transformation, Data Warehousing, Databricks, Design, DevOps, Effective communication skills, ETL frameworks, PowerBI, Python Programming

Job Description

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Skills / Experience

• Experience with software and cloud engineering and architecture in building enterprise data analytics platforms
• Experience in implementing solutions using Azure Data lake, Azure Databricks and PowerBI
• Experience creating data ingestion and data pipelines using python / databricks
• Experience configuring and deploying Azure services.
• expertise with Python development
• Expertise with Databricks
• Experienced in creating Analytics / BI reporting solutions

Additional skills

• Excellent communication skills verbal and written
• Experienced in facilitating meetings and working sessions
• Experience in Azure DevOps and working in an Agile methodology
• certified in Data Engineering on Databricks. 
• Able to lead the direction on design decisions.

Assignment

Candidate would be working on the Enterprise Data and Analytics Platform. Responsible for the system architecture and solution design, ensuring the platform is scalable while performant.

• Design and implement data pipelines using Databricks, Spark, and other Big Data technologies.
• Collaborate with data scientists, analysts, and business stakeholders to understand their data needs and build solutions that meet those needs.
• Build and maintain data warehouse and data lake solutions that can scale with the business.
• Develop and maintain ETL workflows, including data transformation, validation, and loading.
• Implement and maintain data security policies and procedures to ensure the confidentiality, integrity, and availability of data.
• Build and maintain monitoring, alerting, and logging solutions to ensure the health and performance of data pipelines.
• Optimize data pipelines for performance, scalability, and cost.
• Keep up-to-date with emerging trends and technologies in the Big Data ecosystem.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!