Senior Lead Azure Databricks Engineer

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

Nisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto “Building Success Together®,” Nisum has grown to over 1,800 professionals across the United States, Chile,Colombia, India, Pakistan and Canada. A preferred advisor to leading Fortune 500 brands, Nisum enables clients to achieve direct business growth by building the advanced technology they need to reach end customers in today’s world, with immersive and seamless experiences across digital and physical channels.

What You'll Do

• Defines, designs, develops, and test software components/applications using Microsoft Azure- Databricks, ADF, ADL, Hive, Python, Databricks, SparkSql, PySpark.
• Experience in building solutions using a variety of open-source tools Microsoft Azure services and a proven track record in delivering high-quality work to tight deadlines.
• Ability to work with the customer as part of the Agile model of delivery.
• Design and Build Modern Data Pipelines and maintain data warehouse schematics, layouts, architectures, and relational/non-relational databases for data access and Advanced Analytics

What You Know

• Mandatory skills: Java, Azure Databricks, Spark Streaming, Python, PySpark

Other skills:

• Experience with Java8, Spark SQL, Delta Lake, Kafka, ADF, Snowflake, Azure SQL, CosmosDB
• 4-6+ Years of Experience in Data Engineering developing end-to-end Big Data Applications within AzureCloud
• Ability to lead and implement data solutions using Pyspark, SparkSQL, Kafka, Spark Streaming, Azure Databricks, Delta Lake, Storage Accounts, Snowflake
• Good to have experience with Azure Data Factory, Azure SQL, Cosmos
• Strong experience with Agile Scrum Methodology
• Excellent verbal & written communication, problem-solving, analytical, and interpersonal skills
• Experience working with MSFT Teams and using collaboration tools such as Git, Jira, Confluence, etc.,
• Possess a very good understanding of Enterprise Data Management concepts & best practices

Education

• Bachelor’s degree in Computer Science, Information Systems, Engineering, Computer Applications, or related field

Nisum is an Equal Opportunity Employer and we are proud of our ongoing efforts to foster diversity and inclusion in the workplace.