Data Engineer (Data Bricks)

Key Skills

Azure, Azure Blob, Azure CosmosDB, Data Lake, MLflow, PowerBI, Python Programming, Scala Programming, Spark-SQL, SparkML, SQL

Job Description

Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for you!

At 3Cloud, we hire people who aren’t afraid to experiment or fail. We hire people who are willing to give direct and candid feedback to their managers, leaders, and team members. We hire people who jump at those opportunities because they care about our collective growth and success. We hire people who challenge and hold each other accountable for living 3Cloud’s core values because they know that it will result in amazing experiences and solutions for our clients and each other.

Job Highlights:

• Our technology focus is on Azure – you’ll have plenty of exciting opportunities to grow your skills in Microsoft and Azure in an environment committed to technical excellence and client experience in a very specific, defined space. Six months of experience on our team is worth years somewhere else.
• Microsoft Partnerships – Our great global relationship with Microsoft ensures that we have a pipeline of cutting-edge Azure work opportunities, and access to the teams that have built the platform. You won’t find this at other places.
• Competitive compensation package, salary, allowance, standard benefits including quarterly and annual performance-based cash bonus and other remuneration.
• Great working environment and company culture with flexible work location.

Key Responsibilities:

• Support the development of high performing, reliable and scalable solutions
• Clearly communicate technical details to business and management personnel
• Work independently or on a team to design and develop database solutions
• Assist business development team with pre-sales activities and RFPs

Qualifications:

• Bachelor’s degree in computer science, engineering, data science or a related field
• Minimum of 5 years of experience with database design, at least 2 years with Azure technologies, and previous Consulting experience
• Knowledge of Databricks development, including Scala, Python, and Spark
• Advanced knowledge of SQL, including ability to write stored procedures, triggers, analytic functions, and performance tuning for Synapse
• Ability to develop utilizing the following technologies:
• Data Movement (Apache Spark, plus Azure Data Factory and legacy SSIS)
• Data Warehousing (Azure Synapse, CosmosDB)
• Azure Storage Technologies (Data Lake, Blob Storage)
• Expertise in Spark DataFrames API and architecture to ingest and manipulate data, including exploring, preprocessing, joining, filtering, dropping sorting, partitioning, and renaming/manipulating columns in the dataset
• Understanding of network infrastructure and security including
• Workspace Deployment
• Azure Cloud Concepts
• Network Security
• Experience with Informatica (Informatica migration experience would be nice)
• Eagerness to contribute in a team-oriented environment
• Desire to work in an information systems environment
• Excellent communication (written and oral) and interpersonal skills for both technical and non-technical teams
• Passionate about learning new technologies
• Analytical approach to problem-solving; ability to use technology to solve business problems
• Ability to work in a fast-paced environment

Preferred Experience/Skills:

• Machine Learning/AI Practitioner expertise, including
• Predictive, Prescription, and Descriptive Analytics using Data Science tools and technologies
• Experience with Azure ML Studio/Services, and R programming language
• Understanding of analysis models, including Supervised vs Unsupervised, Regression vs Classification, clustering, and cross-validation
• Building, Tuning, and deploying analysis models with Spark ML and ML Flow
• Knowledge of Power BI is a plus
• Relevant Certifications are a plus

Don’t meet every single requirement? At 3Cloud we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway.