Graduation assignment: Test framework for a modern Azure data platform

Key Skills

.NET, Aartificial intelligence, Azure, Continuous Integration & Continuous Delivery - CI/CD, Data Architecture, Database, Databricks, ETL frameworks, IT, Machine learning techniques, SQL

Job Description

Developing the most complete possible testing framework for a modern Azure data platform. That's your assignment. To be able to check whether unit tests, integration tests and data quality tests really work.

Required interest(s)

• Data & AI
• Azure Modern Data Architectures
• .NET

What do you get

• A challenging graduation assignment
• €1000 reimbursement, €500 + lease car or €600 + living space
• Professional guidance
• Trainings aimed at your graduation trajectory
• Sparring with other graduates and colleagues
• Two vacation days per month

What you're going to do

• 35% Graduation research
• 40% Analyze, design, realize
• 25% Documentation

»

In a modern cloud data platform, large amounts of data are sometimes loaded, transformed and distributed. This happens across various types of data stores, including relational databases, but also unstructured stores such as data lakes or document databases.

In the data pipelines that are built within such a platform, more and more techniques are used to load, transform and store the data, including SQL scripts, but also Python scripts, Machine Learning models or propriatary cloud ETL tools, such as Azure Data Factory.

But how do you know whether these types of data pipelines are working correctly? And whether the ever-expanding data stores still contain consistent and reliable data? These are questions that you will be working on.

»

The assignment

We scoped this assignment on a modern data platform built with Microsoft Azure components, including

• Azure Storage
• Azure Data Factory
• Azure SQL Database
• Azure Databricks

For such a data platform, you investigate what options there are for unit tests, integration tests and data quality tests, all part of CI/CD pipelines. For a number of tests, good support is almost certainly lacking within the tools used and something will have to be devised to be able to test whether the data platform works properly. This is also part of your assignment.

At the end of your assignment, you will have devised the most complete possible testing framework for a modern Azure data platform and implemented part of it as proof that the framework works.

What does Info Support offer you during your graduation period?

Naturally, we offer you an excellent package of graduation conditions with various options. Think about:

• Laptop, all necessary tools and development environments to successfully complete your assignment
• A graduation allowance where you can choose from:
• €1000 gross per month
• €500 gross per month + lease car with fuel card
• €600 gross per month + living space in Veenendaal

During your graduation internship you will be included in one of our business units. This way you immediately get a good idea of ​​the developments within our projects.

In addition, Info Support offers you:

• A challenging graduation assignment at a solid, growing and financially healthy company
• Professional and experienced guidance, hybrid working
• A graduation program including training, knowledge evenings, project visits, activities and team, unit and company outings
• Experimenting with new products and releases that are in the pre-release phase
• Sparring with other graduating students and collegial and passionate IT colleagues
• View of the IT Top Traineeship with permanent employment!

Over Info Support

Info Support is a specialist in custom software, data/AI solutions, management and training and active in the Finance, Industry, Agriculture, Food & Retail, Mobility & Public and Healthcare sectors. We offer solid and innovative solutions for complex and business-critical software issues. Our head offices are located in Veenendaal (NL) and Mechelen (BE). Info Support currently employs approximately 500 employees.