Senior - Data Engineer (Opportunity based in Barcelona)

Key Skills

Azure, Continuous Integration & Continuous Delivery - CI/CD, Data Engineering, Data science techniques, Data structuring, Design, DevOps, Effective communication skills, ETL frameworks, GraphQL, HDFS, Metadata, NoSQL, PowerBI, SPARK Programming, SQL

Job Description

About the role:

Gartner is looking for a Senior Data Engineer focused on development of integrations/infrastructure leveraging Data Factory/Synapse for our People Technology Projects. The role would primarily focus on conducting data analysis, developing/supporting high performance data ingestion pipelines, data modelling, dashboarding and collaborating with business teams to create scalable solutions as per business requirements.

What you will do:

• Design, test and implement high performance data ingestion pipelines from multiple sources using Data Factory, Databricks
• Collaborate with architects and business/data science teams to create scalable Azure based solutions as per business requirements.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Develop data models and schemas in our data warehouse that enable performant, intuitive analysis.
• Provide expertise and leadership regarding cloud Architecture for infrastructure in Microsoft Azure.
• Recommend best practice methods for improvement and optimization of current infrastructure.
• Create specification documents for designs, testing and support processes.
• Analyze business requirements and prepare development project schedule, tasks, and estimates.
• Collaborate with project team members to identify issues and risks associated with the design, implementation, and delivery of project assignments.

What you will need:

• Strong IT professional with 4 – 7 years of experience in software development for data engineering using Python, Azure/ GCP / AWS. The candidate should have strong problem-solving skills along with high on ownership and accountability. 

Must have:

• 4 years of experience in Solution, Design and Development of Cloud based data models, ETL Pipelines and infrastructure for reporting, analytics, and data science.
• Experience working with and creating databases and Power BI dashboards using all relevant data to inform decisions.
• Experience working with both structured and unstructured data.
• Strong understanding of OOPS, Design principles and Distributed systems and experience of Data Structures and algorithms
• Experience working in different programming languages (Java, python, scala) and version control tools (Git, Subversion)
• Experience working with Spark/ Hive/HDFS 
• Experience using automated build systems (CI/CD)

Good to have:

• Knowledge of different database technologies (Relational, NoSQL, Graph, Document, Key-Value, Time Series, etc…). This should include building and managing scalable data models
• Knowledge of TDD/BDD 
• Experience working with different flavors of SQL and relative database systems
• Experience in DevOps is good to have

Who you are:

• Graduate/Post graduate in
• Excellent communication and prioritization skills.
• Able to work independently or within a team proactively in a fast-paced AGILE-SCRUM environment.
• Owns success – Takes responsibility for successful delivery of the solutions.
• Strong desire to improve upon their skills in software development, frameworks, and 

Don’t meet every single requirement? We encourage you to apply anyway. You might just be the right candidate for this, or other roles.

What you’ll get:

• Competitive Compensation Packages
• 23 days annual holiday, and additional days off for your birthday, 24th & 31st of December.
• Private Medical and Dental Care.
• Life and Disability Insurance.
• Public Transport Subsidy.
• Ticket Restaurant Card.
• Childcare Vouchers (Ticket Guarderia).
• IncentiFit - annual reimbursement for health-and-wellness-related activities.
• Spanish lessons.
• Pension Scheme.
• Tuition Reimbursement.
• Employee Stock Purchase Plan.
• Employee Assistance Program.
• Gartner Gives Charity Match.
• Relocation Assistance - a specialist to help you with all the appointments and paperwork.

Please Note:

• Applications must be submitted in English.
• A valid EU visa/passport is required for this position.