Data Engineer/ Python Software Engineer (m/f/d)

Key Skills

Apache Flink, Apache Kafka, AWS, AWS Kinesis, Data Lake, Data Modeling, Effective communication skills, ETL frameworks, Python Programming, SPARK Programming

Job Description

Your role in our team

• Collaborate and work with engineering and data teams to digest data and transform it to our internal domain and store it in our data lake.
• Design, create, and maintain data pipelines for multi-dimensional datasets, across a variety of data platforms (RDS, S3, Postgres, Kafka, Kafka-streams).
• Develop and improve the current data architecture, emphasizing data security, data quality and timeliness, scalability, and extensibility.
• Help automate and monitor our pipelines and the onboarding of new clients.
• Deploy and use various big data technologies and run pilots to design low latency data architectures at scale.

Your profile

• Bachelor's degree in Management Information Systems, Statistics, Software Engineering, STEM, or a related technical/quantitative field.
• 3+ years of experience with ETL, data modeling, data lake approaches.
• 3+ years of experience with processing multi-dimensional datasets from different sources and automating the end-to-end ETL pipeline.
• 3+ years of experience in Python.
• 1+ years of experience in cloud technologies (AWS)
• 1+ years of experience with streaming-based systems (Kinesis/ Kafka) and event-driven design.
• 1+ years of experience in distributed computing systems (such as Spark/Flink)
• Experience with continuous delivery and integration.
• Ability to effectively communicate with both business and technical teams.

Nice to have

• Master’s degree in Management Information Systems, Statistics, Software Engineering, STEM, or a related technical/quantitative field.
• Expertise in ETL optimization, designing, coding, and tuning data processes.
• Knowledge of building data pipelines and applications to trigger or schedule jobs using airflow.
• Experience with micro-service architecture

About us

Want to redefine how entire industries work by leveraging IIoT, Smart Manufacturing, and Industry 4.0?

Would you like to be part of the success of a digital solution which will revolutionize manufacturing processes to improve shop floor performance?

If your answer is a big yes, you should continue reading!

With HQ in Berlin and colleagues in Portugal, Italy, the US, and Austria, FactoryPal is a corporate start-up by the Business Area Digital of the international Körber Groups. The venture is poised to become the leading end to end IoT solution for machine efficiency and equipment effectiveness.

We are engineering a human-friendly and smart machine learning software to digitally enable factories.

We are data scientists, engineers, designers, IIoT experts, product managers, and lean manufacturing consultants. We are a team, united by our shared ambition: revolutionize manufacturing and transform the way it is done to ensure smooth operations.

At FactoryPal, we celebrate diversity and are promoting an inclusive environment in which our team members from all different backgrounds, national origins and cultures, religions, ages, disabilities, genders, or sexual orientations feel equally appreciated. In order to achieve this, we are committed to shaping a hiring process that provides everyone with an equal opportunity to get hired. In order to ensure this concern, we strive to compensate for existing disadvantages. We continuously educate ourselves to be sensitive to discrimination issues and regularly evaluate our application process and interviews. Personnel decisions such as hiring are always made jointly by several responsible team members with different backgrounds.

At FactoryPal we know that the fastest and most rewarding path to success is one that combines different talents, backgrounds, and ideas. Driving equality empowers our team, enables us to innovate, and helps us maintain a more inclusive environment.

Recruitment Team

For questions please contact us via kd.recruitment.porto@koerber.com

 Please apply exclusively via the “Apply now” button.
Recruiter: Joana Nina
We value diversity and therefore welcome all applicants - regardless of gender, nationality, ethnic or social origin, religion/belief, disability, age, sexual orientation and identity, and any other protected status.