Data Engineer

Key Skills

Unix Operating system, Java Programming, Python Programming, C++, SQL, DevOps, SQL Server, RDBMS, Big Data Technology, Apache Hadoop, Apache Kafka, Scala Programming, Natural Language Processing (NLP), Continuous Integration & Continuous Delivery - CI/CD, Cloudera, MySQL, SPARK Programming, Bash scripting, AWS Kinesis, PowerShell Programming, Data Engineering, Data pipelines, ETL frameworks

Job Description

Capgemini is a?diverse collective of more than?330,000?strategic and technological experts?based across more than?50 countries, partnering with?world-renowned clients?to transform?and manage their businesses. We are dedicated to leveraging?cloud, data, AI, connectivity,?software, digital engineering, and platforms?to address the?entire breadth of their business needs. This passion drives a?powerful commitment - to?unlock the true value of?technology.?

Over the last 18 months, we have tripled our business in Australia and New Zealand, with over 3,300 team members devoted to helping clients get the future they want. Now is the time to join our rapidly growing team who are at the forefront of finding new ways technology can help us reimagine what's possible, collecting unique career experiences with global brands and game-changing tech projects.

Let's talk about the team:

Our Insights and Data team helps our clients make better business decisions by transforming an ocean of data into streams of insight. Our clients are among Australia's top performing companies, and they choose to partner with Capgemini for a very good reason - our exceptional people.

Let's talk about the role and responsibilities:

• Build robust, efficient and reliable data pipelines consisting of diverse data sources to ingest and process data
• Design and develop real time streaming and batch processing pipeline solutions
• Assemble large, complex data sets to meet functional / non-functional requirements
• Design, develop and implement data pipelines for data migration and collection, data analytics and other data movement solutions

Let's talk about your capability and experience:

• University degree in computer science, computer engineering or equivalent Math's and Science Degree.
• At least 1 year of experience in the following:
• Knowledge or experience in programming languages, such as Java, Python, C++.
• Knowledge or Experience with SQL development, an Understanding of Stored Procedures and Functions.
• Knowledge or Experience in one RDBMS such as MS SQL Server, MySql.
• Knowledge or Experience in version control platforms such as GitHub, Gitlab or AWS Beanstalk.
• Knowledge or Experience in cloud platforms - AWS, Azure, Google.
• Knowledge or experience in Software development life cycle and Agile Development methodologies. 

Nice to have

• Knowledge or interest in Data Engineering and ETL pipelines
• Knowledge or interested in Data Science (Machine Learning and Natural Language Processing)
• Knowledge of CI/CD DevOps practices.
• Knowledge of Message Brokers Such as Jboss, Kafka, Amazon Kinesis, Azure Event Hub.
• Knowledge or experience Big Data Technologies such as Hadoop, Cloudera, Spark, Scala.
• Knowledge or experience in Machine Learning Platforms such as Knime,
• Knowledge or experience working in Unix/*nic with Bash/Shell scripting