Data Engineer

Key Skills

google-adwords, Java Programming, Python Programming, Database, SQL, XML-JSON, AWS, Big Data Technology, Apache Hadoop, ETL/ELT technologies, NoSQL, Apache Hive, HDFS, Amazon RedShift, PySpark, Sqoop, SPARK Programming, DynamoDB, Lambda, Parquet, Data Lake, Avro, AWS Glue

Job Description

Technology - Software Development/Quality Engineering

Prudential’s Global Technology team is the spark that ignites the power of Prudential for our customers and employees worldwide. Our organization plays a critical and highly visible role in delivering customer-driven solutions across every area of the company. The Global Technology team is made up of diverse, agile-thinking, and highly-skilled professionals; we use our combined capabilities to enable the organization with innovation, speed, agility, scalability and efficiency. 

The Global Technology team takes great pride in our culture where digital transformation is built into our DNA. When you join the Global Technology organization at Prudential, you’ll unlock a challenging and impactful career – all while growing your skills and advancing your profession at one of the world’s leading financial services institutions.

Data Tech team at Prudential Financials is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners.

As a part of our CDO organization, you will work with our ML Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and scalable manner.

Qualifications

• 4+ years of experience as Data developer
• Strong knowledge on Python , SQL , PySpark
• Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience
• Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises
• AWS Solutions Architect or AWS Big Data Certification preferred
• Programming experience with Python and shell scripting
• Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
• Solid experience implementing solutions on AWS based data lakes.
• Experience in AWS data lake/data warehouse/business analytics
• Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS
• Knowledge of ETL/ELT
• Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark
• Experience working on Agile projects

Requirements:

• 4+ years of experience as Data developer
• Strong knowledge on Python , SQL , PySpark
• Experience working using AWS and its services
• Experience developing business applications using NoSQL/SQL databases.
• Experience working with Object stores(S3) and Avro/Parquet/JSON
• Serverless application development using AWS Glue , Lambda and Step functions

?

Responsibilities:

• Designing, building and maintaining efficient, reusable, and reliable architecture and code.
• Ensure the best possible performance and quality of high scale web applications and services.
• Participate in the architecture and system design discussions
• Independently perform hands on development and unit testing of the applications;
• Collaborate with the development team and build individual components into complex enterprise web systems;
• Work in a team environment with product, frontend design, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle;
• Responsible to identify and resolve any performance issues
• Keep up to date with new technology development and implementation
• Participate in code review to make sure standards and best practices are met

Plus

• Snowflake experience
• Aware of microservice architecture
• Basics of Machine learning algorithms (supervised/unsupervised