Manager Data Engineer

Key Skills

google-adwords, Java Programming, Python Programming, Database, SQL, XML-JSON, AWS, Big Data Technology, Apache Hadoop, ETL/ELT technologies, NoSQL, Apache Hive, HDFS, Amazon RedShift, PySpark, Sqoop, SPARK Programming, DynamoDB, Lambda, Parquet, Data Lake, Avro, AWS Glue

Job Description

Technology - Software Development/Quality Engineering

Prudential’s Global Technology team is the spark that ignites the power of Prudential for our customers and employees worldwide. Our organization plays a critical and highly visible role in delivering customer-driven solutions across every area of the company. The Global Technology team is made up of diverse, agile-thinking, and highly-skilled professionals; we use our combined capabilities to enable the organization with innovation, speed, agility, scalability and efficiency. 

The Global Technology team takes great pride in our culture where digital transformation is built into our DNA. When you join the Global Technology organization at Prudential, you’ll unlock a challenging and impactful career – all while growing your skills and advancing your profession at one of the world’s leading financial services institutions.

Data Tech team at Prudential Financials is looking for a Manager Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a senior member of the team , this position would require to lead data projects and also work as an individual contributor.

As a part of our CDO organization, you will work with our Data/ML Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and scalable manner.

Responsibilities:

• Designing, building and maintaining efficient, reusable, and reliable architecture and code.
• Ensure the best possible performance and quality of high scale web applications and services
• Design and build highly performant function-based API's
• Participate in the architecture and system design discussions
• Independently perform hands on development and unit testing of the applications;
• Collaborate with the development team and build individual components into complex enterprise web systems;
• Work in a team environment with product, frontend design, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle;
• Responsible to identify and resolve any performance issues
• Keep up to date with new technology development and implementation
• Participate in code review to make sure standards and best practices are met
• Mentor junior data engineers in the team

Qualifications

• 8+ years of experience as Data Engineer
• Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience
• Strong knowledge on Python and SQL
• Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises
• AWS Solutions Architect or AWS Big Data Certification preferred
• Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
• Solid experience implementing solutions on AWS based data lakes.
• Experience developing business applications using NoSQL/SQL databases.
• Experience working on different datasets parquet , avro , json and other formats
• Serverless application development using AWS Glue and Lambda
• Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired
• Experience working on Agile projects

Plus

• Data Architecture in Cloud (AWS)
• Work with external data vendors
• Experience in Snowflake
• Experience in designing microservices/APIs
• Basics of Machine learning algorithms (supervised/unsupervised)