Senior Engineer II - Big Data

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

At American Express, we know that with the right backing, people and businesses have the power to progress in incredible ways. Whether we’re supporting our customers’ financial confidence to move ahead, taking commerce to new heights, or encouraging people to explore the world, our colleagues are constantly redefining what’s possible — and we’re proud to back each other every step of the way. When you join #TeamAmex, you become part of a diverse community of over 60,000 colleagues, all with a common goal to deliver an exceptional customer experience every day.

You won’t just shape the world of software.

You’ll shape the world of life, work and play.

Our Software Engineers not only understand how technology works, but how that technology intersects with the people who count on it every day. Today, innovative ideas, insight and new perspectives are at the core of how we create a more powerful, personal and fulfilling experience for all our customers. So, if you’re interested in a career creating breakthrough software and making an impact on an audience of millions, look no further.

 You won’t just keep up; you’ll break new ground.

We’re looking for a highly skilled and motivated Senior Big Data Engineer with a history of building and leading Big Data Applications. Someone who fosters a culture of high quality and innovation using new capabilities to drive the release of resilient, robust, and performant solutions, to help us build a global platform that will form a backbone of our Marketing ecosystem. We are building an Enterprise Eligibility product using modern Technology and we need someone who can help us evolve our thinking and engineering to ensure that our platform grows in a sustainable way, delivering business value faster and adapting rapidly to change.

Joining the Enterprise Marketing team, this role will be focused on the delivery of innovative solutions to satisfy the needs of our business. As an agile team we work closely with our business partners to understand what they require, and we strive to continuously improve as a team. We all have a role in accelerating our delivery of high quality reliable and resilient code, and as a Senior Engineer you have the opportunity to look at the bigger picture and steer the team in the right direction, being cognizant of developments across the wider enterprise.

Key Responsibilities:

There are hundreds of opportunities to make your mark on technology and life at American Express. Here’s just some of what you’ll be doing:

• As a part of our team, you will be developing innovative, high quality, and robust operational engineering capabilities
• Develop software in our technology stack, which is constantly evolving but currently includes Java, Hive, MapReduce, Spark, MAPR-DB, Unix Shell Script, React JS, etc.
• Work with Business partners and with stakeholders to understand functional requirements, architecture dependencies, and business capability roadmaps
• Lead technical solution design to meet business requirements
• Lead agile project teams in technical issue resolution in line with company and platform strategic direction
• Taking your place as a core member of an Agile team driving the latest development practices
• Identify and drive reengineering opportunities, and opportunities for adopting new technologies

• 10+ years of Software Development experience
• BS or MS Degree in Computer Science, Computer Engineering, or other Technical discipline
• Hands-on experience of at least 7 years in Big Data technologies like Hadoop, Hive, MapReduce Spark, Kafka, Relational Databases, with at least 5 years in Spark and Scala
• Hands-on experience of at least 3 years in Java
• Hands-on experience of at least 5 years in Python, including using it inside the Spark framework
• Experience of leading and being a coach for Team members
• Strong Object-Oriented Programming skills and design patterns
• Good knowledge about Maven build tool and configuration management tools like SVN/Git-hub
• Strong analytical and problem-solving aptitude
• Good communication skills and teamwork
• Understanding of various SDLC methodologies, particularly Agile
• Open-minded and passionate about learning new technologies
• Suggest and recommend solution architecture to resolve business problems
• Perform code review and lead technical discussions with the team on the best solutions possible
• Capable to work as a Technical subject expert
• Willingness to learn new technologies and exploit them to their optimal potential

Additional good to have experience:

• Knowledge of American Express Marketing systems and data is highly preferred
• Working Knowledge of Microservices, Docker, and Cloud computing
• Agile Practices of Software development – Scrum, Kanban
• Splunk Knowledge
• Contribution to Open Source