Big Data Engineer - Java, Hadoop, Spark

American Express
Apply Now

Job Description

You Lead the Way. We’ve Got Your Back.

At American Express, we know that with the right backing, people and businesses have the power to progress in incredible ways. Whether we’re supporting our customers’ financial confidence to move ahead, taking commerce to new heights, or encouraging people to explore the world, our colleagues are constantly redefining what’s possible — and we’re proud to back each other every step of the way. When you join #TeamAmex, you become part of a diverse community of over 60,000 colleagues, all with a common goal to deliver an exceptional customer experience every day. 

You won’t just shape the world of software. You’ll shape the world of life, work and play. Our Software Engineers not only understand how technology works, but how that technology intersects with the people who count on it every day. Today, innovative ideas, insight and new perspectives are at the core of how we create a more powerful, personal and fulfilling experience for all our customers. So if you’re interested in a career creating breakthrough software and making an impact on an audience of millions, look no further. You won’t just keep up, you’ll break new ground.

From building next-generation applications with state of the art technology to using AI in multiple domains, you could be doing transformational work that brings our iconic, global brand into the future. As a part of our tech team, we could work together to bring ground-breaking and diverse ideas to life that power the digital systems, services, products and platforms that millions of customers around the world depend on. If you love to work in building great products, contribute to open source, or use the latest technologies, we’ll support you with an open environment and learning culture to grow your career.

Fortune revealed its 2021 List of the 100 Best Companies to Work For in the U.S., and American Express is celebrating its second consecutive year in the Top 10.

We are looking for energetic, high-performing and highly skilled Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next generation global marketing capabilities. This team is responsible for Global Customer Marketing Personalization products which including batch/real-time analytical, machine learning and modeling solutions leveraging transformational technologies, such as Hadoop, Spark, HDFS, MapReduce, Hive, HBase, Pig & Java. This young team has delivered class leading products with many firsts in the organization including the first Member Rewards (MR) Personalization in the enterprise. Today we support 21+ channels and support content across Card, Merchant & MR offers and are expanding rapidly with a focus on building a single Global Customer Marketing Personalization Product with a focus on driving omni-channel experience for our Card members by delivering world-class innovative solutions leveraging best in class Machine Learning techniques, processing TBs of data, to provide highly personalized member journey to drive profitable growth for the organization.

 Focus:

Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications.

Organizational Context:

Member of a product engineering or delivery and integration team reporting to a Senior Engineer or Engineering Director.

How will you make an impact in this role?

Software Development

  • Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)
  • Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality
  • Primary focus is spent writing code, conducting code reviews and testing in ongoing sprints, or doing proof of concepts/automation tools. Applies visualization and other techniques to fast track concepts.
  • Debug basic software components and identify code defects for remediation
  • Enable the deployment, support, and monitoring of software across test, integration, and production environments
  • Automate deployments in test or production environments
  • Functions as a core member of an Agile team driving user story analysis and elaboration, design and development of software applications, testing and builds automation tools.
  • Identifies opportunities to adopt innovative technologies & build reusable components.
  • Ensures timely & effective communication with the reporting manager.
  • Automatically scale applications based on demand projections

Leadership

  • Demonstrate increased self-reliance to achieve team goals
  • Influence team members with creative changes and improvements by challenging status quo and demonstrating risk taking

Range of Impact/Influence:

  • Accountable for team completing work you’re leading and work you are doing as agreed upon
  • Accountable to team for delivery of quality work.

Minimum Qualifications

This high energy Engineer must have:

  • A Bachelor’s degree in computer science, computer engineering, other technical discipline, or equivalent work experience
  • 5+ years of software development experience. Hands-on expertise with application design, software development, and automated testing.
  • Experience collaborating with the business to drive requirements/Agile story analysis.
  • Ability to effectively interpret technical and business objectives and challenges, and articulate solutions.
  • Ability to think abstractly and deal with ambiguous/under-defined problems.
  • Ability to enable business capabilities through innovation. Looks proactively beyond the obvious for continuous improvement opportunities.
  • High energy, demonstrated willingness to learn new technologies, and takes pride in how fast they develop working software.
  • Experience with design and coding across one or more platforms and languages as appropriate
  • Hands-on expertise with application design, software development and automated testing
  • Experience with distributed (multi-tiered) systems, algorithms, and relational databases
  • Confirmed experience with object-oriented design and coding with variety of languages
  • Bachelor’s Degree in computer science, computer science engineering, or related experience required; advanced degree preferred

High Performance Behaviors:

  • Recognizes opportunities to adopt innovative technologies to enable business capabilities
  • Keeps up to date on current research and technology in the industry
  • Recognizes the importance of collaboration to achieve objectives
  • Clearly communicates ideas and concepts to others
  • Finds opportunities within projects and acts on own initiative without being prompted, including making appropriate decisions as vital
  • Provides feedback to team members in code reviews
  • Drive creative changes & continuous improvements
  • Mentors and guides junior team members to success within the team

Knowledge/Skills:

  • Able to understand and use complex data structures and associated components
  • Designs, codes, tests, maintains, and documents applications
  • Lead reviews of colleagues' work
  • Defines test conditions based on the requirements and specifications provided
  • Has deep understanding of the core tools used in the planning, analyzing, crafting, building, testing, configuring, and maintaining of assigned application(s)
  • Deep understanding of infrastructure technologies and components

Technology Skills You'll Use Every Day:

  • Adaptive Communication
  • Agile Practices
  • Industry and Company Knowledge
  • Change Management
  • Technical Acumen
  • Technology Industry Trends

Game Changers:

  • Flexibility
  • Collaboration & Partnership
  • Continuous Improvement
  • Courage
  • Curiosity
  • Resourcefulness
  • Servant Leadership
  • Tenacity

Role/Strengths You’ll Need:

Technical

  • Strong programming knowledge in Java
  • Solid understanding of data structures, Algorithms & Design Patters is required
  • Hands-on experience in Big Data technologies (at least MapReduce, Hive and Hbase)
  • Understanding and experience with UNIX / Shell / Perl / Python scripting
  • Database query optimization and indexing
  • Web services design and implementation using REST / SOAP
  • Strong analytical ability
  • Excellent communication skills

Bonus skills:

  • Machine learning/data mining
  • Object-oriented design and coding

Functional

  • Business Analysis
  • Data Management
  • Release and Deployment
  • Systems Development Management
  • User Experience Evaluation and Analysis

Leadership

  • Analytical Thinking
  • Building High Performance Teams
  • Coaching and Mentoring
  • Decision-making
  • Executive Presence
  • Influence and Negotiation

Business

  • Business Product Knowledge
  • Problem Solving

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability status, age, or any other status protected by law. 

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.

ReqID: 21008924

Schedule (Full-Time/Part-Time): Full-time

Date Posted: May 11, 2021, 9:13:41 AM

Company Info.

American Express

At American Express, we know that with the right backing, people and businesses have the power to progress in incredible ways. Whether we’re supporting our customers’ financial confidence to move ahead, taking commerce to new heights, or encouraging people to explore the world, our colleagues are constantly striving to uphold our powerful backing promise to our customers and each other every day.

Get Similar Jobs In Your Inbox

American Express is currently hiring Big Data Engineer Jobs in Gurgaon, Haryana, India with average base salary of ₹840,000 - ₹2,160,000 / Year.

Similar Jobs View More