Senior Engineer II - Big Data

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

At American Express, we know that with the right backing, people and businesses have the power to progress in incredible ways. Whether we’re supporting our customers’ financial confidence to move ahead, taking commerce to new heights, or encouraging people to explore the world, our colleagues are constantly redefining what’s possible — and we’re proud to back each other every step of the way. When you join #TeamAmex, you become part of a diverse community of over 60,000 colleagues, all with a common goal to deliver an exceptional customer experience every day.

American Express is looking for energetic, high-performing and highly skilled Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise focused on delivering the next generation data engineering solutions. The team will be responsible for experience for our Card members by delivering world-class innovative solutions leveraging best in class Machine Learning techniques, processing TBs of data, to provide highly personalized card member experience and to drive profitable growth for the organization.

Our Software Engineers not only understand how technology works, but how that technology intersects with the people who count on it every day. Today, innovative ideas, insight and new perspectives are at the core of how we create a more powerful, personal and fulfilling experience for all our customers. Centric to it is Big Data and batch/real-time analytical solutions leveraging transformational technologies to deliver innovative solutions across multiple business units.

Responsibilities:

• Perform technical aspects of software development for assigned applications including design, developing prototypes, and coding assignments
• Perform hands-on architecture, design, and development of systems
• Drive consistent development practices with respect to tools, common components, and documentation
• Spend 80% of time writing code and testing, and remainder of time collaborating with stakeholders through ongoing product/platform releases
• Develop deep understanding of tie-ins with other Amex systems and platforms within the supported domains
• Function as a leader on an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)
• Lead code reviews and automated testing
• Perform ongoing refactoring of code, utilize visualization and other techniques to fast-track concepts, and deliver continuous improvement
• Identify opportunities to adopt innovative technologies
• Provide continuous support for ongoing application availability
• Work closely with product owners on blueprints and annual planning of feature sets that impact multiple platforms and products
• Work with product owners to prioritize features for ongoing sprints and managing a list of technical requirements based on industry trends, new technologies, known defects, and issues
• Enable business capabilities through innovation
• Research and learn new and upcoming technologies, and apply them to develop working software
• Mentor other team members in both technology and domain
• Debug software components and identify code defects for remediation
• Leads the deployment, support, and monitoring of software across test, integration, and production environments.
• Empower teams to automate deployments in test or production environments.
• Empower teams to automatically scale applications based on demand projections
• Influence team members with innovative changes and improvements by challenging status quo and demonstrating risk taking
• Demonstrate increased self-reliance to achieve team goals
• Influence team members with innovative changes and improvements by challenging status quo and demonstrating risk taking.
• Bachelors/Master's Degree.

Past Experience:

• 6+ years of software development experience with proven hands-on experience in -
• Big data technologies combination Hadoop, Hive, Hbase, Map reduce, HD Insights OR Spark Structure Streaming with Java, Hbase, and Kafka.
• Programming with object-oriented design and coding with core Java and spring framework.
• Data structure, & Design patterns
• Critical Factors to Success (Outcome Driven)

Business Outcomes:

• Personalized user experience
• Design and deliver innovative big data solutions across multiple business units
• Identify and adopt new technologies to enhance user experience and predict future challenges
• Leadership Outcomes:
• Put enterprise thinking first, connect the role's agenda to enterprise priorities and balance the needs of customers, partners, colleagues & shareholders.
• Lead with an external perspective, challenge status quo and bring continuous innovation to our existing offerings
• Demonstrate learning agility, make decisions quickly and with the highest level of integrity
• Lead with a digital mindset and deliver the world's best customer experiences every day

Functional:

• Familiarity with design & coding across multiple platforms & languages
• Strong analytical & strategic thinking skills
• Ability to interpret technical /business objectives and challenges
• Porting/Software Configuration
• Agile Methodologies
• Software development/ testing
• Product Engineering Knowledge
• Platform engineering knowledge (e.g. Financial Tech/Ecommerce/ Aggregator platforms)

Technical/Platforms:

• Experience in Big technologies with following combinations Hadoop, HDFS, Hbase, oozie, MapReduce, hive, HD Insights OR Spark Structure Streaming with Java, Hbase, and Kafka.
• Experience with object-oriented design and coding with core Java and spring framework.
• Proficiency on Linux.
• Understanding and experience with UNIX / Shell scripting
• Proficiency on REST.
• RDBMS skills – SQL, Hive, optimization techniques, etc.
• Hive, Java, M/R, and Spark Structure Streaming with Java.
• Understanding of data structures, algorithms & Design Patterns

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. 

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.