Engineer I - Big Data

Key Skills

AWS, Big Data Technology, Continuous Integration & Continuous Delivery - CI/CD, Data science techniques, Effective communication skills, Google Cloud Platform (GCP), HBase, Java Programming, Machine learning techniques, MongoDB, NoSQL, Presentation skills, PySpark, Python Programming, Scala Programming, SPARK Programming, SQL, Unix Operating system

Job Description

As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers’ digital lives. Here, you can work alongside talented engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems. American Express offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skills fresh and relevant, we give you dedicated time to invest in your professional development. Find your place in technology of #TeamAmex.

Member of a product engineering or delivery and integration team reporting to an Engineering Director

How will you make an impact in this role?

Software Development

• Intermediate to advanced level ability in software development
• Function as member of an agile team by chipping in to software builds through consistent development practices (tools, common components, and documentation)
• Participate in code reviews and automated testing
• Debug basic software components and identify code defects for remediation
• Enable the deployment, support, and monitoring of software across test, integration, and production environments
• Automate deployments in test or production environments
• Automatically scale applications based on demand projections

Leadership

• Opportunity to lead a small team of developers and motivate them to achieve their potential
• Influence team members with creative changes and improvements by challenging status quo and demonstrating risk taking

American Express is looking for energetic, high-performing software engineers to help shape our technology and product roadmap. You will be part of a fast-paced, entrepreneurial team that enables batch/ real-time analytical solutions leveraging transformational technologies (Hadoop/Big Data, Data Science/ML, Python, SQL, UNIX , Shell Scripting) to deliver innovative solutions across multiple lines of businesses. Position requires a bachelor’s or higher degree in Computer Science, Information Systems, Engineering or related field. Good experience in data programming and applications systems design and architecture is required.

• Develops and tests software, including ongoing refactoring of code & drives continuous improvement in code structure & quality
• Primary focus is spent writing code, API specs, conducting code reviews & testing in ongoing sprints or doing proof of concepts/automation tools
• Applies visualization and other techniques to fast-track concepts
• Functions as a core member of an Agile team driving User story analysis & elaboration, design and development of software applications, testing & builds automation tools
• Works on a specific platform/product or as part of a dynamic resource pool assigned to projects based on demand and business priority
• Identifies opportunities to adopt innovative technologies
• Embodies rebel with a cause mentality by looking beyond the obvious for continuous improvement opportunities.
• Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.

 Qualifications

• Bachelor’s degree in Engineering or Computer Science or equivalent OR Master’s in Computer Applications or equivalent.
• 6+ years of software development experience and leading teams of engineers and scrum teams
• 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
• Solid Datawarehousing concepts
• Knowledge of Financial reporting ecosystem will be a plus
• Expert on Distributed ecosystem
• Hands-on experience with programming using Core Java or Python/Scala
• Expert on Hadoop and Spark Architecture and its working principle
• Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data
• Experience in UNIX shell scripting
• Ability to design and develop optimized Data pipelines for batch and real time data processing
• Should have experience in analysis, design, development, testing, and implementation of system applications
• Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.

Preferred Qualifications:

• Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be an advantage
• 1 + years of experience in designing and building solutions using Kafka streams or queues 
• Experience with GitHub/Bitbucket and leveraging CI/CD pipelines
• Experience with NoSQL i.e., HBase, Couchbase, MongoDB is good to have
• Excellent technical and analytical aptitude
• Good communication skills
• Excellent Project management skills.
• Results driven

Salary Range: $85,000.00 to $150,000.00 annually + bonus + benefits

The above represents the expected salary range for this job requisition. Ultimately, in determining your pay, we'll consider your location, experience, and other job-related factors.

We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include:

• Competitive base salaries 
• Bonus incentives 
• 6% Company Match on retirement savings plan 
• Free financial coaching and financial well-being support 
• Comprehensive medical, dental, vision, life insurance, and disability benefits 
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need 
• 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy 
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location) 
• Free and confidential counseling support through our Healthy Minds program 
• Career development and training opportunities

For a full list of Team Amex benefits, visit our Colleague Benefits Site.

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.

We back our colleagues with the support they need to thrive, professionally and personally. That's why we have Amex Flex, our enterprise working model that provides greater flexibility to colleagues while ensuring we preserve the important aspects of our unique in-person culture. Depending on role and business needs, colleagues will either work onsite, in a hybrid model (combination of in-office and virtual days) or fully virtually.

US Job Seekers/Employees - Click here to view the “Know Your Rights” poster and the Pay Transparency Policy Statement.

If the links do not work, please copy and paste the following URLs in a new browser window: https://www.dol.gov/agencies/ofccp/posters to access the three posters.

Employment eligibility to work with American Express in the U.S. is required as the company will not pursue visa sponsorship for these positions.