Lead Hadoop Developer/ Feature Lead

Key Skills

Apache Flink, Apache Hadoop, Apache Kafka, AWS, Azure, Bash scripting, Database, Design, Effective communication skills, Google Cloud Platform (GCP), HBase, HDFS, Leadership Skill, Machine learning techniques, MongoDB, Python Programming, R Programming, Scala Programming, Shell Scripting language, SPARK Programming

Job Description

We are actively seeking a talented and motivated Senior Hadoop Developer/Lead to join our dynamic and energetic team. As a key contributor to our agile scrum teams, you will collaborate closely with the Insights and Voices division. We are looking for a candidate who can showcase strong technical expertise in Hadoop and related technologies, and who excels at collaborating with both onshore and offshore team members. While functioning as an individual contributor for one or more teams, the Senior Hadoop Data Engineer will also have the opportunity to lead and take responsibility for end-to-end solution design and delivery, based on the scale of implementation and required skillsets.

Responsibilities:

• Develop high-performance and scalable Analytics solutions using the Big Data platform to facilitate the collection, storage, and analysis of massive data sets from multiple channels.
• Utilize your in-depth knowledge of Hadoop stack and storage technologies, including HDFS, Spark, MapReduce, Yarn, Hive, Sqoop, Impala, Hue, and Oozie, to design and optimize data processing workflows.
• Apply your expertise in NoSQL technologies like MongoDB, SingleStore, or HBase to efficiently handle diverse data types and storage requirements.
• Implement Near real-time and Streaming data solutions to provide up-to-date information to millions of Bank customers.
• Collaborate with cross-functional teams to identify system bottlenecks, benchmark performance, and propose innovative solutions to enhance system efficiency.
• Take ownership of defining Big Data strategies and roadmaps for the Enterprise, aligning them with business objectives.
• Stay abreast of emerging technologies and industry trends related to Big Data, continuously evaluating new tools and frameworks for potential integration.
• Provide guidance and mentorship to junior teammates.

Qualifications:

• Minimum of 7 years of industry experience, with at least 5 years focused on hands-on work in the Big Data domain.
• Highly skilled in Hadoop stack technologies, such as HDFS, Spark, Yarn, Hive, Sqoop, Impala and Hue.
• Strong proficiency in programming languages such as Python, Scala, and Bash/Shell Scripting.
• Excellent problem-solving abilities and the capability to deliver effective solutions for business-critical applications.
• Strong command of Visual Analytics Tools, with a focus on Tableau.
• Demonstrated understanding of Consumer, Small Business, and Wealth Management Client Feedback exclusions, suppressions, quarantine, and prioritization rules. 

Desired Skills:

• Proficiency in NoSQL technologies like HBase, MongoDB, SingleStore, etc.
• Experience in Real-time streaming technologies like Spark Streaming, Kafka, Flink, or Storm.
• Familiarity with Cloud Technologies such as Azure, AWS, or GCP.
• Working knowledge of machine learning algorithms, statistical analysis, and programming languages (Python or R) to conduct data analysis and develop predictive models to uncover valuable patterns and trends.
• Proficiency in Data Integration and Data Security within the Hadoop ecosystem, including knowledge of Kerberos.

General Job Description:

This role is responsible for providing leadership, technical direction and oversight to a team as they deliver technology solutions. Key responsibilities of the role are to provide oversight of the design, implementation, and maintenance of complex computer programs, align technical solutions to business objectives, and ensure that coding practices/quality comply with software development standards. Qualified candidates will have significant experience through multiple software implementations and have developed both depth and breadth in several technical competencies.

Responsibilities:

• Designs, develops and is accountable for feature delivery
• Applies enterprise standards for solution design, coding and quality
• Ensures solution meets product acceptance criteria with minimal technical debt
• Guides the team on work breakdown and execution
• Works with the Product Owner to ensure that product backlog/requirements are healthy, with clear acceptance criteria
• Plays a team lead role (as an individual contributor) and mentors the team
• Guides team members with skills and practices (planning and estimation, peer reviews and other engineering practices)

This position may also have responsibilities for managing associates. At Bank of America, all managers at this level demonstrate the following responsibilities, in addition to those specific to the role, listed above.

Managerial Responsibilities:

• Diversity & Inclusion: Model an inclusive environment for employees and clients, aligned to company D&I goals.
• Manager of Process & Data: Demonstrate deep process knowledge, operational excellence and innovation through a focus on simplicity, data-based decision making and continuous improvement.
• Enterprise Advocate: Communicate enterprise decisions, purpose and results, and connect to team strategy, priorities and contributions.
• Risk Manager: Ensure proper risk discipline, controls and culture are in place to identify, escalate and debate issues.
• People Manager & Coach: Provide inspection, coaching and feedback to motivate, differentiate and improve performance.
• Financial Steward: Actively manage expenses and budgets in alignment with objectives, making sound financial decisions.
• Enterprise Talent Leader: Assess talent and build bench strength for roles across the organization.
• Driver of Business Outcomes: Deliver results by effectively prioritizing, inspecting and appropriately delegating team work.

Skills:

• System Design
• Customer Focus
• Problem-solving
• Coding
• Testing
• Direct / Prioritize Work
• Coaching
• Solutions Modeling
• Modularization and API
• Database Technologies
• Project Management
• Design Thinking
• Analytical Thinking
• Communication
• Change Agility