Sr Platform Engineer

Key Skills

Java Programming, Python Programming, Framework, SQL, Apache Kafka, Scala Programming, Jupyter Notebook, NumPy, Pandas, YARN, R Programming, SPARK Programming, H2O

Job Description

This is a Platform Engineering role supporting Architecture, Platform and Strategy for many new initiatives at Bank of America in TX, NJ or NC. The team will be building data, platform, advanced analytical and self-service capabilities using Open source distributed computing, AI/ML, and Big Data technologies for Consumer, Small Business, Fraud and wealth organizations. Candidate must possess a passion for producing high quality software and solutions, be ready to jump in and solve complex problems, and perform code reviews.

Required Skills:

• Bachelor’s or Master’s Degree in Computer Science or engineering or related field
• 10+ years of experience in platform development, architecture, and strategy for data science, modeling, and advanced analytics
• Experience building E2E analytics platform focusing on self-service for as Data science, Big Data platform, Analytics etc.
• Experience working with technical and line of business users to gather the requirements, writing BRD for building platform, brainstorm with different set of tech and non-tech audience, document the details with conceptual diagrams, validate the tech feasibilities of capabilities by researching and working with tech teams, architects and engineers
• Reviews technical designs to ensure that they are consistent with defined architecture principles, standards, and best practices. Own technical decisions for the solution and application developers in the creation of architectural decisions and artifacts. Ability to clearly communicate with team & stakeholders
• Collaborate with product teams, data analysts and data scientists to design and build solutions
• Manage next generation of architectural decision for advanced analytics platform, create strategy, roadmaps, present to tech and non-tech leaders
• Strong understanding of modern open source based data science platform architecture for storage & compute separation, , interactive development workbenches, virtual environments, containers, and toolsets such as Jupyter, Spyder, VSCode and how they work with open source languages & libraries such as Python, R, H2O, SciKitLearn, Pandas, NumPy etc.
• Accountable for the availability, stability, scalability, security, and recoverability enabled by the designs
• Support the company’s commitment to protect the integrity and confidentiality of systems and data.

Desired Skills:

• Experience building E2E ML pipelines: Data prep, Model Build, training models, Deployment, Scoring, Monitoring and Optimization
• Hands on experience on driving and maintaining a culture of quality, innovation, and experimentation. Research on new tools and capabilities for better UI and UX for advanced analytics platform, quick prototype and demonstrate the features and capabilities, and participate on various user forums.
• Hands on experience on implementing CI/CD and automation using the Atlassian ecosystem

• Experience in designing, developing, and maintaining software frameworks using Open Source technologies such as Python, Spark, Jupyter, H2O etc.
• Knowledge of metadata management, data lineage, and principles of data governance
• Experience designing and building full stack solutions utilizing distributed computing architecture

• Design and build and deploy streaming and batch data pipelines capable of processing and storing large datasets quickly and reliably using Kafka, Spark and YARN

• Good understanding and knowledge of processing and deployment technologies such YARN, Kubernetes/containers and serverless
• Experience working on Java, Scala or Python based tools and technologies