High Performance Computing Lead

Key Skills

Aartificial intelligence, Amazon Elastic Compute Cloud-EC2, Amazon Simple Storage Service (S3), AWS, C Programming, C++, Data Analysis, Data Modeling, Docker, High performance computing- HPC, Infrastructure as code, Keras software library, Linux Operating system, Machine learning techniques, Management, Puppet, Python Programming, Red Hat Enterprise Linux - RHEL, Scrum Agile Methodology, TensorFlow, Terraform, Unix Operating system

Job Description

Job Title

High Performance Computing Lead

Collaborate with Innovative 3Mers Around the World

Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a diversity of people, global locations, technologies and products, 3M is a place where you can collaborate with other curious, creative 3Mers.

This position provides an opportunity to transition from other private, public, government or military experience to a 3M career.

The Impact You’ll Make in this Role

As a High Performance Computing Lead, you will have the opportunity to tap into your curiosity and collaborate with some of the most innovative and diverse people around the world. Here, you will make an impact by:

• Driving Scientific Research by helping data scientists conduct complex simulations, data analysis, and modeling across a wide range of fields.
• Accelerate Innovation by designing, optimizing, and implementing cutting-edge HPC systems and technologies,.
• Enhancing Computational Efficiency by ensuring the systems are optimized for performance , energy efficiency, and cost effectiveness, enabling researchers to achieve results faster and with reduced resource consumption.
• Designing and Managing HPC Infrastructure by partnering with 3M IT to recommend and aid in the design, deployment, and maintenance HPC clusters and storage systems, ensuring the reliability, scalability, and security of the infrastructure.
• Mentoring and Training junior engineers, researchers, and scientists in effectively utilizing HPC resources and best practices to harness the full potential of HPC technologies.
• Exploring Emerging Technologies by staying up to date with the latest trends in HPC, cloud computing, machine learning, and artificial intelligence to identify opportunities to integrate emerging technologies into research processes, unlocking new possibilities and capabilities.

Your Skills and Expertise 

To set you up for success in this role from day one, 3M requires (at a minimum) the following qualifications:

• Bachelor’s degree or higher (completed and verified prior to start)
• Three (3) years of professional experience leading and managing HPC solutions and platforms in a private, public, government or military environment

Additional qualifications that could help you succeed even further in this role include:

• Deep Linux/UNIX experience, especially with RedHat Linux and its derivatives; not only with respect to Linux command-line utilities and package management, but an understanding of process management, kernel tuning for maximum performance, network tuning for maximum performance, memory management, and storage management, and how to debug performance degradation
• Automation and configuration management experience of many Linux systems (via the usual configuration management tools like Chef, Puppet, Salt, CFEngine, bcfg2, etc)
• Experience/exposure to C/C++, and/or Fortran, their compilers, and their common project build tools in Linux/UNIX (Make, autoconf, or CMake), especially with respect to building and maintaining installation of open-source applications
• Systems-level Python development experience (that is, writing Python programs to perform/automate functions on Linux systems)
• Knowledge of how to at least use and launch Docker containers; managing container registries/repositories
• AWS IaaS experience (EC2, VPCs, AMIs, EBS) as well as managed services like S3, EFS, and Route53; and deploying/managing AWS resources with CloudFormation, Terraform, AWS CDK, or similar.
• Exposure to LDAP, AD, and OAuth2/SAML authentication
• Scrum/Agile team mentality
• Exposure to HPC workload management tools or paradigms, either as a user or as an administrator, and the concepts of batch processing and scheduling.
• Workload management solutions might include PBS Professional, OpenPBS, SLURM, Univa Grid Engine, HTCondor. We happen to use PBS Professional.
• Knowledge of distributed and parallel filesystems, such as Lustre, BeeGFS, OrangeFS,GPFS/SpectrumScale, PanFS/ActiveStor, Gluster. We happen to use Lustre (specifically AWS FSx for Lustre) and BeeGFS in AWS, while we use PanFS on-prem.
• Exposure to parallel processing paradigms such as MPI for process-parallel computation and OpenMP for thread-parallel computation
• Knowledge of, or at least some exposure to, object-oriented design patterns, regardless of the language in which they learned them
• Use and/or administration of AI/ML tools like TensorFlow, Keras, Torch at scale
• Individuals should display leadership, excellent communication skills (oral, written and presentation) networking skills, self-motivated and self-directed