Lead HPC Architect Cybersecurity and Cloud - High Performance Computational and Data Ecosystem

The Scientific Computing and Data group at the Icahn School of Medicine at Mount Sinai partners with scientists to accelerate scientific discovery. To achieve these aims we support a cutting-edge high-performance computing and data ecosystem along with MD/PhD-level support for researchers. The group is composed of a high-performance computing team a clinical data warehouse team and a data services team.

TheLead HPC Architect Cybersecurity and Cloud High Performance Computational and Data Ecosystem is responsible forarchitecting designing and leading the technical operations in the cybersecurity and cloud for Scientific Computings computational and data science ecosystem. This ecosystem includes high-performance computing (HPC) systems clinical research databases and a software development infrastructure for local and national projects. The HPC system is the fastest in the world at any academic biomedical center (Top 500 list).

To meet Sinais scientific and clinical goals theLead brings a strategic tactical and customer-focused vision to evolve Sinais computational and data-rich environment to be continually more resilient secure scalable and productive for basic and translational biomedical research. The development and execution of the vision includes a deep technical understanding of the best practices for computational data software development systems cybersecurity and cloud along with a strong focus on customer service for researchers. TheLead is an expert troubleshooter andproductive team member. The incumbent is a productive partner for researchers and technologists throughout the organization and beyond.

Scientific Computings computational and data science ecosystem include a 50000 core and 50 petabyte usable high-performance computing cluster clinical data warehouse and software development environment.

This position reports to the Associate Director for Computational & Data Ecosystem in Scientific Computing. Specific responsibilities are listed below.

HPC Cybersecurity Cloud Architecture and HPC Administration:

• Lead the design development implementation and management of all technical operations and system administration tasks in cybersecurity and cloud consistent with best practices including hardware and software configurations configuration management monitoring usage reporting system performance (parallel file systems scheduler networking high availability etc.).
• Ensure that all designs andimplementations meet cybersecurity performance scalability and reliability goals. Ensure that the design and operation of the HPC ecosystem is productive for research.
• Architect and implement best practices in cybersecurity in the HPC environment including but not limited to encrypting data in flight and at rest configuring and managing audit/logging managing access control and authentication control setting up secure enclaves and network configurations.
• Develop policies and procedures to assess and address security vulnerabilities manage access controls completing all data security documents accurately and efficiently.
• Lead the troubleshooting isolation and resolution of all cybersecurity and cloud technical issues.
• Collaborate effectively with research and hospital system IT Compliance HIPAA security and other departments to ensure compliance with all regulations Sinai policies andrelevant cybersecurity standards (e.g. NIST ISO GDPR).
• Design and implement hybrid and HPC solutions that integrate on-premise resources with public cloud platforms.
• Evaluate cloud-based HPC resources for various workloads and manage the seamless movement of workloads between on-premises and cloud environments.
• Develop automation and orchestration for cloud infrastructure deployment and management.
• Perform all HPC system administration tasks including installation monitoring maintenance troubleshooting performance analysis and tuning of HPC applications networking storage and hardware to optimize for workload efficiency.
• Provide technical guidance and mentorship.
• Partner with other peers regionally nationally and internationally to discover propose and deploy a world-class research infrastructure for Mount Sinai.
• Stay current with emerging HPC cloud and cybersecurity technologies to keep the organizations infrastructure up-to-date. Develop plans for future work.
• Work effectively and productively with other team members within the group and across Mount Sinai.
• Provide after-hours support as needed.
• Perform other duties as assigned or requested.

• Bachelors degree in computer science engineering or another scientific field. Masters or PhD preferred.
• 10 years of progressive HPC system administration and operations experience in a Redhat/CentOS Linux administration batch cluster environment.
• Experience with all aspects of HPC including schedulers parallel file systems configuration management systems etc.
• Proficient in cybersecurity processes posture regulations approaches protocols firewalls data protection in a regulated environment (e.g. finance healthcare).
• In-depth knowledge HIPAA and NIST SP 800-171 regulations with hands-on experience building HPC system compliant with these or other regulations.
• Proficient with cloud services orchestration tools cost optimization and hybrid HPC architectures.
• Experience with Azure AWS or Google cloud services.
• Proven ability to provide mentorship and technical leadership to team members; Proven ability to independently lead projects to success completion with minimal guidance.
• Must be an expert troubleshooter; Must be a team player and customer-focused.
• Excellent analytical ability and troubleshooting skills.
• Excellent communication collaboration and interpersonal skills.
• Scripting and programming experience.

Preferred Experience

• Experience with LSF and GPFS Spectrum Scale.
• Experience in a healthcare environment.
• Experience in a research environment is highly preferred.
• Experience with implementing HPC in FISMA GDPR and/or other regulatory environments.
• Experience with confidential computing technologies and environments.
• Experience with software that enables privacy-preserving linking of PHI.
• Experience with Globus data transfer.

Experience with SAP HANA Oracle MariaDB and other database technologies