HPC Architect

Quantori·Удалённо·Удалённо·5 мес. назад

Responsibilities

Hybrid Architecture Design: Architect and deploy scalable HPC clusters using on-prem and/or cloud-native HPC cluster managers (e.g., AWS ParallelCluster + Amazon EC2 / Azure CycleCloud + Azure VM Scale Sets / Google Cloud Cluster Toolkit or similar + Compute Engine), ensuring seamless integration with on-premises schedulers. Proven expertise with HPC schedulers and orchestration patterns (e.g. Slurm, cloud HPC cluster orchestration, batch orchestration)
Design and optimize data architectures for large-scale HPC workloads, including high-throughput data movement between on-premises and cloud environments and integration with parallel file systems. Ensure data access, lifecycle, and reproducibility patterns to support scientific computing performance and operational requirements
Design and implement high-performance networking solutions, including private dedicated connectivity and low-latency HPC interconnects (e.g., AWS Direct Connect / Azure ExpressRoute / Google Cloud Interconnect; AWS EFA / Azure HPC fabrics e.g. IB/ GCP HPC interconnect options etc.), to support low-latency MPI applications. Design high I/O workloads (parallel file system patterns) (e.g., AWS / GCP / Azure Managed Lustre or parallel FS deployments and/or self-managed Lustre/GPFS/BeeGFS), observability, reproducibility and operational excellence
Define and maintain containerization standards using contanerization and related technologies to ensure binary compatibility across heterogeneous hardware and environments

Requirements

Knowledge of HPC-with-cloud integration strategies, experience with technical feasibility planning
Excellent communication skills
Strong understanding of regulated enterprise R&D environments
Understanding scientific computing reproducibility requirements, relying on enterprise standard tooling
Deep understanding of Amazon VPC /Google Cloud / Azure networking, peering and security group configurations