
Senior Software Architect - Deep Learning and HPC Communications
Role to investigate and improve GPU-to-GPU and node-to-node communication performance, design and implement communication technologies, co-design HW/SW with GPU and networking architects, build proofs-of-concept, run experiments and simulations at large GPU scales. Requirements: M.S./Ph.D. (or equivalent), 3+ years relevant experience, excellent C/C++ programming and debugging, experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), strong Linux skills, and solid understanding of system and network architecture. Desirable: CUDA/NVIDIA GPU experience, knowledge of InfiniBand/RoCE/NVLink, deep learning frameworks (PyTorch, TensorFlow) and HPC application experience.




