← All jobs

Senior Systems Software Engineer, Kubernetes Scale – DGX Cloud

About the role

• Drive end-to-end performance and scale characterization for the NVIDIA DGX Cloud software stack, from Kubernetes control and data planes through NVIDIA components such as GPU Operator, Network Operator, DCGM, NIM, and distributed inference serving
• Collaborate with AI researchers, developers, and customers to develop automated tests simulating real user workloads
• Investigate performance and scale issues in complex distributed systems and identify root causes
• Design and develop monitoring, reporting, and analysis tools for performance and scale testing across software, GPU, and CPU resources
• Triage, debug, and resolve issues related to operating Kubernetes clusters at ultra-large scale
• Build and maintain a continuous, always-on performance and scale testing framework through a modern CI/CD pipeline
• Document research, methodologies, and results, and present findings at internal and external venues including KubeCon and GTC
• Engage with Kubernetes, CNCF, and NVIDIA open-source communities to validate AI workload performance and help shape design and development decisions

• 8+ years of experience in Computer Architecture, Networking, Storage systems, Accelerators
• Bachelor's or Master's degree in Engineering, preferably Electrical Engineering, Computer Engineering, or Computer Science, or equivalent experience
• Expertise in Kubernetes and familiarity with related CNCF projects
• Background working with large-scale parallel and distributed accelerator-based systems
• Expertise optimizing performance and AI workloads on large-scale systems
• Experience with performance modeling and benchmarking at scale
• Proficiency in Golang/Python
• Background with the NVIDIA software ecosystem in both training and inference domains
• Expertise with at least one public CSP infrastructure (GCP, AWS, Azure, OCI, for example)
• Strong operational experience with any one Kubernetes distribution
• Prior experience scaling Kubernetes clusters to ultra-large node and object counts
• Demonstrated history of working in the open-source community
• PhD in relevant areas is a way to stand out
• Excellent communication and interpersonal abilities