Senior Software Engineer, Network System Validation

What you’ll be doing:

• Review system and product requirements, design validation methodologies, develop and implement comprehensive test plans, functional and performance, for networking technologies in large-scale AI cluster solutions

• Develop and maintain benchmarks, automation tools and scripts for test execution, environment setup, log collection, and data analysis.

• Lead end-to-end investigation of complex issues by reproducing real-world scenarios, analyzing logs, telemetry, packet captures, and system metrics to identify functional issues and performance bottlenecks, triaging problems across the hardware and software stack, and driving them to root cause and resolution

• Read and understand source code (C/C++/Python) to investigate defects, validate fixes, and improve logging, instrumentation, and debugging capabilities

• Collaborate deeply with software and hardware development teams to debug networking technologies, including NCCL, RoCE, RDMA, and related software components using targeted experiments and code inspection

• Profile and research AI training and inference workloads, correlating application behavior with network and system telemetry to identify scalability and performance limitations

• Document findings, communicate technical results, and continuously improve validation methodologies, automation environments, and engineering processes

What we need to see:

• B.Sc. / B.A. in Computer Science, Electrical Engineering, or equivalent experience

• 8+ years of experience in networking, system validation, or related domains

• Proven experience debugging complex production systems by forming hypotheses, designing experiments, and driving issues to root cause

• Ability to read, debug, and reason about C/C++ code (Rust or Go a plus)

• Strong scripting and automation experience using Python, Bash, and/or Ansible

• Deep understanding of distributed systems: concurrency, consistency models, fault tolerance, and large-scale system performance under stress

• Ability to drive technical alignment across teams, communicate tradeoffs clearly, and make high-quality architectural decisions at speed

• Advance AI-driven approaches to test automation: intelligent scenario generation, LLM-augmented root-cause analysis, and autonomous validation pipelines

Ways to stand out from the crowd:

• Experience with large-scale clusters or distributed systems

• Familiarity with NVIDIA networking solutions (ConnectX, SpecX, BlueField)

• Background in performance analysis, Kubernetes, or cloud environments

• Background in chaos testing, fault injection, or simulation systems

We have some of the most forward-thinking and hardworking people working for us. If you're creative and autonomous, we want to hear from you! NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, disability status or any other characteristic protected by law.