Nvidia
Engineering Manager, Inference Benchmarking — AI Perf
Found: Today
This role is based in multiple locations including Santa Clara, CA, Austin, TX, and offers remote options.
Compensation:
224,000 USD - 356,500 USD per year
Responsibilities:
- Drive the technical roadmap for AIPerf's core infrastructure.
- Ensure accuracy and statistical soundness of benchmark results.
- Advise on upstream engine integrations and maintain relevance across emerging hardware.
- Hire, mentor, and grow a team of senior engineers.
Requirements:
- Bachelor's degree in Computer Science or related field, or equivalent experience.
- 8+ years of software engineering experience, with 3+ years in engineering leadership.
- Deep understanding of LLM inference mechanics.
- Proven collaboration skills in high-velocity environments.
Preferred Qualifications:
- Experience with vLLM, TRT-LLM, or SGLang internals.
- Background in Kubernetes-native infrastructure.
- History of contributions to open-source projects.
