Senior Technical Program Manager, AI Inference

NVIDIA’s AI Platform Inference team builds the inference technology that powers AI applications worldwide. We’re hiring a Senior Technical Program Manager to lead critical programs across software, hardware, and tooling — helping our engineering teams move from roadmap to reality with speed and precision. Leading inference programs at NVIDIA means owning the full program lifecycle — from initial planning through delivery. We value clear thinking, strong execution, and people who thrive in technically complex environments where no two days look the same.

What You’ll Be Doing:

• Drive planning, scheduling, dependency tracking, and executive reporting across multiple concurrent inference programs.
• Partner with hardware and software engineering leads to align library development with new and upcoming hardware timelines.
• Coach teams on agile practices and run the rituals that keep programs on track.
• Build and maintain metrics that surface risks early and support decisions with real data.
• Communicate program status and technical context clearly to engineering teams and senior leadership alike.
• Align global, cross-disciplinary teams spanning hardware, software, and product.
• Identify process gaps and implement improvements that increase delivery quality and team efficiency.
• Moderate complex technical discussions and drive them to clear, documented conclusions.

What We Need to See:

• BS degree in Computer Science, Artificial Intelligence, or equivalent experience plus 10 years of experience leading global technical programs.
• Solid knowledge of software engineering standard methodologies, hardware bring-up processes, and enterprise quality standards.
• Proficiency with Scaled Agile frameworks and program tracking tools.
• Demonstrated ability to resolve resource conflicts, unblock teams, and drive alignment at every level of the organization.
• Clear, compelling communication skills across both technical and business audiences.

Ways to Stand Out from the crowd:

• Proven experience in machine learning, deep learning, GPU technology, or AI infrastructure.
• Experience shipping production AI software or co-managing software-hardware programs end to end.
• A record of building scalable program management practices in growing engineering organizations.
• Mentorship instincts — the kind of person who invests in the teams around them.
• Familiarity with open-source inference frameworks or model optimization tooling.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:168,000 USD – 258,750 USD for Level 4; and 200,000 USD – 322,000 USD for Level 5.