Senior Software Engineer - NIM Platform SDK and Framework

This role is based in Santa Clara, CA, with remote options available in TX and NY.

Compensation:

Base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

Responsibilities:

• Develop and advance the inference microservice framework.
• Architect new features in open-source codebases.
• Build and optimize high-performance model download and caching pipelines.
• Implement model profile and manifest systems for NVIDIA GPUs.
• Develop cloud microservice patterns for reliable operation.
• Mentor teammates and establish high engineering standards.

Requirements:

• BS or MS in Computer Science or related field.
• 8+ years of experience in microservice and cloud software development.
• Deep expertise in cloud-native microservice architecture.
• Strong programming skills in Python and Rust.

Tech stack:

Python, Rust, C/C++, Docker, Kubernetes, cloud services.