Microsoft

Principal Technical Program Manager

United States, Multiple Locations, Multiple Locations

Found: Today

Overview

The Azure HPC & AI Infrastructure team defines and delivers the systems that power some of the world’s largest AI training and inference workloads. As Microsoft continues to expand the scale and sophistication of its AI infrastructure, networking is a key defining technology determining system performance, reliability, efficiency, and speed of deployment.

We are seeking a Principal Technical Lead for AI Infrastructure Networking to provide technical leadership for the networking architectures that connect GPU and accelerated computing infrastructure. This role will help deliver the next generation of networking capabilities behind Microsoft’s AI infrastructure, spanning technologies including InfiniBand, RDMA, high-performance Ethernet, network interface devices, switches, optics, and emerging AI interconnect architectures.This is a highly cross-functional technical leadership role operating at the intersection of AI systems architecture, networking, GPU platforms, datacenter infrastructure, software, operations, and silicon and networking suppliers. The successful candidate will define technical strategy, shape architecture and roadmap decisions, and drive complex infrastructure programs from early technology evaluation through qualification, deployment, and operation at hyperscale.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

Define the technical strategy and multi-year AI architecture direction for networking capabilities supporting Microsoft’s large-scale AI training and inference infrastructure. Use fleet telemetry, performance analysis, customer signals, and operational incidents to identify systemic improvements and influence future architecture and product investments.
Provide technical leadership across complex AI infrastructure systems spanning GPU and accelerated computing infrastructure, systems software, telemetry, and operations into scalable end-to-end solutions.
Translate AI workload requirements into system and networking architecture requirements spanning bandwidth, latency, topology, congestion management, resiliency, security, observability, serviceability, and operational efficiency.
Lead technical evaluation and architectural decision-making across technologies including InfiniBand, RDMA, advanced Ethernet fabrics, network interface devices, switches, optics, cables, GPU interconnects, and emerging AI networking technologies.
Create clarity in highly ambiguous problem spaces by driving alignment on complex architectural decisions and technical tradeoffs across networking, hardware and software engineering, systems architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing organizations.
Partner with internal AI workload teams and strategic customers to understand evolving training and inference requirements and convert those requirements into infrastructure capabilities and technology roadmap investments.
Influence the roadmaps and technical direction of strategic silicon, networking, and systems suppliers, ensuring emerging technologies can meet Microsoft’s requirements for performance, reliability, scale, serviceability, supply, and cost.
Establish technical success criteria and engineering mechanisms for measuring performance, reliability, availability, deployment readiness, operational health, and infrastructure efficiency.

Qualifications

Required Qualifications:

Bachelor's Degree AND 8+ years experience in engineering, product/technical program management, data analysis, or product development
- OR equivalent experience.
6+ years of experience managing cross-functional and/or cross-team projects.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

Bachelor's Degree AND 15+ years experience engineering, product/technical program management, data analysis, or product development
- OR equivalent experience.
10+ years of experience managing cross-functional and/or cross-team projects.
6+ year(s) experience designing, developing, deploying, or operating distributed large-scale datacenter, cloud, HPC, accelerated computing, or AI infrastructure.
6+ year(s) deep technical experience with high-performance networking technologies such as InfiniBand, Ethernet, RDMA/RoCE, network interface devices, switches, routing and switching architectures, congestion management, optics, or high-speed interconnects.
6+ year(s) experience evaluating complex system architectures and translating workload requirements into technical requirements, architecture decisions, and executable engineering plans.
6+ year(s) experience influencing technical decisions without relying solely on direct organizational authority, including the ability to build alignment among engineering, architecture, operations, product, and business stakeholders.

View Details and Apply