Research Scientist Intern, PyTorch Compiler (PhD)

This internship lasts between twelve (12) to sixteen (24) weeks, with various start dates throughout the year.

Compensation:

$7,650/month to $12,134/month + benefits

Responsibilities:

• Develop new techniques in TorchDynamo, TorchInductor, PyTorch core, and PyTorch Distributed.
• Explore the intersection of PyTorch compiler and PyTorch Distributed.
• Optimize Generative AI models across the stack (pre-training, fine-tuning, and inference).
• Improve general PyTorch performance.
• Conduct cutting-edge research on ML compiler and ML distributed technologies.
• Collaborate with users of PyTorch to enable new use cases for the framework.

Minimum Qualifications:

• Currently has or is in the process of obtaining a PhD degree in Computer Science, Computer Engineering, or a relevant technical field.
• Experience in ML compiler, Distributed Training, ML systems, or similar.
• Proficient in Python or Cuda programming.
• Must obtain work authorization in the country of employment at the time of hire.

Preferred Qualifications:

• Experience working on other ML compiler stacks, especially on PT2 stack or Triton.
• Experience doing performance optimization on machine learning models.
• Intent to return to degree program after the completion of the internship/co-op.
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, or first-authored publications.
• Experience working and communicating cross-functionally in a team environment.