Technical Program Manager, Inference

Anthropic
San Francisco, California, United States
Full Time
Hybrid
Senior
USD 290,000 – 435,000
Bachelor Degree
Technology Information Technology Telecommunications

Posted 2 weeks ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

Manage programs that scale AI inference systems across platforms, ensuring performance, reliability, and efficiency of large-scale serving infrastructure, including capacity, velocity, and inference engine improvements.

Responsibilities

You will own the end-to-end programs for scaling Claude's serving fleet across accelerator and cloud platforms, ensuring reliability and performance. You will also drive developer productivity by identifying bottlenecks and improving the software release lifecycle for inference engineers.

Qualifications

autoscaling capacity planning cloud platforms cluster orchestration deployment and rollout infrastructure ML infrastructure observability project management request routing

Candidates must have 7+ years of experience in technical program management or engineering leadership within distributed systems or ML infrastructure. A strong technical background in large-scale serving, hardware-dependent workloads, and cross-functional collaboration is required.

English

Benefits

  • Competitive compensation
  • Equity donation matching
  • Generous vacation
  • Parental leave
  • Flexible working hours

Company

Anthropic

Anthropic

linkedin
Research Services
Location
San Francisco, California, United States

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.