Engineering Manager, Inference Infrastructure

Anthropic
San Francisco, California, United States
Full Time
Hybrid
Manager
USD 405,000 – 625,000
Bachelor Degree
Technology Information Technology Telecommunications

Posted 3 days ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

The role involves leading a team to develop and maintain the control plane for Anthropic's inference fleet, ensuring high throughput, reliability, and efficiency across complex, large-scale AI deployment systems. The candidate will make architectural decisions, improve system performance, and coordinate across multiple teams and cloud providers to optimize AI inference infrastructure.

Responsibilities

You will lead a team of engineers to design and maintain the inference control plane, ensuring optimal throughput, latency, and reliability for AI models. You are responsible for the technical roadmap, operational health, and cross-team collaboration to scale infrastructure across heterogeneous hardware and cloud providers.

Qualifications

capacity planning cloud infrastructure distributed systems incident response load balancing machine learning systems on-call management performance optimization system architecture team leadership

Candidates must have extensive experience in engineering management for critical-path production infrastructure and a deep background in distributed systems. Proficiency in performance optimization, operational incident response, and the ability to mentor teams through rapid growth are essential.

English

Benefits

  • Competitive compensation
  • Equity donation matching
  • Generous vacation
  • Parental leave
  • Flexible working hours

Company

Anthropic

Anthropic

linkedin
Research Services
Location
San Francisco, California, United States

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.