Staff + Senior Software Engineer, Inference Infrastructure

Anthropic
San Francisco, California, United States
Full Time
Hybrid
Senior
USD 320,000 – 485,000
Bachelor Degree
Software Information Technology Telecommunications

Posted 2 months ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

This role involves designing, building, and maintaining distributed systems for AI inference at scale, optimizing compute efficiency across multiple hardware accelerators, and supporting AI model deployment and infrastructure in a cloud environment. The candidate should have significant experience in distributed systems, cloud infrastructure, and programming, with a focus on scalable machine learning system deployment.

Responsibilities

Design and maintain distributed systems to serve Claude to millions of users while maximizing compute efficiency. Build high-performance inference infrastructure and deployment pipelines to support both production and research workloads.

Qualifications

AWS batching caching strategies distributed systems Kubernetes LLM inference optimization load balancing machine learning systems request routing traffic management

Requires significant software engineering experience in distributed systems and a results-oriented mindset. Preferred qualifications include experience with large-scale ML deployment, Kubernetes, and proficiency in Python or Rust.

English

Benefits

  • Competitive Compensation
  • Optional Equity Donation Matching
  • Generous Vacation
  • Parental Leave
  • Flexible Working Hours
  • Office Space

Company

Anthropic

Anthropic

linkedin
Research Services
Location
San Francisco, California, United States

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.