Staff Engineer, Inference Optimizations

DigitalOcean
Seattle, Washington, United States
Full Time
Hybrid
Senior
USD 191,200 – 239,000
Software Information Technology Telecommunications

Posted 2 days ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

Seeking a Staff Engineer with extensive experience in design and optimization of large-scale multi-tenant AI inference infrastructure, including API development, system resilience, and operational automation, with a focus on GPU utilization, throughput, and fault tolerance.

Responsibilities

Lead the technical strategy for AI inference optimizations to maximize throughput and minimize latency for large models. Solve complex bottlenecks in memory bandwidth and compute utilization while guiding the technical roadmap for the high-performance inference fleet.

Qualifications

AI/ML frameworks (vLLM, Triton) API gateways Cloud-native architectures Distributed systems Golang Inference workloads Kubernetes Monitoring and observability Performance optimization Workload orchestration

Requires 5+ years of experience in high-performance computing or AI infrastructure with deep expertise in NVIDIA and AMD GPU architectures. Must be proficient in low-level GPU programming using Triton or CUDA and have a strong understanding of Gen AI model architectures.

English

Benefits

  • Employee Assistance Program
  • Local Employee Meetups
  • Flexible Time Off Policy
  • Conference Reimbursement
  • Training and Education Reimbursement
  • LinkedIn Learning Access
  • Bonus
  • Equity Grants
  • Employee Stock Purchase Program

Company

DigitalOcean

DigitalOcean

linkedin
Software Development
Location
Seattle, Washington, United States

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.