Staff Software Engineer: AI Inference Data Plane

DigitalOcean
San Francisco, California, United States
Full Time
Remote
Senior
USD 167,200 – 209,000
Engineering Information Technology Telecommunications

Posted 3 days ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

The role involves leading AI inference performance optimization, focusing on GPU kernel tuning, memory and parallelization strategies, and hardware integration for advanced large models, requiring deep expertise in GPU architectures, low-level programming, and open-source collaboration.

Responsibilities

The engineer will lead the technical strategy for benchmarking and performance optimizations at the inference engine and GPU kernel layers to maximize throughput and minimize latency for inference services. Responsibilities include engineering complex solutions for performance issues like attention layer optimizations and managing memory/precision, while acting as a technical leader guiding the roadmap.

Qualifications

AI inference GPU optimization High-performance computing Memory management Model optimization Parallel programming Performance tuning System design

Candidates must possess over 5 years of experience in high-performance computing or AI infrastructure, demonstrating expertise in solving compute utilization and memory bandwidth bottlenecks. A deep familiarity with the Generative AI landscape, hands-on experience with distributed GPU optimization, and fluency in NVIDIA/AMD hardware and software stacks are essential.

English

Benefits

  • Employee Assistance Program
  • Local Employee Meetups
  • Flexible Time Off Policy
  • Bonus
  • Equity Compensation
  • Employee Stock Purchase Program

Company

DigitalOcean

DigitalOcean

linkedin
Software Development
Location
San Francisco, California, United States

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.