Staff/Principal DevOps Engineer, AI Inference

Lila Sciences
Cambridge, Massachusetts, United States
Full Time
On Site
Senior
USD 192,000 – 272,000
Technology Information Technology Telecommunications

Posted 2 days ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

The Staff/Principal DevOps Engineer - AI Inference will design, implement, and optimize infrastructure for scalable machine learning model serving, focusing on GPU/accelerator systems, Kubernetes, AWS cloud services, and observability tools to ensure high performance, low latency, and efficient utilization across production AI inference workloads.

Responsibilities

You will design and optimize infrastructure for serving machine learning models at scale, focusing on low-latency and high-throughput inference. This involves managing GPU clusters, building model serving platforms, and ensuring reliable production deployments.

Qualifications

AWS DevOps GPU infrastructure Helm Kubernetes Load balancing Model serving Networking Python Terraform

The role requires extensive experience in DevOps, SRE, or Platform Engineering with a focus on GPU/accelerator infrastructure and Kubernetes. Proficiency in AWS, infrastructure-as-code, and Python is essential for managing high-performance ML workloads.

English

Benefits

  • Medical coverage
  • Dental coverage
  • Vision coverage
  • Life insurance
  • Disability insurance
  • Flexible time off
  • Paid parental leave
  • Educational assistance program
  • Commuter benefits
  • Subsidized lunch program
  • Equity

Company

Lila Sciences

Lila Sciences

linkedin
Technology, Information and Internet
Location
Cambridge, Massachusetts, United States
Website
lila.ai

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.