Senior Software Engineer, GPU Infrastructure (HPC)

Cohere
Canada
Full Time
Remote
Senior
USD 200,000 – 285,000
Technology Information Technology Telecommunications

Posted 1 day ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

The role involves building, scaling, and optimizing GPU/TPU HPC infrastructure for AI workloads, working closely with researchers to support training and evaluation of foundational models. Key tasks include deploying large-scale Kubernetes clusters, troubleshooting system issues, and driving innovation through automation and best practices.

Responsibilities

You will build and scale ML-optimized HPC infrastructure using Kubernetes to support AI model training across multiple clouds. Additionally, you will collaborate with researchers to optimize performance and provide self-service tools for debugging and monitoring training jobs.

Qualifications

Distributed training frameworks Go GPU infrastructure High-performance computing Kubernetes Linux internals ML infrastructure optimization Python RDMA networking Systems engineering

Candidates must have deep expertise in ML/HPC infrastructure, including experience with GPU/TPU clusters and distributed training frameworks. Proficiency in Python and Go, along with strong knowledge of Linux internals and Kubernetes at scale, is required.

English

Benefits

  • Health insurance
  • Dental benefits
  • Mental health budget
  • RRSP matching
  • 401k
  • Pension scheme
  • Parental leave
  • Arts and culture stipend
  • Fitness and wellness stipend
  • Education and learning stipend
  • Paid vacation
  • Home office stipend
  • Lunch stipend

Company

Cohere

Cohere

linkedin
Software Development
Location
Canada
Website
cohere.com

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.