Staff Software Engineer, Data Infrastructure

Peregrine Technologies
San Francisco, California, United States
Full Time
On Site
Senior
USD 200,000 – 275,000
Bachelor Degree
Data & Analytics Information Technology Telecommunications

Posted 3 days ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

A Staff Data Infrastructure Engineer role focused on designing and implementing large-scale, real-time data systems using technologies like Apache Iceberg, Spark, Kafka, and AWS. The role involves architecting scalable data storage, processing pipelines, and ensuring operational excellence in a senior individual contributor capacity.

Responsibilities

The Staff Data Infrastructure Engineer will architect and build systems to ingest, store, and serve massive volumes of real-time operational data, taking deep ownership over the entire data layer that underpins the company's platform. This involves designing high-throughput integration platforms, architecting scalable open table format layers, and optimizing distributed data processing pipelines.

Qualifications

Airflow Apache Flink Apache Iceberg Apache Kafka Apache Spark AWS Data Infrastructure Kubernetes Python Scala

Candidates must have 8+ years of experience architecting and operating large-scale data infrastructure systems in production, with deep expertise in open table formats like Apache Iceberg and extensive hands-on experience with Apache Spark for batch and streaming processing. Strong software engineering fundamentals in Python and/or Scala, coupled with solid experience in cloud platforms like AWS, are also required.

English

Benefits

  • Benefits
  • Equity
  • Bonus

Company

Peregrine Technologies

Peregrine Technologies

linkedin
Software Development
Location
San Francisco, California, United States

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.