Staff Product Manager (Evals)

Workato
Palo Alto, California, United States
Full Time
On Site
Senior
USD 185,000 – 250,000
Bachelor Degree
Software Information Technology Telecommunications

Posted 2 days ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

The role involves owning and developing evaluation frameworks for AI agents at Workato, including internal tools for shipping better AI features and customer-facing tools for assessing agent performance. Responsibilities include designing evaluation criteria, building evaluation experiences, partnering with engineering teams, and establishing metrics for quality assessment.

Responsibilities

Own the internal and customer-facing evaluation frameworks for AI agents to ensure quality and performance. Partner with ML engineers and product teams to integrate evaluation tools into the builder journey and establish quality metrics.

Qualifications

AI/ML systems collaboration with ML engineers communication skills developer tools enterprise product development evaluation frameworks product management product roadmaps technical translation test suites

Requires 7+ years of product management experience with hands-on expertise in writing evaluations for AI/ML systems. Must possess a strong ability to translate complex technical concepts into accessible products for business technologists.

English

Benefits

  • Benefits
  • Perks
  • Equity

Company

Workato

Workato

linkedin
Software Development
Location
Palo Alto, California, United States

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.