Ml Ops Engineer

Description:

ML Ops Engineer
📍 Location: Austin, TX (Day 1 Onsite) ( Local Only )
📅Mode: Full-Time / Contract
🍎 Ex-Apple candidates & locals strongly preferred

Are you obsessed with making LLM-powered agents reliable at scale? We're building the evaluation backbone for our AI ecosystem—and we need you to own it.

🎯What You'll Do:
✅Design evaluation frameworks from scratch (LLM-as-judge, golden datasets, safety guards)
✅Embed quality gates into CI/CD to catch regressions pre-production
✅Lead incident triage & root-cause analysis for critical agent failures
✅Build observability & reporting dashboards for leadership visibility

🎯What You Bring:
✅5+ yrs ML/Ops/SRE experience + 2+ yrs hands-on with LLMs in production
✅Strong Python & CI/CD (GitHub Actions) skills.
✅Experience building ML evaluation/test harnesses
✅Calm under pressure—you debug complex distributed systems like a pro
✅Builder mindset—blank page? No problem.