Engineering Manager, Agent Oversight

Advertisements
IT & Technology 🇺🇸 San Francisco, CA; New York, NY 22 Oct 2026

Role overview

Scale is an AI data foundry building reliable systems for critical decisions, partnering with leading enterprises and governments to deploy production-grade AI. You’ll manage the engineering team building Scale’s platform for monitoring, evaluating, and improving agentic applications—covering deployment, oversight, and continuous learning so agents perform reliably at enterprise and government scale. Agent development tooling remains nascent industry-wide, and this role offers the opportunity to define the standard for production-grade agentic AI oversight.

Key responsibilities

  • Lead a multi-disciplinary team of software and ML engineers to deliver capabilities across the Scale Generative AI Platform, driving technical execution and shipping features end-to-end.
  • Own the platform roadmap spanning deployment, monitoring, evaluation, and ML-driven improvement of agentic applications.
  • Collaborate cross-functionally with customers, forward-deployed teams, product managers, and internal engineering partners to translate enterprise and government requirements into platform capabilities.
  • Drive high-velocity experimentation to validate and improve platform capabilities based on real customer usage patterns.
  • Establish technical direction, team culture, and processes for a rapidly growing organization.
  • Mentor and develop both software and ML engineers, influencing how the team scales technically and organizationally.

Requirements

  • At least seven years of engineering experience, including two or more years directly managing engineers or ML engineers responsible for production ML or LLM-powered systems beyond consuming third-party ML APIs.
  • Hands-on familiarity with agent architectures including tool use, planning, and multi-agent orchestration, with the technical depth to make informed tradeoffs with your team.
  • Ability to review ML experiment design and evaluation methodology critically, asking sharp questions and earning credibility with ML engineers and scientists.
  • Track record owning the full lifecycle of platform-level infrastructure from initial design through scaling across multiple internal or external teams as usage and complexity grow.
  • Experience collaborating with product managers, forward-deployed engineering teams, and customers to translate real-world requirements into prioritization and shipped capabilities.
  • Demonstrated success building and growing high-performing engineering teams through hiring, retention, and measurable improvements in output or velocity.

What makes this role worth considering

You’ll join the Applied Intelligence Systems team, Scale’s frontier group pushing agentic AI capabilities and experiencing strong traction across both commercial and public sector customers. The team operates across San Francisco and New York, offering geographic flexibility while working on infrastructure and tooling that directly powers production agentic systems at scale.

Advertisements

How to apply

Use the Apply button to view the official job posting and submit your application on Scaleai's careers site.

ImmigrationCafe is a job listing directory, not a recruiter. Applications are submitted on the employer's official careers website.

Location