Role overview

Vanta helps businesses earn and prove trust through continuous security monitoring and verification. As a Senior Software Engineer on the AI Developer Experience (DX) team, you’ll design and build the systems, infrastructure, and workflows that enable Vanta engineers to work more effectively with AI-powered tools. The AI DX team is creating foundations for more autonomous software development, including background agents, evaluation systems, and tooling that make AI adoption practical and reliable across the engineering organization.

Key responsibilities

Plan, build, and improve background-agent infrastructure that supports reliable, trackable, and repeatable automated engineering work.
Develop systems for evaluating agent performance using task outcomes, quality measures, human intervention, cost, and other measurable signals.
Create evaluation sets and feedback loops that enable AI systems to improve continuously through regular review, tuning, and correction.
Improve how engineers discover, understand, and adopt shared AI tools and workflows within the organization.
Evaluate AI development tools against real engineering needs and integrate those that prove valuable, while creating visibility into which tools are useful, where they cause friction, and how they should evolve.
Work directly with engineers to understand workflow friction, build practical solutions, and use real-usage evidence to continuously improve quality, reliability, and adoption.
Help move ambiguous, dependency-heavy projects from early exploration through reliable delivery while influencing the foundations of an autonomous software factory.

Requirements

Substantial industry experience in software engineering with a track record of taking technical leadership roles on teams and complex projects.
Experience improving AI systems, creating evaluation sets, and driving quality improvements through measurement and iteration.
Strong software engineering fundamentals including designing, building, testing, and operating reliable systems.
Experience with developer tooling, AI-enabled workflows, agentic systems, infrastructure, or related technical domains.
Demonstrated ability to work through ambiguity, decompose complex problems, manage dependencies, and help projects reach completion.
Strong written and verbal communication skills with the ability to explain technical concepts clearly and create guidance for adoption of new tools.
Regular use of AI tools in day-to-day work, with sound judgment in ensuring AI-assisted work meets high quality standards.

What makes this role worth considering

You’ll be working on foundational systems that shape how an entire engineering organization adopts AI, directly influencing the future of autonomous software development. The role combines software engineering rigor with product thinking and offers the opportunity to collaborate closely with engineers and cross-functional stakeholders in a startup environment known for a strong bias toward action. Vanta offers competitive compensation including industry-standard salary and equity, comprehensive benefits (medical, dental, vision), pension contributions, 16 weeks of paid parental leave, health and wellness stipends, and flexible remote work arrangements across Canada with 21 vacation days and 11 company-paid holidays.