Role overview

Scale AI is seeking an Infrastructure Software Engineer to join the Applications Platform Engineering team and help build and scale the infrastructure for Scale GP, an enterprise-grade generative AI platform. You will work on core systems that power APIs for knowledge retrieval, inference, evaluation, and related capabilities, serving customers across highly-regulated industries including healthcare, telecom, finance, and retail.

Key responsibilities

Design and architect multi-cloud systems and abstractions that enable the Scale GP platform to operate across GCP, Azure, and AWS.
Develop custom integrations between the Scale AI platform and customer environments, including cloud infrastructure, data warehouses, and internal APIs.
Work directly with platform and product teams as well as customers to design and deploy innovative infrastructure solutions that scale with changing requirements.
Deliver experiments quickly while maintaining high quality standards to support customer engagement and adoption.
Participate throughout the entire product lifecycle from initial design through deployment and production support.
Rapidly acquire new technical knowledge and manage multiple tasks simultaneously in a fast-paced startup environment.

Requirements

At least four years of full-time software engineering experience following graduation.
Demonstrated experience scaling products within high-growth startups or similarly dynamic environments.
Hands-on experience with large-scale distributed systems and proficiency working across multiple cloud providers.
Proficiency in Python or JavaScript/TypeScript and SQL.
Experience with Kubernetes and working with major cloud providers including AWS, Azure, and GCP.
Familiarity with LLMs, vector databases, and emerging AI technologies, either through exploration or production implementation.
Strong communication skills and the ability to explain technical concepts clearly to both technical and non-technical stakeholders.

What makes this role worth considering

Scale works with industry leaders and government agencies to develop reliable AI systems, and the company prioritizes talent density and collaborative teamwork. This role offers the opportunity to build critical infrastructure for an enterprise AI platform while working with customers across diverse, highly-regulated sectors and multiple cloud environments.