Gusto is looking for a Senior to Staff Machine Learning Engineer to join our ML/AI Platform and build out our Generative AI infrastructure.

About The Role

We’re just starting out on this journey with Generative AI and looking to build the founding ML/AI team that will bring the power of AI to Gusto’s customers. You’ll be working alongside a multidisciplinary group of Product Engineers, PMs, and Applied ML data scientists. In this role, you’ll be responsible for making design decisions around our AI infrastructure, building standard model development and deployment workflows,  and design systems that enable rapid iteration with LLMs.

Here’s what you’ll do day-to-day:

• Develop, maintain, and enhance reusable frameworks for ML/AI model development and deployment. Drive best practices in machine learning engineering and MLOps
• Establish standards and infrastructure for on-going monitoring and evaluation of AI applications in production
• Develop and maintain systems that enable rapid iteration and evaluation of LLM prompts and other tuning mechanisms
• Design and build reliable, performant, maintainable and secure pipelines that can scale to the needs of our business while reducing costs
• Collaborate with the AI model builders and application owners to determine business requirements and SLAs for API-enabled services
• Help design and architect an AI platform that adheres to the principles of Responsible AI
• Balance researching new technologies with a practical approach to operationalizing research efforts into Gusto products
• Maintain relationships with external data and analytics vendors

Here’s what we're looking for:

• At least 4+ years of software engineering experience (Python, Ruby or Java).
• Demonstrated experience architecting and developing services for machine learning models.
• Experience with at least one of the major cloud platforms (AWS preferred but not required).
• Experience with MLOps tooling such as KubeFlow, AWS Sagemaker, MLFlow, or similar.
• [Bonus] Experience deploying and maintaining LLM-based applications in production.

Our cash compensation amount for this role is targeted at $152,000-$214,000/year in Denver, Chicago, and Atlanta, $166,000-$234,000/year in Los Angeles and Seattle, $133,000-$188,000/year CAD in Toronto, and $185,000-$253,000/year for San Francisco and New York.