Skip to main content
Back to all jobs

This job is no longer actively hiring. Open Roles to see active jobs.

Confidential company

Job listing

San Francisco, United StatesNot Disclosed

Machine Learning Infrastructure Engineer at early-stage private AI platform

Are you ready to build the future of truly private, personal AI? This early-stage platform is seeking a Machine Learning Infrastructure Engineer to architect and scale systems that serve thousands, then millions, of personalized models while guaranteeing bulletproof user data privacy. If you're passionate about empowering individuals with AI and thrive in a fast-paced, mission-driven environment, this is your chance to make a monumental impact on the trajectory of AI development.

Overview

Role overview

Build the core infrastructure to serve thousands, then millions, of private, personalized AI models at scale. This role involves optimizing model serving performance for low latency and cost, and integrating a TEE-based privacy stack to ensure user data and models are exclusively accessible by the user, not even the company. Drive the foundational systems for a new era of personal AI.

Company

About the company

early-stage private AI platform

Responsibilities

What you will do

  • Build infrastructure for deploying thousands to millions of personalized finetuned models.
  • Monitor and optimize in-the-wild model serving performance for low latency and cost.
  • Integrate with a TEE-based privacy stack to guarantee user data and model confidentiality.

Candidate profile

Who this is a fit for

  • Deep understanding of the machine learning stack, including transformer optimization and GPU performance.
  • Ability to execute quickly in a fast-paced, early-stage startup environment.
  • A missionary mentality, passionate about ensuring AI works for people.

What makes it remarkable

Why this role is remarkable

  • Pioneer the infrastructure for truly private, personal AI models, ensuring user data remains confidential.
  • Join an early-stage, well-funded startup backed by top-tier VCs and leading AI experts.
  • Make a massive impact on the future of AI, helping to keep humans empowered in a post-AGI world.

Meet Jack

Thumbnail for Meet Jack

Jack gets to know what you're great at and what you want next, then searches 14 million jobs daily and introduces you directly to hiring managers.

How does this work?

Jack's an AI agent for job searching and career coaching. He works for you.

Jill is the AI recruiter working for the company. She recruits from Jack's network.

If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives.

Find a job withJack

Ready to find your next role?

Talk to Jack for 10 minutes and see your first matches.