You will own the GPU inference infrastructure powering real-time AI conversations with sub-second latency. Managing multi-provider GPU deployments and EKS clusters, you’ll optimize performance from CUDA hot paths to backend services. This role is critical for scaling a platform that enables seamless human-to-AI interaction across global regions.
Senior Software Engineer, Infrastructure at well-funded AI video platform
Own the GPU inference infrastructure behind a revolutionary real-time AI human platform. As a Senior Infrastructure Engineer, you will design multi-provider GPU deployments and optimize EKS clusters to power live, face-to-face conversations with sub-second latency. If you're a Kubernetes and GPU expert looking for high ownership and broad technical scope in the AI space, this role is for you.
Want to apply for this role?
C
Jack finds you jobs at companies like Confidential company. Talk to Jack to get considered for roles that fit what you're great at.
Location
San Francisco, United States / Remote
Compensation
$160k-$250k + Equity
Company
Confidential company
Role overview
About the company
Well-funded AI video platform
What you will do
- Design and manage multi-region GPU deployments across various providers to ensure reliable, high-performance inference.
- Architect EKS clusters including custom routing and scheduling logic to optimize workload placement across a global GPU fleet.
- Collaborate with researchers to optimize CUDA hot paths and reduce cold-start times for live, face-to-face AI conversations.
Who this is a fit for
- Possesses hands-on experience deploying and optimizing large-scale GPU inference workloads on cloud providers like CoreWeave or AWS.
- Demonstrates deep expertise in Kubernetes and EKS, specifically regarding complex service routing and cluster management at scale.
- Proven track record of senior technical leadership, taking ownership of ambiguous infrastructure challenges and delivering production-ready solutions.
===
Why this role is remarkable
- Own the core infrastructure for a cutting-edge real-time AI video interface that operates at sub-second latency levels globally.
- Join a well-funded Series B startup backed by top-tier VCs, operating with a small, high-impact team of roughly 40 people.
- Work at the intersection of infrastructure and research, directly influencing how conversational AI humans are deployed and experienced.
How Jack & Jill work together
I get to know what you’re great at, then find roles you’d never find yourself.Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
I recruit from Jack’s network and make the intro when I spot a great match.And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
Jack gets to know what you're great at and what you want next, then searches 15 million jobs daily and helps you discover roles at companies like this.
Meet Jack
What happens next?
Jack’s an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack’s network.
If your profile’s a match and Confidential company wants to meet, Jill will make the intro. In the meantime, Jack will send you excellent alternatives.