You will join a world-class engineering team building a high-performance inference server designed for scale. This role focuses on optimizing batched inference workflows and low-level systems architecture to support massive AI workloads. You will play a pivotal role in establishing one of Europe's premier inference teams while working on cutting-edge hardware-software integration.
Back to all jobs
Find a job with Jack
Member of Technical Staff at high-growth AI infrastructure startup
Are you ready to build one of the strongest AI inference teams in Europe? This high-growth AI infrastructure startup is looking for a Member of Technical Staff to lead the development of their batched inference server. Based in London with an in-person culture 2-3 days a week, this role offers a rare chance to work on low-level systems optimization at the 75th-90th percentile of the market's salary range. If you have deep expertise in systems programming and want to shape the future of AI scaling, this is the career-defining move you've been waiting for.
About this role
Role overview
About the company
About the company
High-growth AI infrastructure startup
What you'll do
What you will do
- Design and implement high-performance batched inference systems for large-scale AI models.
- Optimize low-level system performance and hardware utilization to reduce latency and increase throughput.
- Collaborate with cross-functional teams to architect scalable infrastructure for next-generation AI applications.
Who you are
Who this is a fit for
- Extensive experience in systems programming, low-level optimization, or high-performance computing (HPC).
- Proven track record of working on inference engines, compilers, or distributed systems at scale.
- Strong architectural intuition and the ability to thrive in a fast-paced, in-person engineering culture.
Why this role
Why this role is remarkable
- Opportunity to build one of the strongest AI inference teams in Europe from the ground up.
- Backed by top-tier VCs with a focus on high-performance computing and infrastructure.
- Highly competitive compensation package featuring 75th-90th percentile salary and significant equity upside.
Jack & Jill
How Jack & Jill work together
I get to know what you’re great at, then find roles you’d never find yourself.Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
I recruit from Jack’s network and make the intro when I spot a great match.And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
Meet Jack
Jack gets to know what you're great at and what you want next, then searches 15 million jobs daily and helps you discover roles at companies like this.
How does this work?
Jack’s an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack’s network.
If it’s a match and the company wants to meet you, they’ll make the intro. In the meantime, if you’d like, Jack will send you excellent alternatives.