As an AI Software Engineer, you will design and deploy sophisticated ML and LLM systems, focusing on text understanding and reasoning. You will build RAG pipelines and agentic systems, optimizing foundation models for domain-specific performance. This role is central to integrating cutting-edge AI services into production systems and benchmarking performance against proprietary datasets.
Back to all jobsSee Open Roles
Learn about Jack
This job is no longer actively hiring. Open Roles to see active jobs.
AI Software Engineer at fast-growing AI startup
Join a fast-growing AI startup in San Francisco building the next generation of LLM-powered systems. As an AI Software Engineer, you will design RAG pipelines, fine-tune foundation models, and deploy scalable agentic systems. If you are passionate about pushing the boundaries of generative AI and multi-modal reasoning, this is your chance to make a massive impact at a well-funded company backed by top-tier VCs.
Want to apply for this role?
C
This role is no longer actively hiring, but Jack can still help you discover similar open roles that fit.
Location
San Francisco, United States
Compensation
Not Disclosed
Company
Confidential company
Role overview
About the company
Fast-growing generative AI startup
What you will do
- Design, train, and deploy LLM systems for text generation, summarization, and complex reasoning tasks.
- Build and optimize retrieval-augmented generation (RAG) and agentic systems using vector databases.
- Fine-tune models using LoRA/Q-LoRA and develop scalable evaluation pipelines using PyTorch and HuggingFace.
Who this is a fit for
- Strong foundation in deep learning and NLP with proficiency in Python and frameworks like PyTorch.
- Hands-on experience with LLMs (GPT, Claude, Llama) and vector databases such as Pinecone or Milvus.
- Proven ability to optimize system performance for inference speed, memory efficiency, and quantization.
===
Why this role is remarkable
- Work at the forefront of generative AI, implementing advanced RAG and multi-modal reasoning systems.
- Join a well-funded team backed by top-tier VCs in the heart of the AI innovation hub.
- Significant technical ownership with the opportunity to shape the future of AI-driven product capabilities.
How Jack & Jill work together
I get to know what you’re great at, then find roles you’d never find yourself.Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
I recruit from Jack’s network and make the intro when I spot a great match.And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
Jack gets to know what you're great at and what you want next, then searches 15 million jobs daily and helps you discover roles at companies like this.
Meet Jack
What happens next?
Jack’s an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack’s network.
If your profile’s a match and Confidential company wants to meet, Jill will make the intro. In the meantime, Jack will send you excellent alternatives.