As an AI Software Engineer, you will design and deploy sophisticated ML and LLM systems, focusing on text understanding and reasoning. You will build RAG pipelines and agentic systems, optimizing foundation models for domain-specific performance. This role is central to integrating cutting-edge AI services into production systems and benchmarking performance against proprietary datasets.
This job is no longer actively hiring. Open Roles to see active jobs.
AI Software Engineer at fast-growing AI startup
Join a fast-growing AI startup in San Francisco building the next generation of LLM-powered systems. As an AI Software Engineer, you will design RAG pipelines, fine-tune foundation models, and deploy scalable agentic systems. If you are passionate about pushing the boundaries of generative AI and multi-modal reasoning, this is your chance to make a massive impact at a well-funded company backed by top-tier VCs.
Overview
Role overview
Company
About the company
Fast-growing generative AI startup
Responsibilities
What you will do
- Design, train, and deploy LLM systems for text generation, summarization, and complex reasoning tasks.
- Build and optimize retrieval-augmented generation (RAG) and agentic systems using vector databases.
- Fine-tune models using LoRA/Q-LoRA and develop scalable evaluation pipelines using PyTorch and HuggingFace.
Candidate profile
Who this is a fit for
- Strong foundation in deep learning and NLP with proficiency in Python and frameworks like PyTorch.
- Hands-on experience with LLMs (GPT, Claude, Llama) and vector databases such as Pinecone or Milvus.
- Proven ability to optimize system performance for inference speed, memory efficiency, and quantization.
===
What makes it remarkable
Why this role is remarkable
- Work at the forefront of generative AI, implementing advanced RAG and multi-modal reasoning systems.
- Join a well-funded team backed by top-tier VCs in the heart of the AI innovation hub.
- Significant technical ownership with the opportunity to shape the future of AI-driven product capabilities.
Jack & Jill
How Jack & Jill work together
Meet Jack
Jack gets to know what you're great at and what you want next, then searches 14 million jobs daily and introduces you directly to hiring managers.
How does this work?
Jack's an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack's network.
If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives.