You will build and operate high-throughput data foundations for agentic AI products, focusing on real-time decisioning and scalable event-driven systems. This role involves designing robust batch and streaming pipelines while collaborating with product and ML teams to shape technical strategy and evolve the infrastructure behind revenue-critical advertising decision engines.
Back to all jobs
Find a job withJack
This job is no longer actively hiring. Open Roles to see active jobs.
United Kingdom preferred) / RemoteNot Disclosed
Senior Data Engineer at VC-backed adtech AI startup
Join a well-funded AI startup building the next generation of agentic advertising infrastructure. As a Senior Data Engineer, you'll design high-throughput streaming pipelines and lead the technical evolution of real-time decisioning systems that power revenue-critical workflows. This is a rare chance to work at the intersection of Big Data and Agentic AI with a path to leadership in an async-friendly, low-ego environment.
Overview
Role overview
Company
About the company
VC-backed adtech AI startup
Responsibilities
What you will do
- Design and maintain high-volume batch and streaming pipelines using Kafka, SQS, and Spark for real-time AI workflows.
- Develop scalable data models and transformation layers using dbt and lakehouse patterns to support ML and analytics.
- Deploy and manage AWS data infrastructure using Terraform/CDK, ensuring high reliability, observability, and cost-effective performance.
Candidate profile
Who this is a fit for
- Proven experience building production-grade streaming systems and handling complex event-driven data edge cases like backfills and idempotency.
- Strong proficiency in Python, SQL, and modern data stack tools such as Airflow, dbt, and AWS data services.
- Pragmatic mindset with the ability to bridge data engineering with AI/ML requirements, including feature generation and RAG-ready datasets.
What makes it remarkable
Why this role is remarkable
- Opportunity to shape the data foundations of agentic AI systems that drive real-time, revenue-critical advertising decisions.
- Join a well-funded, distributed team where you have significant autonomy to influence technical decisions and scale production infrastructure.
- Potential to transition into a Tech Lead role while working with a modern stack including Spark, Kafka, and agentic coding tools.
Jack & Jill
How Jack & Jill work together
I get to know what you’re great at, then find roles you’d never find yourself.Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
I recruit from Jack’s network and make the intro when I spot a great match.And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
Meet Jack
Jack gets to know what you're great at and what you want next, then searches 14 million jobs daily and introduces you directly to hiring managers.
How does this work?
Jack's an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack's network.
If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives.
Jack