Join a high-leverage team building Skyway, a financial data platform managing multi-billion dollar AI and GPU compute spend. You will design the infrastructure to ingest and normalize massive billing datasets from hyperscalers and neoclouds, turning unstructured contract data into precise financial insights for the world's leading AI labs and enterprises.
Back to all jobs
Learn about Jack
Software Engineer, Platform at Duckbill
AI labs are making ten-figure compute decisions on spreadsheets, and this Heavybit-backed startup is building the financial infrastructure to fix it. As a Platform Engineer, you will join an elite team of six to own the data pipelines processing hundreds of millions of rows of billing data. If you love ClickHouse, Python, and high-autonomy environments, this is the ground-floor opportunity you've been looking for in San Francisco.
About this role
Role overview
About the company
Enterprise B2B SaaS15 employees
We help companies negotiate, manage, and forecast cloud and AI contracts. We’ve worked with hundreds of companies and have supported the negotiation of tens-of-billions in cloud and AI contracts.
What you'll do
What you will do
- Own the streaming and batch data infrastructure processing hundreds of millions of rows of billing data using Python, ClickHouse, and Airflow.
- Architect the contract application engine to map complex, negotiated AI infrastructure agreements into structured, high-precision financial models.
- Design high-performance storage patterns and partitioning strategies to serve sub-second analytical workloads on massive cloud consumption datasets.
Who you are
Who this is a fit for
- Deep experience building robust data systems including warehouses, lakehouses, OLAP databases, and complex ETL pipelines using Python and SQL.
- Proven track record of managing data quality at scale, specifically reconciling streaming and batch data within cloud storage environments like S3 and Parquet.
- Product-minded engineer who thrives in high-autonomy settings and has a meticulous approach to diagnosing anomalies in unstructured data schemas.
Why this role
Why this role is remarkable
- Built on 7 years of deep domain expertise with a massive community reach including 35,000 newsletter subscribers and 5 million podcast downloads.
- Solving the critical "spreadsheet chaos" for strategic finance leaders making ten-figure compute decisions at the world's largest AI labs and neoclouds.
- High-autonomy environment where a small team of six engineers makes foundational architectural decisions for a product with massive market traction.
Jack & Jill
How Jack & Jill work together
I get to know what you’re great at, then find roles you’d never find yourself.Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
I recruit from Jack’s network and make the intro when I spot a great match.And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
Meet Jack
Jack gets to know what you're great at and what you want next, then searches 15 million jobs daily and helps you discover roles at companies like this.
How does this work?
Jack’s an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack’s network.
If it’s a match and the company wants to meet you, they’ll make the intro. In the meantime, if you’d like, Jack will send you excellent alternatives.