What Changed
From Manual Copying to a Pipeline That Runs Itself

The aim was clean listings in a sheet every morning, with nobody copying them. Here is how JobFlow differs from what came before it.

User Research

Single Image
How We Work

How We Got There

1
Scoped to one job-to-be-done

Cut everything that wasn’t “get clean listings into a sheet.” No login system, no user accounts, nothing the MVP didn’t need.

2
Built scrapers one source at a time

Started with Wellfound, made it reliable, then added each source rather than debugging eight things at once.

3
Hit real rate limits on purpose

Ran sources hard enough in testing to trigger actual throttling, so the queueing behavior was proven before it mattered.

4
Wired the dedup logic

Matched on company, title and location after an early version matched on URL alone and missed obvious duplicates.

5
Shipped the dashboard last

The pipeline worked headless first; the dashboard was built once there was real data worth looking at.

6
Documented each source’s quirks

Each board broke in different ways. Writing down what broke and why meant the next source added didn’t repeat the same debugging.

Software & Tools

The Tools Behind the Innovation