A US hotel-intelligence company
Market data collected every night for a hotel-intelligence company
Collectors with proxy rotation feeding MariaDB, running every night since 2025. 8M+ requests a month against the sources the collectors watch.
A real-estate researcher working Montana property records. November 2023.
Every lot in the Yellowstone Club, as one dataset
Property records sit in a state portal built for one lookup at a time, and a real-estate researcher needed the whole Yellowstone Club community as one dataset. We pulled every house and lot through the Montana cadastral API into one CSV, three days after the sample was approved.
Property data. Data.
Yellowstone property records in figures
- 3 daysfrom the approved sample to the full dataset, November 2023
- 37commits to the extractor, started the day the dataset shipped
Every house and lot in the Yellowstone Club, in one CSV
Screens from this system are being added.
The situation
Property records sit in a state portal built for one lookup at a time. The researcher needed the whole community as a dataset, not a page per parcel, and needed it inside a fortnight.
What we built
- Extraction against the Montana cadastral API, with the HTML parcel pages parsed for the fields the API does not return
- Every house and lot in the Yellowstone Club community, written to a structured CSV
- A sample approved by the researcher on 1 November, the full dataset delivered on 4 November
- A Jupyter notebook measuring how the extraction behaved, so the run could be tuned rather than guessed at
What changed
The researcher had the whole community in one file three days after approving the sample.
Read next
Our own engineering
A retail catalogue kept in step with Shopify, price by price
A scheduled Python pipeline that reads Costco product pages, stores them in MongoDB and creates and updates the matching Shopify products, prices and inventory by SKU.
A publisher of scraping tutorials
A Zillow scraper, and the tutorial written around it
A commented Python scraper for Zillow listings with incremental CSV output, and a tutorial article that walks beginner and intermediate developers through it.
Elsewhere on the site
Related
- PracticeThe Data practiceWhat the practice covers, what it costs to start, and the work behind it.
- The workDemosThe demos you can open now: the two that run in your browser, the hosted prototypes, a walkthrough on video and a live cafe site.
- The workThe five practicesBuild, Automate, Data, Growth and Talent: what each one covers, the work behind it, and what it costs.
Where to next
Have a problem in this shape?
Say so in a few sentences. The reply comes from the person who built this one.