Client projectData pipelinesReal estate and public records

Property data scraping: every Yellowstone Club lot in one CSV, in three days

A real-estate researcher working Montana property records. November 2023, 1 month.

from the approved sample to the full dataset
3 days
One parcel lookup at a time to Every lot in one CSVNovember 2023
commits to the extractor, started the day the dataset shipped
37

Property data scraping at a glance

Challenge
A real-estate researcher needed a whole community's property records as one dataset, from a portal built for one lookup at a time.
Solution
Extraction from the Montana cadastral API and its parcel pages into one CSV, with a notebook measuring how the run behaved.
Result
Every house and lot in the club arrived in one file three days after the sample was approved, not weeks of manual lookups.

The property data scraping challenge

Property records sit in a state portal built for one lookup at a time. The researcher needed the whole community as a dataset, not a page per parcel, and needed it inside a fortnight.

What went into the property data scraping

Web scrapingData pipeline

  1. Extraction against the Montana cadastral API, with the HTML parcel pages parsed for the fields the API does not return

  2. Every house and lot in the Yellowstone Club community, written to a structured CSV

  3. A sample approved by the researcher on 1 November, the full dataset delivered on 4 November

More of what we built1
  1. A Jupyter notebook measuring how the extraction behaved, so the run could be tuned rather than guessed at

Property data scraping results

The researcher had the whole community in one file three days after approving the sample.

Your project, next

Have a problem in this shape?

Say so in a few sentences. The free plan comes from the person who built this one.

We usually reply within 2 business days with a free plan for what to do first. No call needed.