About our crawler

LandUseWire tracks land-use items (rezones, permits, general plan amendments and similar decisions) on the public meeting agendas of cities and counties, so residents and local businesses can follow them in one place.

Our crawler identifies itself with the user agent LandUseWire/1.0 (+https://landusewire.com/about-our-crawler; hello@landusewire.com).

What it does

• Reads published meeting calendars, agendas, minutes and staff reports. Nothing else.
• Checks each agency a few times a day, never submits forms, and never logs in.
• Makes one request at a time to each host, at least two seconds apart, and backs off when a server is busy.
• Uses conditional requests and never re-downloads a document it already has.
• Honors robots.txt, and doesn't try to get past access controls or browser checks.

Contact

If our crawler is causing a problem, or you'd prefer we use a feed or API instead, email hello@landusewire.com and we'll adjust promptly.