For website owners
CampervanAtlasBot
CampervanAtlasBot is Campervan Atlas's web crawler. It visits the official website of a campsite or motorhome aire that is on our map, picks out a few facts, and links visitors back to that website. It never copies your text or photos and never touches your booking system.
How to recognise it
Every request sends this User-Agent:
CampervanAtlasBot/1.0 (+https://www.campervanatlas.com/bot)It runs on Cloudflare Workers, so requests come from Cloudflare's network.
Which pages it reads
- Only the website listed for the place in OpenStreetMap, and only that site's own domain.
- Your
robots.txtfirst. Then the website's page, plus at most 3 more pages on the same site whose link or address is about prices, tariffs, rates, facilities or the site itself. - It never fills in forms, picks dates, runs JavaScript, logs in, or opens booking pages. It never follows links to booking platforms or directories such as Pitchup, Campsited, eviivo, freetobook, Booking.com, Airbnb or Hipcamp.
- It reads HTML pages only, up to 1.5 MB each, and gives up after 10 seconds.
How often
- At most one request to your site every 10 seconds (longer if your
robots.txtsets aCrawl-delay), and at most 6 sites at a time across the whole crawler. - Each place is checked again at most every 90 days. A visit is usually 3 to 5 requests.
- Your
robots.txtis cached for 7 days. If it can't be fetched because of a server error, we don't crawl and try again the next day.
What it keeps: facts only
- Nightly prices "from", with the currency and what they are for (a pitch, a tent, a motorhome, hook-up). We only show a price when the page makes clear it is a price per night for camping.
- The opening season.
- Facilities, such as electric hook-up, showers, toilets, dogs, Wi-Fi, a shop, laundry, waste disposal, drinking water, a pool, a playground and accessible facilities.
- The phone number, the address of your booking page (as a link for visitors to click), a maximum vehicle length, and whether the site is adults-only or welcomes families.
- The same facts from structured data (JSON-LD) on your pages, which we prefer when it is there.
We don't keep or publish your descriptions, other text, meta descriptions, reviews or photos. Pages are read in memory to find the facts and then thrown away. We never collect email addresses. For checking and correcting our own extraction, we keep a short note (up to 200 characters) of where each price was found. It is never shown on the site.
How the facts appear
The place's page shows a box headed "From the campsite's website" with a short sentence we write from the facts, for example "Pitches from £25 a night; open March–October; dogs welcome." Each fact names your domain and the month we checked it, and links to the page it came from. Prices always say "check live prices on their website", and the main button is "Book or check prices on {your domain}", which goes to your site.
How to stop it
Either of these works, and you don't need to do both:
- Add this to your
robots.txt. We obey rules forCampervanAtlasBot, or your rules for all crawlers (User-agent: *) when you have none for us:
We read it before every visit, so the next visit (within 90 days) stops there and deletes what we stored from your site. For an immediate stop, use the form below. AUser-agent: CampervanAtlasBot Disallow: /noindexornoarchiverobots meta tag (orX-Robots-Tagheader) on a page also means we don't use that page. - Or opt out on our contact form. Choose "Stop CampervanAtlasBot reading my website" and enter your website's address. The domain goes on our block list straight away, and the facts we stored from it are deleted at once.
Something wrong or out of date? Tell us through the contact form, or claim your listing to add your own prices, photos and booking link.