Before you scrape: six questions.
There is no universal "yes" or "no". The answer depends on the site's terms, robots rules, the data type, your jurisdiction and your purpose. This checklist helps you ask the right questions and points to the official text. It is not legal advice.
The six checks
- Is the data public? If it needs a login, a paywall or a bypass, stop. Scraping private content is a different risk category.
- Does the site allow automated access? Read the terms and the robots file. Robots is not the same as a legal permission.
- Is it personal data? Profile pages, reviews with names and contact details can trigger GDPR, CCPA or other privacy rules. Business contact data is not automatically exempt.
- Is the volume polite? Rate limits exist for a reason. Cache, batch and back off. A 429 or 503 is a signal to slow down, not a puzzle to defeat.
- Do you need a licence? Property listings, search results, reviews and social posts can carry broker, platform or copyright restrictions.
- Can you explain the purpose? A documented lawful basis and retention policy matter more than a clever workaround.
What this site does
Scraper Finder reports the public API status, the platform terms link and the date the facts were checked. It does not provide legal advice or help bypass access controls.