For site owners

OncaBot

OncaBot is Onça's research crawler. If it fetched a page on your site and you want to know why — or you'd rather it didn't — this page has everything, including how to turn it off.

What it does

When an Onça customer researches a search term, we look at the handful of pages already ranking for it and read what they cover. That's it: a small number of public pages, the same ones anyone gets from a search results page.

  • At most five pages per search term. We don't spider a site, follow links, or crawl beyond the pages that already rank.
  • We cache for 72 hours. Once we've read a page we don't come back for it — repeated visits are exactly the thing worth avoiding.
  • Public HTML only. No logins, no forms, no paywalled content, no personal data.

How to identify it

OncaBot sends this user agent:

Mozilla/5.0 (compatible; OncaBot/1.0; +https://oncahq.com/bot)

How to block it

We read and obey robots.txt before every fetch, and we check it per site rather than per page. To keep OncaBot out entirely, add this to yours:

User-agent: OncaBot
Disallow: /

To allow it everywhere but one place, disallow just that path — we honour Allow and Disallow the standard way, with the most specific rule winning. If we can't read your robots.txt at all, we treat that as a no and skip the site.

Something wrong?

If OncaBot behaved in a way this page doesn't describe — too many requests, a page you'd disallowed, anything — tell us and we'll fix it. hello@oncahq.com

Back to Onça