Speroll

Speroll-AdsTxt-Crawler

A compliance crawler for the IAB Tech Lab ads.txt, app-ads.txt and sellers.json standards.

What it does

Speroll is an advertising technology company and an authorised reseller of advertising inventory. This crawler retrieves the small text files that site and app owners publish at fixed public paths for the express purpose of being read by advertising platforms:

https://example.com/ads.txt
https://example.com/app-ads.txt
https://example.com/sellers.json

These files exist so that companies can verify which partners are authorised to sell a publisher's advertising inventory. We read them to confirm where Speroll is listed as an authorised reseller and to keep an accurate view of the advertising supply chain. This is a routine function performed by every major advertising platform.

What it does not do

It does not scan ports or enumerate services.
It does not attempt authentication or submit forms.
It does not transmit any payload — it issues ordinary GET requests and reads the response.
It does not collect personal data.

How to identify it

Every request we make carries this User-Agent, on every path, with no exceptions:

Speroll-AdsTxt-Crawler/1.0 (+https://crawler.speroll.com/crawler)

Requests originate from 15.204.142.87.

How to block it

1. robots.txt — we honour it. To exclude us completely, add:

User-agent: Speroll-AdsTxt-Crawler
Disallow: /

2. Email us — write to adops@speroll.com with the domains or IP ranges you want excluded and we will add them to our exclusion list and confirm back. No justification needed.

We also honour Retry-After, and a 403, 429 or 503 response is treated as final for that host — we do not retry around a block.

Crawl behaviour

Only the file paths listed above are requested — nothing else on a site.
Requests to any single host are rate limited.
Responses larger than 5 MB are abandoned mid-transfer.