Free Builder Kit — illustrated PDF + reference codebase

Why is the crawl token rate-limited, and what happens if my AI worker hits the limit?

The crawl token is rate-limited to keep it available to everyone and to stop it from turning into a bulk scraper. I don't have the exact request cap published yet. When the limit is known, it will be on the site with the token.

If your AI worker hits the limit, the fetch returns an error and the worker stops pulling that chapter or module spec. Nothing is lost. You can wait for the window to reset, or have the worker retry with backoff. The 206-page PDF is free and has the same content, so you can download it and let your worker read from that copy instead.

The kit is free. The AI crawl token is free too. What costs you is time: a stalled worker is a stalled build. Don't let a rate limit idle your evening.

Want this kind of write-up in your inbox weekly?
One specific idea, build, or number per week. Plus the free PDF AI and the White-Collar Worker the moment you subscribe.

If the token keeps failing, email me and I'll look at it.

Mouldi

Keep going — one signal-dense email a week.
Drop your email. The free PDF AI and the White-Collar Worker lands within minutes. Unsubscribe anytime.

Leave a Reply

Your email address will not be published. Required fields are marked *