GeordyBot

GeordyBot, Geordy's crawler.

What it fetches, how often, and how to allow it or block it.

GeordyBot: what Geordy's crawler fetches, and how to allow or block it | Geordy