Crawlers aren’t LLMs; they can do arbitrary computations (whatever the target demands to access resources).

In response to your edit.

Yes, or countries could use their cctld, e.g. email@us or noreply@uk.

Or any tld owner could do the same with theirs, of course.

There’s nothing wrong with manually breaking a loop.