Re: RobotRules fails on user-agents with spaces

Nigel Horne writes:
> Perhaps it would help if WWW::RobotRules were to warn/die when setting
> an agent with a space in? An excellent message would be "RFC2616 forbids
> spaces in an agent's names".

Impossible, because the whole user agent string *is* allowed to have
spaces in it. It's just that the component before the first space is
supposed to be the browser identifier, and the subsequent components
are supposed to represent more specific features or capabilities of
the browser.

Please read the RFC for the details.

jik