Crawler directory

Which AI crawlers and agents we recognise, and how Seiton treats them.

Coming with the public docs.

Questions in the meantime: hello@seiton.app