This site is pretend to be a [Web Crawler](https://en.wikipedia.org/wiki/Web_crawler).
You add challnge site's URL **/robots.txt** you can see flag text.

Original writeup (https://312k.github.io/312k-blog/post/post6/brixelctf-312k-eng/#robotopia).