https://sangkrit.net/easiest-way-of-generating-a-robot-txt-file-for-your-website/