Commit Graph

2 Commits

Author SHA1 Message Date
Alex Beregszaszi
37db29e9f1 Set preferred host in robots.txt 2021-06-28 21:26:00 +01:00
cxxboy
bd1fc0e88d script to automate updates to robots.txt #11199
Rewritten the script to work with a 'robots.txt' template file and we
generate the 'robots.txt' from the template when we execute the script.
It's found to be a better alternative to editing the 'robots.txt' file
in-place.
2021-04-27 17:54:55 -04:00