solidity/docs/robots.txt.template
cxxboy bd1fc0e88d script to automate updates to robots.txt #11199
Rewritten the script to work with a 'robots.txt' template file and we
generate the 'robots.txt' from the template when we execute the script.
It's found to be a better alternative to editing the 'robots.txt' file
in-place.
2021-04-27 17:54:55 -04:00

15 lines
406 B
Plaintext

User-Agent: *
Sitemap: http://docs.soliditylang.org/sitemap.xml
Allow: /en/latest/
Allow: /en/v0.7.6/
Allow: /en/v{{ LATEST_VERSION }}/
Allow: /_/downloads/en/latest/
Allow: /_/downloads/en/0.7.6/
Allow: /_/downloads/en/{{ LATEST_VERSION }}/
# Prevent documentation for the development branches and older Solidity
# versions from showing up in search results.
Disallow: /en/*
Disallow: /_/downloads/en/*