Feat robots.txt (#237)

* add robots.txt

* removes robots.txt manual steps
This commit is contained in:
Markos Gogoulos
2021-07-02 17:19:02 +03:00
committed by GitHub
parent 1f0cc4ff87
commit 060bb45725
4 changed files with 14 additions and 65 deletions

2
templates/robots.txt Normal file
View File

@@ -0,0 +1,2 @@
User-Agent: *
Allow: /