Skip to content

Commit a4c0178

Browse files
author
meowabyte
committed
Added robots.txt
1 parent 16a19d2 commit a4c0178

File tree

1 file changed

+14
-0
lines changed

1 file changed

+14
-0
lines changed

‎public/robots.txt

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
User-agent: *
2+
Disallow: /
3+
4+
User-agent: Googlebot
5+
Disallow:
6+
7+
User-agent: Bingbot
8+
Disallow:
9+
10+
User-agent: DuckDuckBot
11+
Disallow:
12+
13+
User-agent: Screaming Frog SEO Spider
14+
Disallow: *

0 commit comments

Comments
 (0)