erik/mastodon
1
0
Fork 0
mirror of https://github.com/mastodon/mastodon.git synced 2024-08-20 21:08:15 -07:00
Code Issues Projects Releases Wiki Activity

Update robots.txt

Browse source
This commit is contained in:
Shlee 2024-08-01 19:16:46 +09:30 committed by GitHub
parent 88ec894149
commit 2de2180af7
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
public/robots.txt
View file

@ -95,4 +95,5 @@ User-agent: VelenPublicWebCrawler
# AI Search Crawler
User-agent: YouBot
Disallow: /