CEO @ Mojeek No-tracking indepdendent search engine
- 0 Posts
- 1 Comment
Joined 8 months ago
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
CEO @ Mojeek No-tracking indepdendent search engine
You should put these entries into your robots.txt file.
To block the Google search crawler use for all of your site:
User-agent: Googlebot
Disallow: /
To block the Google AI crawler use:
User-agent: Google-Advanced
Disallow: /