CEO @ Mojeek No-tracking indepdendent search engine
- 0 Posts
- 1 Comment
Joined 5 months ago
Cake day: August 19th, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
CEO @ Mojeek No-tracking indepdendent search engine
You should put these entries into your robots.txt file.
To block the Google search crawler use for all of your site:
User-agent: Googlebot
Disallow: /
To block the Google AI crawler use:
User-agent: Google-Advanced
Disallow: /