Remove public from URL
User # Start: Block all search engine bots from accessing the site – (Do not Edit) RewriteEngine On RewriteCond %{HTTP_USER_AGENT} (googlebot|bingbot|baiduspider|yandex|duckduckbot) [NC] RewriteRule .* – [F,L] Header set X-Robots-Tag "noindex, nofollow" # New rule to override robots.txt RewriteEngine On RewriteRule ^robots.txt$ robots.txt [L] # End: Block all search engine bots from accessing the site – […]