You can create a custom robots.txt file for your blog or website in just a few clicks.
Generate sitemap for your blogger (blogspot) blog
The robots.txt file is used by search engines to know which parts of your site they should crawl and index, and which parts they shouldn't.
Custom robots.txt tools
User-agent: Googlebot
Disallow:
User-agent: Googlebot-image
Allow: /search
Allow: /
Sitemap: https://mywebsite.com/sitemap.xml
Sitemap: https://mywebsite.com/sitemap-pages.xml
How to Generate
1. Simple copy the the above code
2. Replace https://mywebsite.com/ with your site URL
Congrats your have generated Custom robots.txt .
Add Custom Robots.txt File on Blogger/Blogspot
1. login to your blogger dashboard (blogger account)
2. Navigate to Setting
3. Open Settings > Search Preferences > Crawlers and indexing > Custom robots.txt > Edit > Yes.
4. Paste the Above code you have edited
You May Like:Blogger Templates 2121: New Top Best Free Template
The robots.txt file makes it easy to control the way search engines and other web traffic interact with your website. By using a custom robots.txt generator, you can quickly create an optimal file that will help you achieve your goals without any hassle. Follow our social media profiles today to keep up-to-date on all of our latest developments and promotions!
0 Comments