Blogs are not indexing in Blogspot, what should I do? This question is going viral, I mean people are asking help from Blogger Team! Questioners are too many but a proper answer is still missing!
Relax, I’m here to assist you! We will get rid of Crawl Error Server Error (5xx) - Failed: Server error (5xx). What would the reason for the error in the message “Failed: Server error (5xx)”? Well, due to minor mistakes in blogger finds you the error message “Failed: Server error (5xx)”
Don’t worry, you just have to perform few settings in your Blogspot Blog to fix the indexing issue: Crawl Error Server Error (5xx) - Failed: Server error (5xx)
How to fix Server Error 5xx in Blogger?
I will guide you to fix the indexing error for Blogspot Website. Ok, let’s begin!
Step 1. Firstly, I want you to login into your blogger dashboard and select a particular blog that is failing to index and finds you the error message: “Failed: Server error (5xx)”
Step 2. Well, now click on the Settings option and scroll down to the Crawlers and indexing section!
Step 3. Kindly, enable the option “Enable custom robots.txt”. Have a look at the above image for a better understanding!
Step 4. The next, step is to click on the “Custom robots.txt” option and enter the below-stated code!
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: https://xyz.blogspot.com/sitemap.xml
NOTE
Make sure to change the URL address
https://xyz.blogspot.com with your website URL and click on Save
Button.
Here's what that the above code means:
- In the first line, gives the permission of all the bots of all the search engines to crawl the blog. Asterisk (*) means for all the robots (GoogleBot, BingBot etc).
- The second line, tells all robots to disallow nothing and crawl the whole website.
- The third line, tells all other user agents to crawl the entire site.
- The fourth line, disallows the bot to crawl the "/search" for example "https://example.com/search" will neither be crawled by the bots nor indexed in the search engines.
- The fifth line, helps in the indexing of the homepage.
- The sixth line, tells the bots that the site's sitemap is located at "https://xyz.blogspot.com/sitemap.xml".
Step 5. After proceeding with the above steps click on the Save Button.
Once you save the Custom robots.txt codes, you will find such interface which confirms that the blogger website has set proper Custom robots.txt
Well, you have completed half of the process to get rid of the problem Crawl Error Server Error (5xx) - Failed: Server error (5xx) from your Blogger Website.
Now, let's proceed with some other minor settings in blogger to fix the index error in Blogspot “Failed: Server error (5xx)”.
Step 6. Now, kindly click Enable custom robots header tags on your Blogger website! Have a look at the above image for a better understanding!
Step 7. The next step is to click on Home page tags and enable the options all and noodp. Once done, save it!
Step 8. Now, click on Archive and search page tags and enable the options noindex and noodp. Once done, save it!
Step 9. The final step to get rid of the Blogspot Indexing error is to click on Post and page tags and enable the options all and noodp. Once done, save it!
That’s it! You just have to perform the stated settings in your Blogspot Website to fix the indexing error “Crawl Error Server Error (5xx) - Failed: Server error (5xx)”
Conclusion
So friends, how did you guys like this post on How to fix Server Error 5xx in Blogger? Now you must have understood How to fix Server Error 5xx in Blogger.
Tell us how you felt about this article for How to fix Server Error 5xx in Blogger? by writing a comment so that we too have a chance to learn and improve something from your ideas.
