Hello Everyone , Today We Will Be Learning How To Setup Robots.txt For Your Blog , Robot Has A Good Side And A Bad Side Too Cause If You Have Configured It Properly Then It Will Crawl To Your Blog As Fast As It Can Depending To The Crawl Rate And If You Configured It Incorrectly then it can result
in your blog being ignored by search engines. So In This Post We Will
Be Learning How To Configure Or Setup The Robot.txt Properly For Your
Blog .
Improving Site Visibility And Ranking
What Are Robots.txt ?
Before We Start Our Article Lets See What Are Robots Used For And What Is It ? Robots are some specific instructions
which allow or disallow search engines from crawling a particular page
or post on your site whereas META tags only inform the search engines
that this that is the topic, keywords, etc. of a website.
How To Setup The Robot.txt In Your Blog ?
To Setup The Robot.txt In Your Blog Follow Me , This Is Very Easy Task For You To Do :)
1. Go to Blogger >> Settings >> Search Preferences
2. Now Click On Edit In Custom robots.txt
3. Now In The Box Paste The Following Set Of Codes
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://www.thedigitcrunch.com/feeds/posts/default?orderby=UPDATED
4. Change The Domain Of Us To Your Specific Domain And Save The Rest.
5. Now Click On Edit In Custom robots header tags
6. Follow The Image Given Below And Fill The Details As It Is .
7. Save It And Done !
All Set And Now You Have Completely Optimized And Configured Robot.txt For Your blog , After Few Days See The Changes Of Your Blog Towards The Search Engines Like Google , Bing , Yahoo Etc . But Warning! Use with caution. Incorrect use of these features can result in your blog being ignored by search engines. So That's The End Of This Article In the Next Article We Will Be Sharing On How To Setup Meta Tag Of Your Blog . Peace , Happy Blogging :)
No comments:
Post a Comment