Follow for free plugins, new theme releases and theme news
Plugin Description
A robots.txt file is a file at the root of your site that indicates those parts of your site you dont want accessed by search engine crawlers. The file uses the Robots Exclusion Standard, which is a protocol with a small set of commands that can be used to indicate access to your site by section and by specific kinds of web crawlers (such as mobile crawlers vs desktop crawlers).
You only need a robots.txt file if your site includes content that you don’t want Google or other search engines to index.
Why Robots.txt File Important?
Do you need a robots.txt file and what is the importance of it? Your sites robots.txt file play an important role in your sites overall SEO performance. It basically allows you to communicate with search engines and let them know which parts of your site they should index.
Really Need Robots.txt File?
Absence of a robots.txt file will not stop search engines from crawling and indexing your website. However, it is highly recommended that you create one. If you want to submit your site’s XML sitemap to search engines, then this is where search engines will look for your XML sitemap unless you have specified it in Google Webmaster Tools.
How to Use Robots.txt File?
Robots Txt File plugin allows you to create or edit the content of your robots.txt file. It’s really simple to use. Just install the plugin by using dashboard or upload “robots-txt-file” folder to your plugins directory. Now activate it from WordPress admin panel and go to Dashboard => Settings => Reading. You’ll find a box with title Robots.txt File. You can write and edit the default robots.txt content in the box. And click the “Save Changes” button to save your edited file. All done!
If you have any questions then ask here.
Screenshots
-
Admin option
