Robots.txt For Some CMS

Robots.txt is a text file that we place on our website to inform the search robots not to visit or index certain pages on our site.

There are usually placed in the robots.txt main directory because when search engines do Crawling on our site. For example http://facebook.com/robots.txt

In this tutorial, I will give some list of robots.txt which is used on the famous CMS such as Joomla, Wordpress, Magento, and Drupal.

Wordpress Robots.txt

Magento Robots.txt

Drupal Robots.txt

Joomla Robots.txt

Hopefully useful
Source : http://cruzenaldo.com/robot-txt-untuk-beberapa-cms/

0 komentar:

Post a Comment

Just Comment. Not Spam!

 

Followers

There was an error in this gadget

Free Download Scripts and Source Code | © 2009 | edited by asal-klik