Middle East : Telephone +961 3041 941    |    India : Telephone +9188 9189 5272    |      USA : Telephone (713) 239 - 9322    |       Home
Middle East : Telephone+961 3041 941

| India : Telephone +9188 9189 5272

| USA : Telephone (713) 239 - 9322

| iBaroody   LIVE CHAT Online
FAQ
Get To Know Us Better! We help you to bring the world closer

FAQ MENU

Other FAQ Items in This Category

What is? and Definitions

ID #1084

What is a robot.txt file?

What is a robot.txt file?


If any company owning a website does not want its pages or directories to be indexed by a search engine it can add a file named robot.txt to its root directory. This can only be effective if the search engine robots follow the usual protocol of searching a website in a specified normal routine. Deviations may be there due to the development of software technology and the searching abilities of the search engine robots. With the help of this file robot.txt the robots following the usual protocol can be either allowed or disallowed to index the file on their respective search engines. Here is an example. For excluding all robots the commands used will be; Disallow:/cgi-bin/ along with Disallow:/misc/sitestats.

Related entries:

Last update: 2008-02-02 11:53
Author: AMB
Revision: 1.0

Digg it! Print this record Send to a friend Show this as PDF file
Propose a translation for Propose a translation for
Please rate this entry:

Average rating: 0 out of 5 (0 Votes )

completely useless 1 2 3 4 5 most valuable

You can comment on this entry

Other FAQ Items in This Category