Middle East : +961 3 041 941    |      USA : Telephone (713) 239 - 9322    |       Home
Middle East : +961 3 041 941

| USA : Telephone (713) 239 - 9322

Get To Know Us Better! We help you to bring the world closer


Other FAQ Items in This Category

What is? and Definitions

ID #1084

What is a robot.txt file?

What is a robot.txt file?

If any company owning a website does not want its pages or directories to be indexed by a search engine it can add a file named robot.txt to its root directory. This can only be effective if the search engine robots follow the usual protocol of searching a website in a specified normal routine. Deviations may be there due to the development of software technology and the searching abilities of the search engine robots. With the help of this file robot.txt the robots following the usual protocol can be either allowed or disallowed to index the file on their respective search engines. Here is an example. For excluding all robots the commands used will be; Disallow:/cgi-bin/ along with Disallow:/misc/sitestats.

Related entries:

Last update: 2008-02-02 11:53
Author: AMB
Revision: 1.0

Digg it! Print this record Send to a friend Show this as PDF file
Propose a translation for Propose a translation for
Please rate this entry:

Average rating: 0 out of 5 (0 Votes )

completely useless 1 2 3 4 5 most valuable

You can comment on this entry

Other FAQ Items in This Category


Tetapi, butuh dikenal kalau julukan“ basket” awal mulanya cumalah gelar yang diucapkan salah seseorang muridnya pada dikala mempermainkan perlombaan. Alhasil, game ini kesimpulannya diketahui agen sbobet dengan julukan basket semacam saat ini ini. Dengan metode game bola basket yang diciptakannya, mulailah bola basket ini dipertandingkan. Bola basket awal kali dipertandingkan pada 20 Januari 1892 di tempat kegiatan James Naismith.

Client & Users Login

Search Our Website