A spider is a special software that supports a search engine by helping it see the contents contained in a website which the search engine is not able to do so. This invisible content includes a lot of variety. A spider also helps webmasters by not only generating Meta tags regarding description but also the keywords. Entering the main page once ensure that the program does the rest of the task itself. This invisible content for the search engine includes a lot of different items like flash content to java script and others. If the modern World Wide Web wouldn�t have any spider the search engines would not have achieved the abilities they currently have.