Glossary Entry



Term:  Spider     Acronym: -    
Definition: Also known by many other names like Search Agent, Robot, Bot, WebCrawler, and many others. This is an automated program that retrieves web pages so that the information can be used by a search engine.

This information is parsed by a search engine and stored in a huge database, so that the search engine knows how many times a word is referenced on a webpage. This information is used to determine which pages should show in the serps when a search is made.




Related Links
SERPS
Anatomy of a spider.


 

 

 

Return to Glossary