Search engines utilize indexing software agents often called robots or spiders. These agents are programmed to constantly “crawl” the Web in search of new or updated pages. They will essentially go from URL to URL until they have visited every Web site on the Internet. Search engines read a web site’s ‘meta tags’ and content in order to determine their ranking.
What is the difference between search engines and directories?
Search Engine Market Shares
Relationship of Major Search Engines (Google, Yahoo, MSN, …)
