What are Spiders, Crawlers and Robots?

Spiders, Crawlers and Robots are interchangeable terms. They are automated programs sent out by search engines to crawl the world wide web. Their job is to find websites, copy text of web pages and index those web pages in the search engine’s database. They can not read images; so, it is wise not to turn text on a website into an image.

Back to SEM FAQ