Welcome! Enter your question below. Please use words like "Who, What, Where, When, Why, How, etc..." in your question. Nothing to ask? Click here for a random, un-answered question.

What is a crawler?

1,020,847questions on
Add New Page
Add New Page Talk0

A crawler (also called spider) is a computer program running on a machine connected to a network (i.e. the internet) which "crawls" through the content of the network. It is commonly used by search engines to build up a search index which affords fast search results.

Also on Fandom

Random Wiki