Welcome! Enter your question below. Please use words like "Who, What, Where, When, Why, How, etc..." in your question. Nothing to ask? Click here for a random, un-answered question.

What is a crawler?

1,038,885questions on
Add New Page
Talk0 Share

A crawler (also called spider) is a computer program running on a machine connected to a network (i.e. the internet) which "crawls" through the content of the network. It is commonly used by search engines to build up a search index which affords fast search results.

Ad blocker interference detected!

Wikia is a free-to-use site that makes money from advertising. We have a modified experience for viewers using ad blockers

Wikia is not accessible if you’ve made further modifications. Remove the custom ad blocker rule(s) and the page will load as expected.

Also on Fandom

Random Wiki