1,082,877 Pages
Welcome! Enter your question below. Please use words like "Who, What, Where, When, Why, How, etc..." in your question. Nothing to ask? Click here for a random, un-answered question.

A crawler (also called spider) is a computer program running on a machine connected to a network (i.e. the internet) which "crawls" through the content of the network. It is commonly used by search engines to build up a search index which affords fast search results.

Ad blocker interference detected!

Wikia is a free-to-use site that makes money from advertising. We have a modified experience for viewers using ad blockers

Wikia is not accessible if you’ve made further modifications. Remove the custom ad blocker rule(s) and the page will load as expected.