How do Web Crawlers Work?

Answer

Web crawlers work by collecting data from websites and their links. The web crawlers then return to the home computer and the search engine will sort the information that the web crawler has found.
1 Additional Answer
Web crawlers basically do nothing all day and night except crawl around every website they can get a hold of, tunneling through all their links and such, and gather every little tidbit of information available that is then returned home to the main database, where it is stored for use when a search is made. You can find out more information here: www.webopedia.com
Q&A Related to "How do Web Crawlers Work?"
A web crawler is an automated software search routine typically used by search engines to seek out and index web pages in order to categorize the content for effective web searches.
http://answers.ask.com/Computers/Internet/what_is_...
That's slang for Spiderman
http://wiki.answers.com/Q/What_is_web-crawler
I've tried 80legs. It's basically a hosted massively multiuser version of Nutch-- each user has a share of their crawlers. It seemed pretty good to me, but I was more comfortable
http://www.quora.com/What-are-some-deep-web-crawle...
Put the semi sweet chocolate chips in a microwave safe bowl and heat them for 1 to 3 minutes, until the chocolate begins to melt. Stir in the vegetable oil and blend well. Use your
http://www.ehow.com/how_2294145.html
Explore this Topic
A crawler crane refers to a track based vehicle, which has cranes attached to it. It is made stable by steel tracks, and it can lift more weight. It is enormous ...
1. Use a measuring tape and measure the distance from the center of rotation of the crane to the object being picked. 2. Lower the boom of the crane over the object ...
1. Use a measuring tape and measure the distance from the center of rotation of the crane to the object being picked. 2. Lower the boom of the crane over the object ...
About -  Privacy -  AskEraser  -  Careers -  Ask Blog -  Mobile -  Help -  Feedback © 2014 Ask.com