A web census is possible
LE3 .A278 2006
2006
Benoit, Darcy
Acadia University
Bachelor of Computer Science
Honours
Computer Science
How large is the World Wide Web? In the past several years there have been numerous approaches to estimate its size using different techniques. The technology available at that time only allowed them to perform estimates, so a measure of its exact size was something that could not be done or people did not wish to do. This thesis shows that it is now possible to get an exact measurement of the Web by conducting the first ever census of the internet. We will discuss how we have developed a system capable of completing this task, the bottlenecks of such a system, and problems that current software gives us. We will also present some preliminary results that we have acquired through the testing of this system and evidence that a census can be completed in a reasonable amount of time.
The author retains copyright in this thesis. Any substantial copying or any other actions that exceed fair dealing or other exceptions in the Copyright Act require the permission of the author.
https://scholar.acadiau.ca/islandora/object/theses:490