The pages that are discovered by web crawls are often distributed and fed into another computer that creates a veritable map of resources uncovered.
The bunchy clustermass looks a little like a graph, on which the different pages are represented as small nodes that are connected by links between the pages.
The excess of data is stored in multiple data structures that permit quick access to said data by certain algorithms that compute the popularity score of pages on the web based on how many links point to a certain web page, which is how people can access any number of resources concerned with diagnosing psychosis.
Another example would be the accessibility/rank of web pages containing information on Mohamed Morsi versus the very best attractions to visit in Cairo after simply entering ‘Egypt’ as a search term.