The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
- Top ranked pages (up to a max of 100) from every linked-to domain using the Wide00012 inter-domain navigational link graph
-- a ranking of all URLs that have more than one incoming inter-domain link (rank was determined by number of incoming links using Wide00012 inter domain links)
-- up to a maximum of 100 most highly ranked URLs per domain
The seed list contains a total of 431,055,452 URLs The seed list was further filtered to exclude known porn, and link farm, domains The modified seed list contains a total of 428M URLs
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20160411051017/https://en.wikipedia.org/wiki/Portal:Contents/Indices
This is an index of subjects on Wikipedia. Each entry below is an alphabetical index of its respective subject area. For structured lists on these subjects, see Outline of knowledge. For an alphabetical index of all articles on Wikipedia, see A-Z Index.
^Kazakhstan is sometimes considered a transcontinental country in Central Asia and Eastern Europe; population and area figures are for Asian portion only.
^Armenia is sometimes considered a transcontinental country: physiographically in Western Asia, it has historical and sociopolitical connections with Europe.
^Azerbaijan is often considered a transcontinental country in Western Asia and Eastern Europe; population and area figures are for Asian portion only. Figures include Nakhchivan, an autonomous exclave of Azerbaijan bordered by Armenia, Iran, and Turkey.
^ The island of Cyprus is sometimes considered a transcontinental territory: in the Eastern Basin of Mediterranean Sea south of Turkey, it has historical and socio-political connections with Europe. However, the U.N. considers Cyprus to be in Western Asia, while the C.I.A. considers it to be in the Middle East.
^Georgia is often considered a transcontinental country in Western Asia and Eastern Europe; population and area figures are for the Asian portion only.
^Turkey is generally considered a transcontinental country in Western Asia and Southern Europe; population and area figures are for Asian portion only, excluding all of Istanbul.
^The use and scope of this term varies. The UN designation for this subregion is "Australia and New Zealand."