The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
- Top ranked pages (up to a max of 100) from every linked-to domain using the Wide00012 inter-domain navigational link graph
-- a ranking of all URLs that have more than one incoming inter-domain link (rank was determined by number of incoming links using Wide00012 inter domain links)
-- up to a maximum of 100 most highly ranked URLs per domain
The seed list contains a total of 431,055,452 URLs The seed list was further filtered to exclude known porn, and link farm, domains The modified seed list contains a total of 428M URLs
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20160622023005/https://en.wikipedia.org/wiki/Planetary_Science_Archive
The Planetary Science Archive is the central repository for all scientific and engineering data returned by the European Space Agency's Solar system missions: currently Giotto, Huygens, Mars Express, Rosetta, SMART-1, and Venus Express, as well as several ground-based cometary observations. It uses NASA's Planetary Data System standards as a baseline for the formatting and structure of all data contained within the archive. All of the data sets are peer reviewed and undergo an additional internal validation procedure.
