WARC file for University at Albany - SUNY - Home Page, 2015 July 21
- Acquisition information:
-
crawl: 165504
This item had no crawl rules.
Crawl Timesstart_date: 2015-07-21T15:23:16Z
original_start_date: 2015-07-21T15:23:16Z
last_resumption: None
processing_end_date: 2015-07-22T21:01:20Z
end_date: 2015-07-21T15:44:58Z
elapsed_ms: 1261256
Crawl Typestype: DAILY
recurrence_type: DAILY
pdfs_only: False
test: False
Crawl Limitstime_limit: 82800
document_limit: 1000
byte_limit: None
crawl_stop_requested: None
Crawl Resultsstatus: FINISHED_DOCUMENT_LIMIT
discovered_count: 5372
novel_count: 373
duplicate_count: 653
resumption_count: 0
queued_count: 4346
downloaded_count: 1026
download_failures: 0
warc_revisit_count: 653
warc_url_count: 1007
total_data_in_kbs: 175099
duplicate_bytes: 55422592
warc_compressed_bytes: 110576392
Crawl Technical Detailsdoc_rate: 0.81
kb_rate: 138.0
- Physical / technical requirements:
- Researchers interested in data analysis with web archives may request a WARC file. WARC files are very large and difficult to work with. Your request may take time to process, and we may be unable to deliver your request remotely. Please consult an archivist if you are interested in advanced research with web archives.
Using these materials
- Access:
- The archives are open to the public and anyone is welcome to visit and view the collections.
- Collection restrictions:
- Access to this collection is unrestricted.
- Collection terms of access:
- The University Archives are eager to hear from any copyright owners who are not properly identified so that appropriate information may be provided in the future.