WARC file for Parks & Trails New York Homepage, 2016 August 26
- Acquisition information:
-
crawl: 232507
Crawl RulesLimit host facebook.com to 100 documents
Limit host twimg.com to 100 documents
Limit host twitter.com to 100 documents
Crawl Timesstart_date: 2016-08-25T19:17:36Z
original_start_date: 2016-08-25T19:17:36Z
last_resumption: None
processing_end_date: 2016-09-01T23:43:28Z
end_date: 2016-09-01T01:45:24Z
elapsed_ms: 179206750
Crawl Typestype: TEST_SAVED
recurrence_type: NONE
pdfs_only: False
test: True
Crawl Limitstime_limit: 259200
document_limit: None
byte_limit: None
crawl_stop_requested: None
Crawl Resultsstatus: FINISHED
discovered_count: 17198
novel_count: 4431
duplicate_count: 12767
resumption_count: 0
queued_count: 0
downloaded_count: 17198
download_failures: 61
warc_revisit_count: 12767
warc_url_count: 17187
total_data_in_kbs: 786105
duplicate_bytes: 403714028
warc_compressed_bytes: 308069093
Crawl Technical Detailsdoc_rate: 0.1
kb_rate: 4.0
- Physical / technical requirements:
- Researchers interested in data analysis with web archives may request a WARC file. WARC files are very large and difficult to work with. Your request may take time to process, and we may be unable to deliver your request remotely. Please consult an archivist if you are interested in advanced research with web archives.
Using these materials
- Access:
- The archives are open to the public and anyone is welcome to visit and view the collections.
- Collection restrictions:
- Access to this collection is restricted because it is unprocessed. Portions of the collection may contain recent administrative records and/or personally identifiable information. Please contact an archivist for more information.
- Collection terms of access:
- The University Archives are eager to hear from any copyright owners who are not properly identified so that appropriate information may be provided in the future.