Stowage/browsertrix-crawler
2
0
Fork 0
mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-10-19 14:33:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
browsertrix-crawler/tests
History
Exact
Ilya Kreymer 089d901b9b
Always add warcinfo records to all WARCs (#556) 
Fixes #553 

Includes `warcinfo` records at the beginning of new WARCs, as well as
the combined WARC.
Makes the warcinfo record also WARC/1.1 to match the rest of the WARC
records.
2024-05-22 15:47:05 -07:00
..
custom-behaviors Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
fixtures Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
invalid-behaviors detect invalid custom behaviors on load: (#450) 2023-12-13 15:14:53 -05:00
.DS_Store tests text extraction (#30) 2021-03-01 16:00:23 -08:00
adblockrules.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
add-exclusion.test.js QA Crawl Support (Beta) (#469) 2024-03-22 17:32:42 -07:00
basic_crawl.test.js WARC filename prefix + rollover size + improved 'livestream' / truncated response support. (#440) 2023-12-07 23:02:55 -08:00
blockrules.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
collection_name.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
config_file.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
config_stdin.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
crawl_overwrite.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
custom-behavior.test.js detect invalid custom behaviors on load: (#450) 2023-12-13 15:14:53 -05:00
custom_driver.test.js Separate writing pages to pages.jsonl + extraPages.jsonl to use with new py-wacz (#535) 2024-04-11 13:55:52 -07:00
extra_hops_depth.test.js Separate writing pages to pages.jsonl + extraPages.jsonl to use with new py-wacz (#535) 2024-04-11 13:55:52 -07:00
file_stats.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
limit_reached.test.js Fix failOnFailedLimit and add tests (#580) 2024-05-21 16:35:43 -07:00
log_filtering.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
mult_url_crawl_with_favicon.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
pageinfo-records.test.js Bump version to 1.2.0 Beta + make draft release for each commit (#582) 2024-05-22 15:45:48 -07:00
pdf-crawl.test.js PDF loading status code fix (#571) 2024-05-14 15:26:06 -07:00
qa_compare.test.js QA Crawl Support (Beta) (#469) 2024-03-22 17:32:42 -07:00
redis_crawl_state.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
rollover-writer.test.js Fix for --rolloverSize for individual WARCs in 1.x (#542) 2024-04-15 13:43:08 -07:00
saved-state.test.js Separate writing pages to pages.jsonl + extraPages.jsonl to use with new py-wacz (#535) 2024-04-11 13:55:52 -07:00
scopes.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
screenshot.test.js Fix for --rolloverSize for individual WARCs in 1.x (#542) 2024-04-15 13:43:08 -07:00
seeds.test.js Fix regressions with failOnFailedSeed option (#572) 2024-05-15 11:02:33 -07:00
sitemap-parse.test.js Separate writing pages to pages.jsonl + extraPages.jsonl to use with new py-wacz (#535) 2024-04-11 13:55:52 -07:00
storage.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
text-extract.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
url_file_list.test.js Add Prettier to the repo, and format all the files! (#428) 2023-11-09 16:11:11 -08:00
warcinfo.test.js Always add warcinfo records to all WARCs (#556) 2024-05-22 15:47:05 -07:00