Ilya Kreymer 4fb9577d4f don't disable extraHops when using sitemaps: (#639) ... - instead, exclude sitemap-discovered page URLs from being counted to extra hops rules, eg. if a sitemap page is not in scope, don't include it. -if extraHops is set with sitemaps, only consider extraHops for links for pages that are in scope. - bump version to 1.2.4		2024-07-11 19:48:43 -07:00
..
custom-behaviors	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
fixtures	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
invalid-behaviors	detect invalid custom behaviors on load: (#450)	2023-12-13 15:14:53 -05:00
.DS_Store	tests text extraction (#30)	2021-03-01 16:00:23 -08:00
adblockrules.test.js	tests: reduce logging (#596)	2024-06-26 13:05:13 -07:00
add-exclusion.test.js	QA Crawl Support (Beta) (#469)	2024-03-22 17:32:42 -07:00
basic_crawl.test.js	WARC filename prefix + rollover size + improved 'livestream' / truncated response support. (#440)	2023-12-07 23:02:55 -08:00
blockrules.test.js	tests: reduce logging (#596)	2024-06-26 13:05:13 -07:00
brave-query-redir.test.js	Don't filter saving redirect if no response body. (#628)	2024-06-25 15:48:22 -07:00
collection_name.test.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
config_file.test.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
config_stdin.test.js	tests: reduce logging (#596)	2024-06-26 13:05:13 -07:00
crawl_overwrite.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
custom-behavior.test.js	detect invalid custom behaviors on load: (#450)	2023-12-13 15:14:53 -05:00
custom_driver.test.js	Separate writing pages to pages.jsonl + extraPages.jsonl to use with new py-wacz (#535)	2024-04-11 13:55:52 -07:00
dryrun.test.js	add --dryRun flag and mode (#594)	2024-06-07 10:34:19 -07:00
extra_hops_depth.test.js	Dependency Update / 1.2.2 (#633)	2024-07-03 12:55:14 -07:00
file_stats.test.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
http-auth.test.js	http auth support per seed (supersedes #566): (#616)	2024-06-20 16:35:30 -07:00
limit_reached.test.js	Fix failOnFailedLimit and add tests (#580)	2024-05-21 16:35:43 -07:00
log_filtering.test.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
mult_url_crawl_with_favicon.test.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
multi-instance-crawl.test.js	dependency: update RWP to 2.0.1 (#610)	2024-06-13 18:43:58 -07:00
non-html-crawl.test.js	Always download PDF + non HTML page cleanup + enterprise policy cleanup (#629)	2024-06-26 09:16:24 -07:00
pageinfo-records.test.js	Loosen selectors for login fields in automated profile creation (#638)	2024-07-11 15:55:06 -07:00
proxy.test.js	proxy: support setting proxy via --proxyServer, PROXY_SERVER env var or PROXY_HOST + PROXY_PORT env vars (#589)	2024-06-10 13:11:00 -07:00
qa_compare.test.js	QA Crawl Support (Beta) (#469)	2024-03-22 17:32:42 -07:00
redis_crawl_state.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
rollover-writer.test.js	tests: reduce logging (#596)	2024-06-26 13:05:13 -07:00
saved-state.test.js	Separate writing pages to pages.jsonl + extraPages.jsonl to use with new py-wacz (#535)	2024-04-11 13:55:52 -07:00
scopes.test.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
screenshot.test.js	Fix for --rolloverSize for individual WARCs in 1.x (#542)	2024-04-15 13:43:08 -07:00
seeds.test.js	Fix regressions with failOnFailedSeed option (#572)	2024-05-15 11:02:33 -07:00
sitemap-parse.test.js	don't disable extraHops when using sitemaps: (#639)	2024-07-11 19:48:43 -07:00
storage.test.js	tests: reduce logging (#596)	2024-06-26 13:05:13 -07:00
text-extract.test.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
url_file_list.test.js	Add Prettier to the repo, and format all the files! (#428)	2023-11-09 16:11:11 -08:00
warcinfo.test.js	tests: reduce logging (#596)	2024-06-26 13:05:13 -07:00