Stowage/browsertrix-crawler
2
0
Fork 0
mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-10-19 06:23:16 +00:00
Code Issues Projects Releases Packages Wiki Activity
browsertrix-crawler/tests
History
Exact
Tessa Walsh e02058f001 Add ad blocking via request interception (#173) 
* ad blocking via request interception, extending block rules system, adding new AdBlockRules
* Load list of hosts to block from https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts added as json on image build
* Enabled via --blockAds and setting a custom message via --adBlockMessage
* new test to check for ad blocking
* Add test-crawls dir to .gitignore and .dockerignore
2022-11-15 18:30:27 -08:00
..
fixtures Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
.DS_Store tests text extraction (#30) 2021-03-01 16:00:23 -08:00
adblockrules.test.js Add ad blocking via request interception (#173) 2022-11-15 18:30:27 -08:00
basic_crawl.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
blockrules.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
collection_name.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
config_file.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
config_stdin.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
custom_driver.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
extra_hops_depth.test.js Add ad blocking via request interception (#173) 2022-11-15 18:30:27 -08:00
scopes.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
url_file_list.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00
warcinfo.test.js Convert to ESM (#179) 2022-11-15 18:30:27 -08:00