Stowage/browsertrix-crawler
2
0
Fork 0
mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-10-19 06:23:16 +00:00
Code Issues Projects Releases Packages Wiki Activity

Add ad blocking via request interception (#173)

Browse source 
* ad blocking via request interception, extending block rules system, adding new AdBlockRules
* Load list of hosts to block from https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts added as json on image build
* Enabled via --blockAds and setting a custom message via --adBlockMessage
* new test to check for ad blocking
* Add test-crawls dir to .gitignore and .dockerignore
This commit is contained in:
Tessa Walsh 2022-10-25 10:53:32 -04:00 • committed by Ilya Kreymer
parent 277314f2de
commit e02058f001
8 changed files with 123 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

1
.dockerignore
View file

@ -1,3 +1,4 @@
output/
node_modules/
crawls/
test-crawls/