Support option to fail crawl on content check (#861)

- add --failOnContentCheck for quick fail if content check in behavior
fails
- expose __bx_contentCheckFailed to cause an immediately failure from
behavior
- only allow failing crawl due to content check from within
awaitPageLoad() callback
- set a 'failReason' key to track that crawl failed due to a particular
content check reason
- deps: update to browsertrix-behaviors 0.9.0, update to wabac.js
(2.23.6)
- fixes #860

---------
Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>
This commit is contained in:
Ilya Kreymer 2025-07-08 13:08:52 -07:00 committed by GitHub
parent 6244515818
commit 549d655173
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
8 changed files with 70 additions and 18 deletions

View file

@ -18,8 +18,8 @@
"dependencies": {
"@novnc/novnc": "1.4.0",
"@puppeteer/replay": "^3.1.1",
"@webrecorder/wabac": "^2.23.3",
"browsertrix-behaviors": "^0.8.5",
"@webrecorder/wabac": "^2.23.6",
"browsertrix-behaviors": "^0.9.0",
"client-zip": "^2.4.5",
"css-selector-parser": "^3.0.5",
"fetch-socks": "^1.3.0",