Stowage/browsertrix-crawler
2
0
Fork 0
mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-10-19 06:23:16 +00:00
Code Issues Projects Releases Packages Wiki Activity

Make numRetries configurable (#754)

Browse source 
Add --numRetries param, default to 1 instead of 5.
This commit is contained in:
Ilya Kreymer 2025-02-05 23:34:55 -08:00 • committed by GitHub
parent f379da19be
commit 2e46140c3f
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
6 changed files with 30 additions and 12 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/docs/user-guide/cli-options.md
View file

@ -240,6 +240,9 @@ Options:
s [boolean] [default: false]
--writePagesToRedis If set, write page objects to redis
[boolean] [default: false]
--numRetries If set, number of times to retry a p
age that failed to load
[number] [default: 1]
--failOnFailedSeed If set, crawler will fail with exit
code 1 if any seed fails. When combi
ned with --failOnInvalidStatus,will