browsertrix-crawler/docs
Ilya Kreymer e585b6d194
Better default crawlId (#806)
- set crawl id from collection, not other way around, to ensure unique
redis keyspace for different collections
- by default, set crawl id to unique value based on host and collection,
eg. '@hostname-@id'
- don't include '@id' in collection interpolation, can only used
hostname or timestamp
- fixes issue mentioned / workaround provided in #784 
- ci: add docker login + cacheing to work around rate limits
- tests: fix sitemap tests
2025-04-01 13:40:03 -07:00
..
docs Better default crawlId (#806) 2025-04-01 13:40:03 -07:00
gen-cli.sh Gracefully handle non-absolute path for create-login-profile --filename (#521) 2024-03-29 13:46:54 -07:00
mkdocs.yml Add documentation on exit codes (#765) 2025-02-11 12:16:29 -05:00