service worker capture fix: disable by default for now (#506)

Due to issues with capturing top-level pages, make bypassing service
workers the default for now. Previously, it was only disabled when using
profiles. (This is also consistent with ArchiveWeb.page behavior).
Includes:
- add --serviceWorker option which can be `disabled`,
disabled-if-profile (previous default) and `enabled`
- ensure page timestamp is set for direct fetch
- warn if page timestamp is missing on serialization, then set to now
before serializing

bump version to 1.0.2
This commit is contained in:
Ilya Kreymer 2024-03-22 13:37:14 -07:00 committed by GitHub
parent 93c3894d6f
commit 22a7351dc7
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 55 additions and 8 deletions

View file

@ -1,6 +1,6 @@
{
"name": "browsertrix-crawler",
"version": "1.0.1",
"version": "1.0.2",
"main": "browsertrix-crawler",
"type": "module",
"repository": "https://github.com/webrecorder/browsertrix-crawler",