Ilya Kreymer 9f541ab011 Support for uploading to S3 (#95) ... - support uploading WACZ to s3-compatible storage (via minio client) - config storage loaded from env vars, enabled when WACZ output is used. - support pinging either or an http or a redis key-based webhook, - webhook: include 'completed' bool to indicate if fully completed crawl or partial (eg. interrupted via signal) - consolidate redis init to redis.js - support upload filename with custom variables: can interpolate current timestamp (@ts), hostname (@hostname) and user provided id (@crawlId) - README: add docs for s3 storage, remove unused args - update to pywb 2.6.2, browsertrix-behaviors 0.2.4 * fix to `limit` option, ensure limit check uses shared state * bump version to 0.5.0-beta.1		2021-11-23 12:53:30 -08:00
..
fixtures	Customizable extract selectors + typo fix (0.4.2) (#72)	2021-07-23 18:31:43 -07:00
.DS_Store	tests text extraction (#30)	2021-03-01 16:00:23 -08:00
basic_crawl.test.js	Customizable extract selectors + typo fix (0.4.2) (#72)	2021-07-23 18:31:43 -07:00
blockrules.test.js	State Save + Restore State from Config + Redis State + Scope Fix 0.5.0 (#78)	2021-09-28 09:41:16 -07:00
collection_name.test.js	Customizable extract selectors + typo fix (0.4.2) (#72)	2021-07-23 18:31:43 -07:00
config_file.test.js	Customizable extract selectors + typo fix (0.4.2) (#72)	2021-07-23 18:31:43 -07:00
config_stdin.test.js	Customizable extract selectors + typo fix (0.4.2) (#72)	2021-07-23 18:31:43 -07:00
custom_driver.test.js	Support for uploading to S3 (#95)	2021-11-23 12:53:30 -08:00
scopes.test.js	State Save + Restore State from Config + Redis State + Scope Fix 0.5.0 (#78)	2021-09-28 09:41:16 -07:00
url_file_list.test.js	Customizable extract selectors + typo fix (0.4.2) (#72)	2021-07-23 18:31:43 -07:00
warcinfo.test.js	Customizable extract selectors + typo fix (0.4.2) (#72)	2021-07-23 18:31:43 -07:00