3 commits

Author	SHA1	Message	Date
Ilya Kreymer	7b906f921c	Origin Overrides: Ensure Host header also set (#326) ... * origin overrides: ensure 'host' and 'origin' headers are also overridden, set to the *original* host and origin when sent to the destination origin	2023-05-30 19:25:37 -07:00
Ilya Kreymer	71b618fe94	Switch back to Puppeteer from Playwright (#301) ... - reduced memory usage, avoids memory leak issues caused by using playwright (see #298) - browser: split Browser into Browser and BaseBrowser - browser: puppeteer-specific functions added to Browser for additional flexibility if need to change again later - browser: use defaultArgs from playwright - browser: attempt to recover if initial target is gone - logging: add debug logging from process.memoryUsage() after every page - request interception: use priorities for cooperative request interception - request interception: move to setupPage() to run once per page, enable if any of blockrules, adblockrules or originOverrides are used - request interception: fix originOverrides enabled check, fix to work with catch-all request interception - default args: set --waitUntil back to 'load,networkidle2' - Update README with changes for puppeteer - tests: fix extra hops depth test to ensure more than one page crawled --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>	2023-04-26 15:41:35 -07:00
Ilya Kreymer	3d8e21ea59	origin override: add --originOverride source=dest to allow routing where https://src-host:src-port/path/page.html -> http://dest-host:dest-port/path/page.html where source=https://src-host:src-port and dest=http://dest-host:dest-port (#281)	2023-04-19 19:17:15 -07:00