Stowage/browsertrix-crawler

Fork 0

mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-10-27 18:24:11 +00:00

Commit graph

Author	SHA1	Message	Date
Ilya Kreymer	5c00bca2b4	tests: use old.webrecorder.net for testing (#710 ) replace webrecorder.net -> old.webrecorder.net to fix tests relying on old website for now	2024-10-31 13:24:58 -04:00
Ilya Kreymer	6a9ca3df54	Don't filter saving redirect if no response body. (#628 ) It's possible for a redirect, especially a browser-generated one to have headers and no body (eg. Brave removing tracking url query). Don't filter these redirects out from being written to WARC, just set payload to empty buffer. fixes #627 where Brave-generated redirect response was not stored.	2024-06-25 15:48:22 -07:00

Author

SHA1

Message

Date

Ilya Kreymer

5c00bca2b4

tests: use old.webrecorder.net for testing (#710 )

replace webrecorder.net -> old.webrecorder.net to fix tests relying on
old website for now

2024-10-31 13:24:58 -04:00

Ilya Kreymer

6a9ca3df54

Don't filter saving redirect if no response body. (#628 )

It's possible for a redirect, especially a browser-generated one to have
headers and no body (eg. Brave removing tracking url query). Don't
filter these redirects out from being written to WARC, just set payload to empty
buffer.

fixes #627 where Brave-generated redirect response was not stored.

2024-06-25 15:48:22 -07:00

2 commits