4 commits

Author	SHA1	Message	Date
Ilya Kreymer	804becc5b6	for consistency, since excluded page isn't written to pages.jsonl, there should also be no urn:pageinfo record added for excluded pages	2025-12-07 19:48:12 -08:00
Ilya Kreymer	ba4471f25b	tests: update excude redirect test to test that extra urn:page records are not written for excluded-on-redirect page	2025-12-06 16:46:30 -08:00
Ilya Kreymer	8ca7756d1b	tests: remove example.com from tests (#885) ... also use local http-server for behavior tests	2025-09-19 23:21:47 -07:00
Ilya Kreymer	a00866bbab	Apply exclusions to redirects (#745) ... - if redirected page is excluded, block loading of page - mark page as excluded, don't retry, and don't write to page list - support generic blocking of pages based on initial page response - fixes #744	2025-01-28 11:28:23 -08:00