mirror of
https://github.com/webrecorder/browsertrix-crawler.git
synced 2025-10-19 06:23:16 +00:00
a2742df328
- check for urls that are wrapped in quotes, eg. 'https://example.com/' or "https://example.com/" and trim and remove the quotes before adding seed - tests: add quoted URL to tests, fix old.webrecorder.net test - deps: update wabac.js, RWP to latest - logging: reduce error logging for seed lists, only log once that there are duplicates or page limit is reached - fix for #882
3 lines
111 B
Text
3 lines
111 B
Text
https://old.webrecorder.net/about/
|
|
https://specs.webrecorder.net/wacz/1.1.1/
|
|
"https://old.webrecorder.net/faq"
|