Stowage/browsertrix-crawler
2
0
Fork 0
mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-11-01 12:40:53 +00:00
Code Issues Projects Releases Packages Wiki Activity
358 commits 55 branches 144 tags 83 MiB
Commit graph

2 commits

Author SHA1 Message Date
Emma Segal-Grossman
2a49406df7
Add Prettier to the repo, and format all the files! (#428) 
This adds prettier to the repo, and sets up the pre-commit hook to
auto-format as well as lint.
Also updates ignores files to exclude crawls, test-crawls, scratch, dist as needed.
 2023-11-09 16:11:11 -08:00
Anish Lakhwara
1c486ea1f3
Capture Favicon (#362) 
- get favicon from CDP debug page, if available, log warning if not
- store in favIconUrl in pages.jsonl
- test: add test for favIcon and additional multi-page crawls
 2023-09-10 11:29:35 -07:00