Stowage/browsertrix-crawler
2
0
Fork 0
mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-10-19 14:33:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
42 commits 54 branches 144 tags 82 MiB
Commit graph

3 commits

Author SHA1 Message Date
Ilya Kreymer
8f740d4e24 support custom crawl directory with --cwd flag, default to /crawls 
update README
 2020-11-02 15:28:19 +00:00
Ilya Kreymer
a875aa90d3 Dockerfile: switch to cmd 'crawl', instead of entrypoint to support running 'pywb' also 
update README with docker-compose and docker run examples, update commandline example
default output to './crawls' subdirectory
 2020-11-01 21:35:00 -08:00
Ilya Kreymer
91b8994a08 refactor crawler and default driver: 
- add extensible defaultDriver, wrap crawling functionality in Crawler class
- support headless/non-headless, custom driver
- support custom collection name for pywb, generate-cdx option
- autoplay: add slightly delay for splash loading
 2020-11-01 19:53:47 -08:00