Stowage/browsertrix-crawler
2
0
Fork 0
mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-10-19 06:23:16 +00:00
Code Issues Projects Releases Packages Wiki Activity

Add wacz support to browsertrix (#6)

Browse source 
* Add WACZ creation support, fixes #2
* --generateWACZ flag adds WACZ file (currently named <collection>/<collection>.wacz)
* page list generated in <collection>/pages/pages.jsonl, entry for each page is appended to end of file, includes url and title of page

Co-authored-by: Emma Dickson <emmadickson@Emmas-MacBook-Pro.local>
Co-authored-by: Ilya Kreymer <ikreymer@gmail.com>
This commit is contained in:
Emma Dickson 2021-02-04 00:28:32 -05:00 • committed by GitHub
parent 789279021b
commit 9c139eba2b
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 78 additions and 14 deletions
Download patch file Download diff file Expand all files Collapse all files

5
package.json
View file

@ -11,8 +11,9 @@
"puppeteer-cluster": "^0.22.0",
"puppeteer-core": "^5.3.1",
"sitemapper": "^3.1.2",
"yargs": "^16.0.3"
},
"yargs": "^16.0.3",
"uuid": "8.3.2"
},
"devDependencies": {
"eslint": "^7.12.1"
}