Stowage/browsertrix-crawler
2
0
Fork 0
mirror of https://github.com/webrecorder/browsertrix-crawler.git synced 2025-10-19 06:23:16 +00:00
Code Issues Projects Releases Packages Wiki Activity

Adds warning about crawling with basic auth (#669)

Browse source 
Closes https://github.com/webrecorder/browsertrix/issues/1950 over here
too

### Changes
- Adds a warning about using basic auth
- Adds a link to MDN because learning and cross referencing is fun!
This commit is contained in:
Henry Wilkinson 2024-08-15 00:14:31 -04:00 • committed by GitHub
parent 4cc67a3267
commit 4c1da90d8f
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 4 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

5
docs/docs/user-guide/yaml-config.md
View file

@ -49,7 +49,10 @@ seeds:
## HTTP Auth
Browsertrix Crawler supports HTTP Basic Auth, which can be provide on a per-seed basis as part of the URL, for example:
!!! warning "HTTP basic auth credentials are written to the archive"
We recommend exercising caution and only archiving with dedicated archival accounts, changing your password or deleting the account when finished.
Browsertrix Crawler supports [HTTP Basic Auth](https://developer.mozilla.org/en-US/docs/Web/HTTP/Authentication), which can be provide on a per-seed basis as part of the URL, for example:
`--url https://username:password@example.com/`.
Alternatively, credentials can be added to the `auth` field for each seed: