Updated section about memory/disk requirements in the README
This commit is contained in:
parent
345d0cfc5c
commit
8c29a31598
1 changed files with 1 additions and 1 deletions
|
@ -10,7 +10,7 @@ A frontend for large language models like [🐨 Koala](https://bair.berkeley.edu
|
||||||
- The pip packages listed in `requirements.txt`
|
- The pip packages listed in `requirements.txt`
|
||||||
- A Koala model in the ggml format (should be quantized)
|
- A Koala model in the ggml format (should be quantized)
|
||||||
|
|
||||||
The 7B-Model of Koala, `q4_0`-quantized, requires approx. 5 GB of RAM.
|
For memory and disk requirements for the different models, see [llama.cpp - Memory/Disk Requirements](https://github.com/ggerganov/llama.cpp#memorydisk-requirements)
|
||||||
|
|
||||||
## Supported Models
|
## Supported Models
|
||||||
|
|
||||||
|
|
Reference in a new issue