Updated section about memory/disk requirements in the README

This commit is contained in:
Julian Müller (ChaoticByte) 2023-05-25 21:26:00 +02:00
parent 345d0cfc5c
commit 8c29a31598

View file

@ -10,7 +10,7 @@ A frontend for large language models like [🐨 Koala](https://bair.berkeley.edu
- The pip packages listed in `requirements.txt` - The pip packages listed in `requirements.txt`
- A Koala model in the ggml format (should be quantized) - A Koala model in the ggml format (should be quantized)
The 7B-Model of Koala, `q4_0`-quantized, requires approx. 5 GB of RAM. For memory and disk requirements for the different models, see [llama.cpp - Memory/Disk Requirements](https://github.com/ggerganov/llama.cpp#memorydisk-requirements)
## Supported Models ## Supported Models