kamp/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2024-07-02 15:20:37 +02:00
Code Issues Packages Projects Releases Wiki Activity

docs: placeholder for model downloads folder (#446)

Browse Source
This commit is contained in:
Timothy Carambat 2023-12-14 10:31:14 -08:00 committed by GitHub
parent d094cc3c10
commit 1e98da07bc
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 8 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
server/storage/models/.gitignore vendored
View File

@ -1,2 +1,3 @@
Xenova
downloaded/*
downloaded/*
!downloaded/.placeholder

6
server/storage/models/README.md
View File

@ -30,4 +30,8 @@ If you would like to use a local Llama compatible LLM model for chatting you can
> If running in Docker you should be running the container to a mounted storage location on the host machine so you
> can update the storage files directly without having to re-download or re-build your docker container. [See suggested Docker config](../../../README.md#recommended-usage-with-docker-easy)
All local models you want to have available for LLM selection should be placed in the `storage/models/downloaded` folder. Only `.gguf` files will be allowed to be selected from the UI.
> [!NOTE]
> `/server/storage/models/downloaded` is the default location that your model files should be at.
> Your storage directory may differ if you changed the STORAGE_DIR environment variable.
All local models you want to have available for LLM selection should be placed in the `server/storage/models/downloaded` folder. Only `.gguf` files will be allowed to be selected from the UI.

1
server/storage/models/downloaded/.placeholder Normal file
View File

@ -0,0 +1 @@
All your .GGUF model file downloads you want to use for chatting should go into this folder.