Commit Graph

6 Commits

Author SHA1 Message Date
timothycarambat
a2a903741d replace stored GIF with Github CDN hosted image 2024-01-04 10:59:24 -08:00
Timothy Carambat
655ebd9479
[Feature] AnythingLLM use locally hosted Llama.cpp and GGUF files for inferencing (#413)
* Implement use of native embedder (all-Mini-L6-v2)
stop showing prisma queries during dev

* Add native embedder as an available embedder selection

* wrap model loader in try/catch

* print progress on download

* add built-in LLM support (expiermental)

* Update to progress output for embedder

* move embedder selection options to component

* saftey checks for modelfile

* update ref

* Hide selection when on hosted subdomain

* update documentation
hide localLlama when on hosted

* saftey checks for storage of models

* update dockerfile to pre-build Llama.cpp bindings

* update lockfile

* add langchain doc comment

* remove extraneous --no-metal option

* Show data handling for private LLM

* persist model in memory for N+1 chats

* update import
update dev comment on token model size

* update primary README

* chore: more readme updates and remove screenshots - too much to maintain, just use the app!

* remove screeshot link
2023-12-07 14:48:27 -08:00
timothycarambat
d509d7ed3d compress GIFs in readme 2023-10-25 11:38:47 -07:00
timothycarambat
4233d1a240 Update screenshots of new UI
Update README to point to updated YT video
2023-10-25 11:31:58 -07:00
Timothy Carambat
4dd1887bd1
Easy AWS cloud deployment for private instances via CloudFormation template (#52)
* wip

* fix file ref

* update dockerfile

* mute chown

* add build script for AWS CF template construction
add comment about script and AWS deployment

* move aws stuff into its own folder

* edit readme
2023-06-14 10:34:22 -07:00
timothycarambat
27c58541bd inital commit 2023-06-03 19:28:07 -07:00