Timothy Carambat 655ebd9479 [Feature] AnythingLLM use locally hosted Llama.cpp and GGUF files for inferencing (#413) ... * Implement use of native embedder (all-Mini-L6-v2) stop showing prisma queries during dev * Add native embedder as an available embedder selection * wrap model loader in try/catch * print progress on download * add built-in LLM support (expiermental) * Update to progress output for embedder * move embedder selection options to component * saftey checks for modelfile * update ref * Hide selection when on hosted subdomain * update documentation hide localLlama when on hosted * saftey checks for storage of models * update dockerfile to pre-build Llama.cpp bindings * update lockfile * add langchain doc comment * remove extraneous --no-metal option * Show data handling for private LLM * persist model in memory for N+1 chats * update import update dev comment on token model size * update primary README * chore: more readme updates and remove screenshots - too much to maintain, just use the app! * remove screeshot link		2023-12-07 14:48:27 -08:00
..
anthropic	assume default model where appropriate (#366)	2023-11-13 15:17:22 -08:00
azureOpenAi	Allow use of any embedder for any llm/update data handling modal (#386)	2023-11-16 15:19:49 -08:00
lmStudio	assume default model where appropriate (#366)	2023-11-13 15:17:22 -08:00
localAi	Add API key option to LocalAI (#407)	2023-12-04 08:38:15 -08:00
native	[Feature] AnythingLLM use locally hosted Llama.cpp and GGUF files for inferencing (#413)	2023-12-07 14:48:27 -08:00
openAi	Allow use of any embedder for any llm/update data handling modal (#386)	2023-11-16 15:19:49 -08:00