7 Commits

Author	SHA1	Message	Date
timothycarambat	049bfa14cb	fix: fully separate chunkconcurrency from chunk length	2023-12-20 11:20:40 -08:00
timothycarambat	a7f6003277	fix: set lower maxChunk limit on native embedder to stay within resource constraints ... chore: update comment for what embedding chunk means	2023-12-19 16:20:34 -08:00
Timothy Carambat	cba66150d7	patch: API key to localai service calls (#421) ... connect #417	2023-12-11 14:18:28 -08:00
Timothy Carambat	8cc1455b72	feat: add support for variable chunk length (#415) ... fix: cleanup code for embedding length clarify resolves #388	2023-12-07 16:27:36 -08:00
Timothy Carambat	88cdd8c872	Add built-in embedding engine into AnythingLLM (#411) ... * Implement use of native embedder (all-Mini-L6-v2) stop showing prisma queries during dev * Add native embedder as an available embedder selection * wrap model loader in try/catch * print progress on download * Update to progress output for embedder * move embedder selection options to component * forgot import * add Data privacy alert updates for local embedder	2023-12-06 10:36:22 -08:00
Tobias Landenberger	a96a9d41a3	LocalAI for embeddings (#361) ... * feature: add localAi as embedding provider * chore: add LocalAI image * chore: add localai embedding examples to docker .env.example * update setting env pull models from localai API * update comments on embedder Dont show cost estimation on UI --------- Co-authored-by: timothycarambat <rambat1010@gmail.com>	2023-11-14 13:49:31 -08:00
Timothy Carambat	5d56ab623b	Anthropic claude 2 support (#305) ... * WIP Anythropic support for chat, chat and query w/context * Add onboarding support for Anthropic * cleanup * fix Anthropic answer parsing move embedding selector to general util	2023-10-30 15:44:03 -07:00