Commit Graph

386 Commits

Author SHA1 Message Date
timothycarambat 083dc5bf1c WIP on iframe embed support 2024-02-02 13:00:50 -08:00
timothycarambat 27381a612c nonpriv 2024-02-02 12:24:00 -08:00
timothycarambat 20cfb2f4c4 update embed 2024-02-02 12:09:24 -08:00
timothycarambat 8e0b08ecad Admin Embed Chats mgmt page 2024-02-02 11:41:04 -08:00
timothycarambat b219c5df0e Admin embed config page 2024-02-02 11:12:06 -08:00
timothycarambat efc54be4ae reset chat history 2024-02-01 16:20:44 -08:00
timothycarambat 1bdc4b9975 auto open param and default greeting 2024-02-01 15:38:07 -08:00
timothycarambat 2f0942afac add middleware validations on embed chat 2024-02-01 15:08:30 -08:00
timothycarambat 3b9f7cb373 introduce chat modal styles 2024-02-01 14:14:17 -08:00
timothycarambat 97bc5fa39b rename to embed folder 2024-02-01 13:55:37 -08:00
timothycarambat feb686dc36 forgot files 2024-02-01 11:24:42 -08:00
timothycarambat 625d2f9654 Implement models and cleanup embed chat endpoints
Improve build process for embed
prod minification and bundle size awareness
WIP
2024-02-01 11:24:04 -08:00
timothycarambat 0c77a2b4af remove eslint config 2024-01-31 13:35:28 -08:00
timothycarambat 55170107c8 rough in modularization of embed chat
cleanup dev process for easier dev support
move all chat to components
todo: build process
todo: backend support
2024-01-31 13:34:25 -08:00
shatfield4 677cf96b34 load params from script tag into embedded app 2024-01-31 10:49:22 -08:00
shatfield4 3076809a17 WIP embedded app history functional 2024-01-31 09:23:08 -08:00
shatfield4 6665b39ceb implemented streaming and tailwind min for styling into embedded app 2024-01-29 18:32:58 -08:00
shatfield4 28a9cf52ec WIP streaming prints to embedded app 2024-01-26 12:18:32 -08:00
shatfield4 a0e1152258 WIP got response from backend in embedded app 2024-01-25 17:26:36 -08:00
shatfield4 58ecc10dcc WIP embedded app 2024-01-24 17:20:26 -08:00
timothycarambat 171b1dd9aa Add runtime metric to Telemetry 2024-01-24 10:40:31 -08:00
timothycarambat 09a0fe1c81 Add prisma reset dev command
Patch background color for fullscreen loader
2024-01-23 14:22:50 -08:00
Sean Hatfield 62da5c9933
[REFACTOR] remove all <dialog> modals and replace with custom ModalWrapper component (#641)
* add useModal hook and ModalWrapper component that will be used to replace all <dialog> modals for better browser support

* implement useModal hook and ModalWrapper component to replace all exisiting <dialog>
2024-01-23 14:19:08 -08:00
Sean Hatfield 2f3db0e63a
[FEAT] support pinecone serverless (#639)
* migrate pinecone package to latest version and migrate pinecone vectordb provider class

* remove pinecone environment name env variable and update docs to reflect removal & serverless support complete

* migrate query for pinecone db

* typo in log

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-22 16:41:20 -08:00
timothycarambat ad5a35b662 fix bare-metal.md typos 2024-01-22 16:09:54 -08:00
Timothy Carambat c5d0f29c48
Add bare metal support docs and deployment (#638)
* Add bare metal support docs and deployment

* typos
2024-01-22 16:07:55 -08:00
Timothy Carambat d5cde8b7c2
Apply permissioning on document modification endpoints (#637) 2024-01-22 14:31:19 -08:00
Timothy Carambat 9a237db3d1
Implement total permission overhaul (#629)
* Implement total permission overhaul
Add explicit permissions on each flex and strict route
Patch issues with role escalation and CRUD of users
Patch permissions on all routes for coverage
Improve middleware to accept role array for clarity

* update comments

* remove permissions to API-keys for manager. Manager could generate API-key and using high-privelege api-key give themselves admin

* update sidebar permissions for multi-user and single user

* update options for mobile sidebar
2024-01-22 14:14:01 -08:00
Sean Hatfield 62cea07599
add gpt-3.5-turbo-1106 model for openai LLM (#636)
* add gpt-3.5-turbo-1106 model for openai LLM

* add gpt-3.5-turbo-1106 as valid model for backend and per workspace model selection
2024-01-22 13:19:47 -08:00
Sean Hatfield 288ff0d18c
fix vector cache not deleting cache after unembedding items with folders (#630) 2024-01-22 13:03:05 -08:00
Timothy Carambat 8a7324d0e7
Employ strict validations on document pathing (#627)
* Employ strict validations on document pathing

* add comment

* update validSubfolder var
2024-01-19 12:56:00 -08:00
Timothy Carambat 0db6c3b2aa
Prevent private octets from link collection for self-hosted (#626) 2024-01-19 10:49:40 -08:00
timothycarambat 0efb3ab54c remove unneeded import multer 2024-01-19 10:22:37 -08:00
Timothy Carambat 44eb1e9ab0
617 persist special env keys (#624)
* add support for exporting to json and csv in workspace chats

* safety encode URL options

* remove message about openai fine tuning on export success

* all defaults to jsonl

* Persist special env keys on updates

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2024-01-18 18:13:24 -08:00
Sean Hatfield 7fb76cfef0
add support for exporting to json and csv in workspace chats (#622)
* add support for exporting to json and csv in workspace chats

* safety encode URL options

* remove message about openai fine tuning on export success

* all defaults to jsonl
2024-01-18 17:59:51 -08:00
Sean Hatfield 08d33cfd8f
Merge pull request from GHSA-xmj6-g32r-fc5q
* remove support for import export anythingllm data

* remove unused imports
remove unused dep
update lockfile

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-18 13:57:23 -08:00
Sean Hatfield 56fa17caf2
create configurable topN per workspace (#616)
* create configurable topN per workspace

* Update TopN UI text
Fix fallbacks for all providers
Add SQLite CHECK to TOPN value

* merge with master
Update zilliz provider for variable TopN

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-18 12:34:20 -08:00
Timothy Carambat 683cd69a97
Display readable error message in chat failure (#621) 2024-01-18 12:01:53 -08:00
Timothy Carambat 658e7fa390
chore: Better VectorDb and Embedder error messages (#620)
* chore: propogate embedder and vectordb errors during document mutations

* add default value for errors on addDocuments
2024-01-18 11:40:48 -08:00
Timothy Carambat 0df86699e7
feat: Add support for Zilliz Cloud by Milvus (#615)
* feat: Add support for Zilliz Cloud by Milvus

* update placeholder text
update data handling stmt

* update zilliz descriptor
2024-01-17 18:00:54 -08:00
Sean Hatfield 3fe7a25759
add token context limit for native llm settings (#614)
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-17 16:25:30 -08:00
Sean Hatfield 56dc49966d
add copy feature to assistant chat message (#611)
* add copy feature to assistant chat message

* fix tooltip not hiding on mobile

* fix: add tooltips
chore: breakout actions to extendable component + memoize
add CopyText to hook we can reuse
fix: Copy on code snippets broken, moved to event listener
fix: highlightjs patch for new API support
feat: add copy response support

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-17 16:22:06 -08:00
Sean Hatfield c2c8fe9756
add support for mistral api (#610)
* add support for mistral api

* update docs to show support for Mistral

* add default temp to all providers, suggest different results per provider

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-17 14:42:05 -08:00
Sean Hatfield 90df37582b
Per workspace model selection (#582)
* WIP model selection per workspace (migrations and openai saves properly

* revert OpenAiOption

* add support for models per workspace for anthropic, localAi, ollama, openAi, and togetherAi

* remove unneeded comments

* update logic for when LLMProvider is reset, reset Ai provider files with master

* remove frontend/api reset of workspace chat and move logic to updateENV
add postUpdate callbacks to envs

* set preferred model for chat on class instantiation

* remove extra param

* linting

* remove unused var

* refactor chat model selection on workspace

* linting

* add fallback for base path to localai models

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-17 12:59:25 -08:00
Sean Hatfield bf503ee0e9
add check to skip empty messages (#602)
* add check to skip empty messages

* add comment explaining prisma + sqlite not supporting createMany()
2024-01-16 18:23:51 -08:00
Timothy Carambat b35feede87
570 document api return object (#608)
* Add support for fetching single document in documents folder

* Add document object to upload + support link scraping via API

* hotfixes for documentation

* update api docs
2024-01-16 16:04:22 -08:00
Timothy Carambat c61cbd1502
Add support for fetching single document in documents folder (#607) 2024-01-16 14:58:49 -08:00
Timothy Carambat e973c1edbf
Preload onboarding (#606)
* no lazy onboarding

* no lazy onboarding steps

* Do not lazy load onboarding to prevent lazy-load white flash
2024-01-16 14:15:46 -08:00
Sean Hatfield 8b11288764
truncate title to shorter length so x button is not hidden for longer… (#603)
* truncate title to shorter length so x button is not hidden for longer title names in the citation modal

* absolutely position x button on citation modal
2024-01-16 13:43:32 -08:00
Timothy Carambat d0a3f1e3e1
Fix present diminsions on vectorDBs to be inferred for providers who require it (#605) 2024-01-16 13:41:01 -08:00