timothycarambat
e1372a81d4
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-04-20 18:22:41 -07:00
Timothy Carambat
c65f890afc
Add LMStudio embedding endpoint support ( #1141 )
...
* Add LMStudio embedding endpoint support
* update alive path check for HEAD
remove commented JSX
* update comment
2024-04-19 15:36:07 -07:00
Timothy Carambat
b3c7c002db
Warn user when changing embedder with current progress already ( #1135 )
...
* Warn user when changing embedder with current progress already
* update comment
2024-04-19 09:51:58 -07:00
Timothy Carambat
58b744771f
Add support for Gemini-1.5 Pro ( #1134 )
...
* Add support for Gemini-1.5 Pro
bump @google/generative-ai pkg
Toggle apiVersion if beta model selected
resolves #1109
* update API messages due to package change
2024-04-19 08:59:46 -07:00
timothycarambat
e28c0469f4
bump togetherai models Apr 18, 2024
...
resolves #1126
2024-04-18 16:28:43 -07:00
timothycarambat
bd5b3f5d00
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-04-18 14:54:05 -07:00
Timothy Carambat
91ea37d17a
Patch model selection for openai ( #1128 )
...
prevent rerenders of web-browsing for agents
update openai latest pkg name
2024-04-18 13:32:50 -07:00
Timothy Carambat
9655880cf0
Update all vector dbs to filter duplicate source documents that may be pinned ( #1122 )
...
* Update all vector dbs to filter duplicate parents
* cleanup
2024-04-17 18:04:39 -07:00
Timothy Carambat
41978765bc
Improve document summarizer by being able to reference by direct name versus ID, which sometimes models fail to chain ( #1121 )
2024-04-17 14:34:58 -07:00
Timothy Carambat
81fd82e133
model specific summarization ( #1119 )
...
* model specific summarization
* update guard functions
* patch model picker and key inputs
2024-04-17 14:04:51 -07:00
timothycarambat
45505630a6
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-04-17 11:55:57 -07:00
Timothy Carambat
9449fcd737
Add Anthropic agent support with new API and tool_calling ( #1116 )
...
* Add Anthropic agent support with new API and tool_calling
* patch useProviderHook to unset default models on provider change
2024-04-17 11:54:58 -07:00
Timothy Carambat
8ebe1a515b
Gracefully handle bad agent auth ( #1115 )
...
use provider that is set
2024-04-16 16:42:06 -07:00
Timothy Carambat
f9ac27e9a4
Handle Anthropic streamable errors ( #1113 )
2024-04-16 16:25:32 -07:00
Timothy Carambat
661563408a
Enable dynamic GPT model dropdown ( #1111 )
...
* Enable dynamic GPT model dropdown
2024-04-16 14:54:39 -07:00
Timothy Carambat
a5bb77f97a
Agent support for @agent default agent inside workspace chat ( #1093 )
...
V1 of agent support via built-in `@agent` that can be invoked alongside normal workspace RAG chat.
2024-04-16 10:50:10 -07:00
Timothy Carambat
8306098b08
Bump all static model providers ( #1101 )
2024-04-14 12:55:21 -07:00
Timothy Carambat
6fde5570b3
remove unneeded answerKey for Anthropic ( #1100 )
...
resolves #1096
2024-04-14 12:04:38 -07:00
timothycarambat
fde4e5400f
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-04-12 14:57:46 -07:00
Timothy Carambat
a8e731f548
Add ability for owner to reset just the workspace vector DB ( #1094 )
...
* Add ability for owner to reset just the workspace vector DB
* explicit border none
2024-04-12 14:50:39 -07:00
Timothy Carambat
d54e1c1f2d
expand support for non-US azure deployments ( #1080 )
...
* expand support for non-US azure deployments
* update conditional
2024-04-10 09:34:14 -07:00
timothycarambat
75ced7e65a
merge with master
...
Patch LLM selection for native to be disabled
2024-04-07 14:55:18 -07:00
Timothy Carambat
24b523d5eb
append missing import for some vectordb providers ( #1066 )
2024-04-07 14:40:23 -07:00
Timothy Carambat
ce98ff4653
Enable customization of chunk length and overlap ( #1059 )
...
* Enable customization of chunk length and overlap
* fix onboarding link
show max limit in UI and prevent overlap >= chunk size
2024-04-06 16:38:07 -07:00
Timothy Carambat
1c11a47f93
Check ollama alive for embedder ( #1057 )
2024-04-06 12:16:30 -07:00
Timothy Carambat
6f52a2b729
Embedder download - fallback URL ( #1056 )
...
* Embedder download - fallback URL
* improve logging for native embedder
2024-04-06 11:49:15 -07:00
Timothy Carambat
94b58249a3
Enable per-workspace provider/model combination ( #1042 )
...
* Enable per-workspace provider/model combination
* cleanup
* remove resetWorkspaceChatModels and wipeWorkspaceModelPreference to prevent workspace from resetting model
* add space
---------
Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2024-04-05 10:58:36 -07:00
timothycarambat
56de16005f
patch render/railway hotdir path
2024-04-05 09:55:15 -07:00
timothycarambat
2638098d49
patch with master
2024-04-05 09:45:28 -07:00
Timothy Carambat
8c7379cda1
persist provider keys between toggle providers ( #1041 )
2024-04-04 13:47:33 -07:00
timothycarambat
0b454016cf
patch comkey path to fallback
2024-04-04 10:47:26 -07:00
timothycarambat
718062d033
patch milvus/zilliz auto-generated collection name
...
resolves #1027
2024-04-03 12:34:23 -07:00
timothycarambat
8305bbaf7f
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-04-02 14:54:07 -07:00
Sean Hatfield
41fe20f2e0
[FEAT] Implement new workspace members settings and admin users UI updates ( #990 )
...
* members workspace settings menu and admin users UI updates
* change copy/fix admin and managers in workspace when not showing in UI
* remove existing workspace user mgmt modal
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-04-02 14:53:35 -07:00
timothycarambat
a4c1d42e41
merge with master
2024-04-02 14:33:32 -07:00
Timothy Carambat
df2aac9f3c
useMLock for Ollama API chats ( #1014 )
2024-04-02 10:43:04 -07:00
Ivan Skodje
e9199bac12
[FEAT] Check port access in docker before showing a default error ( #961 )
...
* [FEAT] Added port checks in updateENV.validDockerizedUrl to prevent docker from assuming it cannot access localhost URLs
* [CHORE] Updated error message to include Linux URL
* Patch port checking for general loopbacks
* typo
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-04-02 10:34:50 -07:00
Timothy Carambat
f4088d9348
RSA-Signing on server<->collector communication via API ( #1005 )
...
* WIP integrity check between processes
* Implement integrity checking on document processor payloads
2024-04-01 13:56:35 -07:00
timothycarambat
200bd7f061
patch prisma query expansion on threads
2024-04-01 13:09:37 -07:00
timothycarambat
b1a2fa6385
Stringify username/pass
2024-04-01 12:11:46 -07:00
Timothy Carambat
b8d37d9f43
Handle no-mutli-part form data error ( #1004 )
2024-04-01 12:06:47 -07:00
timothycarambat
49f30e051c
security: patch footer icon self-xss from privledged user
2024-03-29 13:39:11 -07:00
timothycarambat
bfedfebfab
security: force sanitize env string set by user
2024-03-29 13:03:05 -07:00
timothycarambat
2374939ffb
security: patch primsa expansion on token request
2024-03-29 11:47:30 -07:00
Timothy Carambat
52fac84422
Patch ability to update multi-user-flag once set ( #993 )
...
* Patch ability to update multi-user-flag once set
* update logo function to safe update key values
2024-03-29 10:56:32 -07:00
timothycarambat
bf8df60c02
move vector db debug endpoint to dev only
2024-03-27 13:19:28 -07:00
timothycarambat
99cfee1e70
sec: fix enable-multi-user preflight check to prevent error loop
2024-03-27 12:20:53 -07:00
Sean Hatfield
fa4adb1e56
[FIX] User messages not saving due to empty message check ( #978 )
...
fix user messages not saving due to empty message check
2024-03-27 10:45:20 -07:00
Timothy Carambat
0dd6001fa6
Patch Gemini/Google AI errors ( #977 )
2024-03-26 17:20:12 -07:00
Timothy Carambat
efe9dfa5e3
handle expired token being null and prevent constant rerender ( #956 )
...
* handle expired token being null and prevent constant rerender
* reset defaults
2024-03-26 16:47:25 -07:00
Timothy Carambat
1ecefe8bed
Add ability to add invitee to workspaces automatically ( #975 )
2024-03-26 16:38:32 -07:00
timothycarambat
1cd255c1ec
deprecate /migrate endpoint
2024-03-26 15:32:07 -07:00
timothycarambat
7de23dbb2d
norm path logo
2024-03-26 15:25:46 -07:00
timothycarambat
971c54e2c8
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-03-26 14:12:09 -07:00
Timothy Carambat
1135853740
Patch LMStudio Inference server bug integration ( #957 )
2024-03-22 14:39:30 -07:00
Sean Hatfield
35a155d3ac
Workspace prompt changes ( #949 )
...
* track workspace prompt change
* refactor
* modify arg order
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-03-21 15:25:42 -07:00
timothycarambat
373c833aad
path API document mgmt with STORAGE_DIR
2024-03-21 15:10:44 -07:00
timothycarambat
22ef2c287d
folder mgmt, use STORAGE_DIR
2024-03-21 15:03:52 -07:00
timothycarambat
2ce77b943e
filter null folders
2024-03-21 14:47:45 -07:00
Sean Hatfield
4f268dfeb6
[FEAT] Document picker folders for organization ( #902 )
...
* implement alternating color rows for file picker
* implement alternating colors for workspace directory
* remove unneeded props/variables
* remove unused border classes
* WIP new folder UI
* remove unneeded expanded prop from filerow component
* folder creation UI and files object manipulation WIP
* folder creation & moving files complete
* add developer API support for creating folders and moving files
* update alternating row css for file picker
* remove unneeded props from merge
* normalize paths for folders
priority to custom docs folder
silently fail on duplicate folders
* update folder icon to custom svg
* linting and move FolderIcon to JSX
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-03-20 16:10:30 -07:00
timothycarambat
540d18ec84
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-03-18 09:52:11 -07:00
Timothy Carambat
7e7e957e32
Enable privacy and handling to be reviewed and modified ( #910 )
2024-03-14 16:56:15 -07:00
Timothy Carambat
0ada882991
Support external transcription providers ( #909 )
...
* Support External Transcription providers
* patch files
* update docs
* fix return data
2024-03-14 15:43:26 -07:00
Sean Hatfield
ac0e62d490
[FEAT] Anthropic Haiku model support ( #901 )
...
add Haiku model support
2024-03-13 17:32:02 -07:00
Timothy Carambat
0e46a11cb6
Stop generation button during stream-response ( #892 )
...
* Stop generation button during stream-response
* add custom stop icon
* add stop to thread chats
2024-03-12 15:21:27 -07:00
timothycarambat
429ea0c805
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-03-12 12:29:57 -07:00
Sean Hatfield
04399b1328
[FEAT] Ability to set workspace profile image ( #847 )
...
* WIP workspace pfp, CRUD functions complete
* implement fetching workspace pfp in UserIcon component
* update UI for workspace settings pfp
* minor css refactor
* WIP fixes to workspace pfp
* create responseCache for workspace pfp blob to improve performance
* fix cache not clearing when removing workspace pfp and remove unneeded util
* load workspace image once, dont reload
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-03-12 11:36:59 -07:00
timothycarambat
d1d29ff2e4
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-03-08 12:56:28 -08:00
timothycarambat
0117589bbf
pin prisma versions to be the same
2024-03-08 12:51:58 -08:00
timothycarambat
31d9268ed4
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm
2024-03-06 17:14:26 -08:00
timothycarambat
273d824df4
patch: do not block response if user password check failed
2024-03-06 17:14:17 -08:00
timothycarambat
65f8a01505
merge with master
2024-03-06 16:43:36 -08:00
Sean Hatfield
e0d5d8039a
[FEAT] Claude 3 support and implement new version of Anthropic SDK ( #863 )
...
* implement new version of anthropic sdk and support new models
* remove handleAnthropicStream and move to handleStream inside anthropic provider
* update useGetProvidersModels for new anthropic models
2024-03-06 14:57:47 -08:00
Sean Hatfield
0634013788
[FEAT] Groq LLM support ( #865 )
...
* Groq LLM support complete
* update useGetProvidersModels for groq models
* Add definiations
update comments and error log reports
add example envs
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-03-06 14:48:38 -08:00
Gabriel Koo
4731ec8be8
[FIX] : missing import for parseAuthHeader in server/utils/vectorDbProviders/chroma/index.js ( #869 )
...
fix: import parseAuthHeader in chroma/index.js
2024-03-06 09:14:36 -08:00
Sean Hatfield
fde905aac1
[FEAT] JSON export append all metadata fields to workspace chats ( #845 )
...
have JSON export append all metadata fields
2024-02-29 17:04:59 -08:00
timothycarambat
2b6e1db79b
merge with master
2024-02-27 23:12:09 -08:00
Timothy Carambat
9e085baf5e
Add chat-export to API ( #831 )
2024-02-27 12:52:57 -08:00
Timothy Carambat
bbe3c0a5d6
Bulk remove files from file picker ( #830 )
...
Do bulk deletion on backend
2024-02-27 11:53:42 -08:00
Timothy Carambat
b64cb199f9
788 ollama embedder ( #814 )
...
* Add Ollama embedder model support calls
* update docs
2024-02-26 16:12:20 -08:00
Timothy Carambat
a385ea3d82
CHORE: bump pplx model support ( #791 )
...
bump pplx model support
2024-02-23 17:33:16 -08:00
Sean Hatfield
633f425206
[FEAT] OpenRouter integration ( #784 )
...
* WIP openrouter integration
* add OpenRouter options to onboarding flow and data handling
* add todo to fix headers for rankings
* OpenRouter LLM support complete
* Fix hanging response stream with OpenRouter
update tagline
update comment
* update timeout comment
* wait for first chunk to start timer
* sort OpenRouter models by organization
* uppercase first letter of organization
* sort grouped models by org
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-02-23 17:18:58 -08:00
Sean Hatfield
80ced5eba4
[FEAT] PerplexityAI Support ( #778 )
...
* add LLM support for perplexity
* update README & example env
* fix ENV keys in example env files
* slight changes for QA of perplexity support
* Update Perplexity AI name
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-02-22 12:48:57 -08:00
timothycarambat
e60bea1273
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-02-22 10:07:53 -08:00
Sean Hatfield
e99c74aec1
[DOCS] Update Docker documentation to show how to setup Ollama with Dockerized version of AnythingLLM ( #774 )
...
* update HOW_TO_USE_DOCKER to help with Ollama setup using docker
* update HOW_TO_USE_DOCKER
* styles update
* create separate README for ollama and link to it in HOW_TO_USE_DOCKER
* styling update
2024-02-21 18:42:32 -08:00
timothycarambat
28069040f3
merge with master
2024-02-21 15:16:01 -08:00
timothycarambat
ae01785220
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into render
2024-02-21 15:11:45 -08:00
Timothy Carambat
791c0ee9dc
Enable ability to do full-text query on documents ( #758 )
...
* Enable ability to do full-text query on documents
Show alert modal on first pin for client
Add ability to use pins in stream/chat/embed
* typo and copy update
* simplify spread of context and sources
2024-02-21 13:15:45 -08:00
Sean Hatfield
17c1913ccc
[FEAT]: Allow user to set support email ( #726 )
...
* implement custom support email for usermenu support button
* small refactor
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-02-19 10:30:41 -08:00
Timothy Carambat
aad32db5e3
Migrate document processor to class ( #735 )
...
* Migrate document processor to class
* forgot "new"
2024-02-16 16:32:25 -08:00
Timothy Carambat
51dbff0dcb
Breakout Chat/Query mode as a workspace setting ( #734 )
...
Remove useless icons in prompt bar
Add chatMode column to workspaces that defaults to chat
Add UI for toggle of chat mode with hint
Update UI for workspace settings to match designs
2024-02-16 14:50:40 -08:00
Timothy Carambat
32233974c2
Enable Alpaca JSON export format ( #732 )
...
* Enable Alpaca JSON export format
* Replace dom download link with filesave for browser compat
Fix layout of exported json types for readability
2024-02-16 12:35:53 -08:00
Timothy Carambat
44c71013c8
Enforce name requirements for Zilliz/Milvus ( #723 )
2024-02-14 13:01:05 -08:00
Timothy Carambat
c59ab9da0a
Refactor LLM chat backend ( #717 )
...
* refactor stream/chat/embed-stram to be a single execution logic path so that it is easier to maintain and build upon
* no thread in sync chat since only api uses it
adjust import locations
2024-02-14 12:32:07 -08:00
Sean Hatfield
f4b09a8c79
[FEAT] RLHF on response messages ( #708 )
...
* WIP RLHF works on historical messages
* refactor Actions component
* completed RLHF up and down votes for chats
* add defaults for HistoricalMessage params
* refactor RLHF implmenation
remove forwardRef on history items to prevent rerenders
* remove dup id
* Add rating to CSV output
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-02-13 11:33:05 -08:00
Sean Hatfield
1b29882c71
[FEAT] Improved CSV chat exports ( #700 )
...
* add more fields to csv export to make more useful
* refactor from review comments
* fix escapeCsv function
* catch export errors properly
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-02-13 10:12:59 -08:00
timothycarambat
b1cc69848c
fix reset scope when non-threaded
2024-02-08 18:46:47 -08:00
Timothy Carambat
406732830f
Implement workspace threading that is backwards compatible ( #699 )
...
* Implement workspace thread that is compatible with legacy versions
* last touches
* comment on chat qty enforcement
2024-02-08 18:37:22 -08:00
Sean Hatfield
b985524901
[FEAT] Customizable footer icon links in Appearance Settings ( #694 )
...
* WIP custom footer icons
* UI for updating footer icons complete and backend to save/modify
* add backend for unprotected footer fetch
* break out footer into separate component and render footer items using a cache for 1 hour
* wip review
* refactor & cleanup
* Optimize footer form component
Optimize caching for footer icons
Add validation on SystemSetting upserts
Normalize fallback items for footer_data
* Adjust max icons to 3
* fix success message on remove
* fix success message on remove
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-02-08 12:17:01 -08:00
Timothy Carambat
f490c35456
Recover from fatal Ollama crash from LangChain library ( #693 )
...
Resolve fatal crash from Ollama failure
2024-02-07 16:23:17 -08:00
