Timothy Carambat
b4651aff35
Support gpt-4o for Azure deployments ( #2182 )
2024-08-26 14:35:42 -07:00
Timothy Carambat
22ecb7cb39
Add RAG agent plugin to API agent ( #2171 )
2024-08-23 09:32:19 -07:00
Timothy Carambat
2de9e492ec
Enabled use of @agent (and skills) via dev API calls ( #2161 )
...
* Use `@agent` via dev API
* Move EphemeralEventListener to same file as agent
2024-08-22 13:12:09 -07:00
Timothy Carambat
fdc3add53c
Api session id support ( #2158 )
...
* Refactor api endpoint chat handler to its own function
remove legacy `chatWithWorkspace` and cleanup `index.js`
* Add `sessionId` in dev API to partition chats logically statelessly
2024-08-21 15:25:47 -07:00
timothycarambat
2d2e49bc00
fix missing export
2024-08-21 14:58:56 -07:00
Timothy Carambat
1f96b837b3
Refactor api endpoint chat handler to its own function ( #2157 )
...
remove legacy `chatWithWorkspace` and cleanup `index.js`
2024-08-21 14:47:06 -07:00
timothycarambat
cb7cb2d976
Add 405B to perplexity
2024-08-19 12:26:22 -07:00
Timothy Carambat
a8d25c7dd3
Allow readable username passed in script widget ( #2131 )
2024-08-16 16:55:42 -07:00
Timothy Carambat
c8fe254d45
Omit invalid response.text values and prompts ( #2127 )
...
* Omit invalid `response.text` values and `prompts`
resolves #2108
* remove import
2024-08-15 14:22:27 -07:00
Timothy Carambat
99f2c25b1c
Agent Context window + context window refactor. ( #2126 )
...
* Enable agent context windows to be accurate per provider:model
* Refactor model mapping to external file
Add token count to document length instead of char-count
refernce promptWindowLimit from AIProvider in central location
* remove unused imports
2024-08-15 12:13:28 -07:00
Shahar
4365d69359
Fix TypeError by replacing this.openai.createChatCompletion with the correct function call ( #2117 )
...
fixed new api syntax
2024-08-14 14:39:48 -07:00
Timothy Carambat
4430ddb059
Encryption in JWT for single-user password mode ( #2111 )
...
* wip encrypting jwt value
* Encrypt/Decrypt pass in JWT value for verification in single-user password mode
2024-08-13 17:54:12 -07:00
PyKen
a2571024a9
Add prompt window limits for gpt-4o-* models ( #2104 )
2024-08-13 09:13:36 -07:00
Timothy Carambat
f06ef6180d
add exp model to v1Beta ( #2082 )
2024-08-09 14:19:49 -07:00
Timothy Carambat
d072875e43
Add piperTTS in-browser text-to-speech ( #2052 )
...
* Add piperTTS in-browser text-to-speech
* update vite config
* Add voice default + change prod public URL
* uncheck file
* Error handling
bump package for better quality and voices
* bump package
* Remove pre-packed WASM - will not support offline first solution for docker
* attach TTSProvider telem
2024-08-07 11:09:51 -07:00
Sean Hatfield
6666fff0c2
Support multiple preset prompts in single message ( #2036 )
...
support multiple preset prompts in single message
2024-08-06 10:27:36 -07:00
Sean Hatfield
7273c892a1
Ollama performance mode option ( #2014 )
...
* ollama performance mode option
* Change ENV prop
Move perf setting to advanced
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-08-02 13:29:17 -07:00
Timothy Carambat
ba8e4e5d3e
handle OpenRouter exceptions on streaming ( #2033 )
2024-08-02 12:23:39 -07:00
RahSwe
c55ef33fce
Gemini Pro 1.5, API support for 2M context and new experimental model ( #2031 )
2024-08-02 10:24:31 -07:00
timothycarambat
6dc3642661
Patch Groq preview models maxed to 8K tokens due to warning
2024-08-01 09:24:57 -07:00
timothycarambat
466bf7dc9c
Bump Perplexity and Together AI static model list
2024-07-31 10:58:34 -07:00
Timothy Carambat
38fc181238
Add multimodality support ( #2001 )
...
* Add multimodality support
* Add Bedrock, KoboldCpp,LocalAI,and TextWebGenUI multi-modal
* temp dev build
* patch bad import
* noscrolls for windows dnd
* noscrolls for windows dnd
* update README
* update README
* add multimodal check
2024-07-31 10:47:49 -07:00
Timothy Carambat
5e73dce506
Enable editing of OpenRouter stream timeout for slower connections ( #1994 )
2024-07-29 11:49:14 -07:00
timothycarambat
296f041564
path perplexity model ids
...
closes #1990
2024-07-28 16:29:18 -07:00
timothycarambat
7a2ffefdc3
update case stmt for duplicate groq model
2024-07-25 17:39:29 -07:00
Timothy Carambat
04a0fc4ec9
Remove unused deps ( #1938 )
...
* Remove unused deps
* improve dependency
2024-07-25 10:21:03 -07:00
Timothy Carambat
61e214aa8c
Add support for Groq /models endpoint ( #1957 )
...
* Add support for Groq /models endpoint
* linting
2024-07-24 08:35:52 -07:00
Timothy Carambat
23de85a3bd
Revert odbc support ( #1936 )
...
* Revert "Patch ODBC support from missing binary/headers for node-odbc"
This reverts commit 9de6b1cc26#1933 )"
This reverts commit cd597a361e
2024-07-23 17:27:39 -07:00
Timothy Carambat
9366e69d88
Add AWS bedrock support for LLM + agents ( #1935 )
...
add AWS bedrock support for LLM + agents
2024-07-23 16:35:37 -07:00
Timothy Carambat
cd597a361e
OBDC Support ( #1933 )
...
* add possibility to connect to SQL Base by ODBC
---------
Co-authored-by: suchaudn <nicolas.suchaud@legrand.fr>
Co-authored-by: nicho2 <nicho2@laposte.net>
2024-07-23 12:42:53 -07:00
Timothy Carambat
42235fcd8a
GitLab Hosted and Local Connector ( #1932 )
...
* Add support for GitLab repo collection as well as Github Repo collection
* Refactor for repo collectors to be more compact
---------
Co-authored-by: Emil Rofors <emirof@gmail.com>
2024-07-23 12:23:51 -07:00
Timothy Carambat
76aa2a4fd4
Implement support for selecting basic keep_alive times for Ollama ( #1920 )
2024-07-22 14:44:47 -07:00
timothycarambat
2185753068
patch text.substring bug from compressor
2024-07-22 12:53:11 -07:00
Timothy Carambat
3198718975
Update references to new domain ( #1916 )
2024-07-22 11:05:34 -07:00
timothycarambat
f15529653f
patch logger for full logs
2024-07-19 18:35:41 -07:00
timothycarambat
cec1a3d585
append stacktraces to winston
2024-07-19 18:13:54 -07:00
Timothy Carambat
b5a2437bb5
patch docker scount CVE in old express-ws pkg ( #1907 )
...
* patch CVE in old express-ws pkg
* patch workflow
* remove dev-image
2024-07-19 17:40:22 -07:00
Timothy Carambat
8180787c2e
Enable editing and setting of meta-tag information ( #1892 )
...
* Enable editing and setting of meta-tag information
* cleanup
* tmp build for testing
* finally always refresh
* unset workflow
* dev build
* rm tmp build
2024-07-19 15:58:43 -07:00
Timothy Carambat
5df6b5f7d9
Bump perplexity models ( #1905 )
...
* Added Supported Models Free Tier - chat_models.txt
Need to fill in correct Parameter Count.
* Bump perplexity model
closes #1901
closes #1900
---------
Co-authored-by: Tim-Hoekstra <135951177+Tim-Hoekstra@users.noreply.github.com>
2024-07-19 15:11:10 -07:00
timothycarambat
86a66ba569
change alpaca format to include citations and system prompt
2024-07-15 16:05:53 -07:00
Sean Hatfield
8f0af88332
[FIX] Fix manual input model pref for agents ( #1848 )
...
* patch llm providers that have manual inputs for model pref
* refactor agent model fallback
update UI to show disabled providers to stop questions about provider limitations
* patch log on startup
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-07-11 14:03:24 -07:00
timothycarambat
8658b1e7c7
linting
2024-07-03 18:25:44 -07:00
Timothy Carambat
29c9eeaa5c
Add winston logging for production ( #1811 )
2024-07-03 16:39:33 -07:00
timothycarambat
89538c3614
fix typo in agent debug logs
2024-07-03 14:02:33 -07:00
Timothy Carambat
cb6b3340f0
Update bgworker to use fork instead of worker_thread ( #1808 )
2024-07-03 11:44:34 -07:00
Timothy Carambat
0b845fbb1c
Deprecate .isSafe moderation ( #1790 )
...
Add type defs to helpers
2024-06-28 15:32:30 -07:00
Sean Hatfield
910eb36cfe
[FIX] OpenAI compatible endpoints query mode developer API bug fix ( #1789 )
...
fix query mode always responding with refusal message on develop api openai compatible endpoints
2024-06-28 14:23:16 -07:00
Timothy Carambat
7a78ad3960
Apply workspace topN to agent call ( #1779 )
...
resolves #1777
2024-06-27 17:58:28 -07:00
Timothy Carambat
9bd65f1567
[CHORE] Migration from vectordb to @lancedb/lancedb NodeJS SDK ( #1766 )
...
WIP on migration to @lancedb/lancedb NodeJS SDK
2024-06-26 21:57:16 -07:00
Sean Hatfield
dde8bc238b
[FIX] Remove Azure URL validation ( #1758 )
...
remove azure url validation
2024-06-25 12:10:51 -07:00
Timothy Carambat
88a0335fd2
Add OpenAI compatible API support ( #1757 )
2024-06-24 18:28:21 -07:00
Sean Hatfield
e72fa8b370
[FEAT] Generic OpenAI embedding provider ( #1664 )
...
* implement generic openai embedding provider
* linting
* comment & description update for generic openai embedding provider
* fix privacy for generic
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-06-21 16:27:02 -07:00
Timothy Carambat
dc4ad6b5a9
[BETA] Live document sync ( #1719 )
...
* wip bg workers for live document sync
* Add ability to re-embed specific documents across many workspaces via background queue
bgworkser is gated behind expieremental system setting flag that needs to be explictly enabled
UI for watching/unwatching docments that are embedded.
TODO: UI to easily manage all bg tasks and see run results
TODO: UI to enable this feature and background endpoints to manage it
* create frontend views and paths
Move elements to correct experimental scope
* update migration to delete runs on removal of watched document
* Add watch support to YouTube transcripts (#1716 )
* Add watch support to YouTube transcripts
refactor how sync is done for supported types
* Watch specific files in Confluence space (#1718 )
Add failure-prune check for runs
* create tmp workflow modifications for beta image
* create tmp workflow modifications for beta image
* create tmp workflow modifications for beta image
* dual build
update copy of alert modals
* update job interval
* Add support for live-sync of Github files
* update copy for document sync feature
* hide Experimental features from UI
* update docs links
* [FEAT] Implement new settings menu for experimental features (#1735 )
* implement new settings menu for experimental features
* remove unused context save bar
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
* dont run job on boot
* unset workflow changes
* Add persistent encryption service
Relay key to collector so persistent encryption can be used
Encrypt any private data in chunkSources used for replay during resync jobs
* update jsDOC
* Linting and organization
* update modal copy for feature
---------
Co-authored-by: Sean Hatfield <seanhatfield5@gmail.com>
2024-06-21 13:38:50 -07:00
timothycarambat
c176fe38d2
remove async on dumpEnv
2024-06-20 20:50:14 -07:00
timothycarambat
ed53bbcf15
Merge branch 'master' of github.com:Mintplex-Labs/anything-llm
2024-06-20 18:03:33 -07:00
timothycarambat
9411791fe5
Simplify ENV management
...
auto write ENV on changes
Dont double-track envs that are already tracked
2024-06-20 18:03:21 -07:00
Sean Hatfield
c2523a9593
[FEAT] Persist query mode refusal responses as chat history ( #1727 )
...
* log query refusals to workspace chats but hide in ui
* linting
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-06-20 15:44:19 -07:00
Timothy Carambat
8b1ceb30c1
Add support for searXNG search for agents ( #1733 )
...
resolves #1367
2024-06-20 14:08:00 -07:00
Sean Hatfield
524edd6e69
[FEAT] Add support for Claude Sonnet 3.5 model ( #1731 )
...
add support for claude sonnet 3.5 model
2024-06-20 10:13:53 -07:00
timothycarambat
05870ec8d0
chore: update no agent error message
...
style: update error message width
2024-06-12 13:19:06 -07:00
timothycarambat
4f15f95f53
hotfix: fix bad semantic HTML
...
feat: add /reset to bailout for agent session
fix: patch save-to-browser not enabling
2024-06-12 12:43:06 -07:00
timothycarambat
394b5aafb6
linting
2024-06-10 15:22:32 -07:00
Serply
7693240e21
1646-added serply ( #1647 )
...
* added serply search api
* undo remove of new line
---------
Co-authored-by: teampen <136991215+teampen@users.noreply.github.com>
2024-06-10 15:17:41 -07:00
Timothy Carambat
d470845931
feat: expand summarization to OSS LLM ( #1648 )
2024-06-10 14:31:39 -07:00
Sean Hatfield
1b8386b079
[FIX] ChromaDB namespace normalization ( #1625 )
...
* chromadb namespace normalization
* update normalization function with more clarity
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-06-06 15:38:05 -07:00
Anush
771889ad7f
[FIX] Incorrect vectors count with Qdrant ( #1561 )
...
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-06-06 13:18:01 -07:00
Sean Hatfield
26c220503c
[FEAT] Edit message button ( #1392 )
...
* WIP edit message feature
* WIP edit message
* WIP editing messages feature
* Fix PFPs
TODO: Fix default user profile image
Add User and Assistant workspace response
* unset PFP changes for later PR
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-06-06 12:56:11 -07:00
Sean Hatfield
d29292ebd2
[FEAT] Add LiteLLM embedding provider support ( #1579 )
...
* add liteLLM embedding provider support
* update tooltip id
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-06-06 12:43:34 -07:00
Sean Hatfield
3f78ef413b
[FEAT] Support for gemini-1.0-pro model and fixes to prompt window limit ( #1557 )
...
support for gemini-1.0-pro model and fixes to prompt window limit
2024-05-29 08:17:35 +08:00
Sean Hatfield
c24b79c9d1
[FEAT] Bing Search API web search provider ( #1519 )
...
implement bing search engine for agents
2024-05-23 16:49:30 -07:00
Timothy Carambat
a89812703b
repatch path normalization ( #1516 )
2024-05-23 12:52:04 -07:00
Timothy Carambat
2f9b785f42
Patch handling of end chunk stream events for OpenAI endpoints ( #1487 )
...
* Patch handling of end chunk stream events for OpenAI endpoints
* update LiteLLM to use generic handler
* update for empty choices
2024-05-23 10:20:40 -07:00
Timothy Carambat
13fb63930b
Improve RAG responses via source backfilling ( #1477 )
...
* Improve RAG responses via source backfilling
* Hide irrelevant citations from UI
2024-05-23 09:56:57 -07:00
Sean Hatfield
cc7e7fb3ac
[FEAT] Add support for gemini-1.5-flash-latest model ( #1502 )
...
* add support for gemini-1.5-flash-latest
* update comment in gemini LLM provider
2024-05-23 09:42:30 -07:00
timothycarambat
961630f7d5
fix example call param
2024-05-23 08:29:25 -07:00
timothycarambat
7bace20769
Improve VoyageAI error responses and textChunk handler
...
resolves #1491
2024-05-22 13:42:48 -05:00
Timothy Carambat
8c5a30db9d
Support dynamic context length - VoyageAI ( #1489 )
2024-05-22 10:53:49 -05:00
Shixian Sheng
a256db132d
Fixed links ( #1485 )
...
* Update CHROMA_SETUP.md
* Update ASTRA_SETUP.md
2024-05-22 10:06:39 -05:00
timothycarambat
9f327d015a
update error handling for OpenAI providers
2024-05-22 09:58:10 -05:00
Timothy Carambat
b23cb1a90f
Improve RAG results via chunkHeader append ( #1473 )
2024-05-21 14:43:39 -05:00
Timothy Carambat
28eba636e9
Allow setting of safety thresholds for Gemini ( #1466 )
...
* Allow setting of safety thresholds for Gemini
* linting
2024-05-20 13:17:00 -05:00
Sean Hatfield
5bf4b4db58
[FEAT] Add support for Voyage AI embedder ( #1401 )
...
* add support for voyageai embedder
* remove unneeded import
* linting
* Add ENV examples
Update how chunks are processed for Voyage
use correct langchain import
Add data handling
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-05-19 13:20:23 -05:00
Timothy Carambat
9ace0e67e6
Validate max_tokens is number ( #1445 )
2024-05-17 21:44:55 -07:00
Timothy Carambat
1a5aacb001
Support multi-model whispers ( #1444 )
2024-05-17 21:31:29 -07:00
timothycarambat
3794ef8dfd
patch: use workspace LLM for embed chats and fallback to system
...
resolves #1439
2024-05-17 17:33:19 -07:00
Timothy Carambat
f140139534
Patch WSS upgrade for manual HTTPS certs ( #1429 )
...
* Patch WSS upgrade for manual HTTPS certs
* update comment
* refactor
2024-05-17 14:03:25 -07:00
Timothy Carambat
cae6cee1b5
Do not go through LLM to embed when embedding documents ( #1428 )
2024-05-16 17:51:04 -07:00
Timothy Carambat
01cf2fed17
Make native embedder the fallback for all LLMs ( #1427 )
2024-05-16 17:25:05 -07:00
Sean Hatfield
826ef00da3
[FEAT] LiteLLM provider support ( #1424 )
...
* litellm LLM provider support
* fix lint error
* change import orders
fix issue with model retrieval
---------
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-05-16 13:56:28 -07:00
Timothy Carambat
15cf921616
Support SQL Agent skill ( #1411 )
...
* Support SQL Agent skill
* add MSSQL agent connector
* Add frontend to agent skills
remove FAKE_DB mock
reset skills to pickup child-skill dynamically
* add prompt examples for tools on untooled
* add better logging on SQL agents
* Wipe toolruns on each chat relay so tools can be used within the same session
* update comments
2024-05-16 10:38:21 -07:00
Timothy Carambat
b6be43be95
Add Speech-to-text and Text-to-speech providers ( #1394 )
...
* Add Speech-to-text and Text-to-speech providers
* add files and update comment
* update comments
* patch: bad playerRef check
2024-05-14 11:57:21 -07:00
Timothy Carambat
64b62290d7
Set gpt-4o as default for OpenAI ( #1391 )
2024-05-13 14:31:49 -07:00
Sean Hatfield
9ed2309757
[FEAT] Add API key support for Oobabooga Web UI ( #1354 )
...
* add api key support for oobabooga web ui
* dont expose API Key for TextWebGenUi
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-05-13 12:58:16 -07:00
timothycarambat
a87978d1d9
Make LanceDB the vector database default provider in backend to prevent issues where somehow this key is not set by the user resulting in a Pinecone error even though they never said they wanted Pinecone to be their vector db
2024-05-13 12:22:53 -07:00
Sean Hatfield
948ac8a3dd
[FIX] Validate messages schema for gemini provider ( #1351 )
...
validate messages schema for gemini provider
2024-05-10 17:33:25 -07:00
Timothy Carambat
7b18a36288
prevent accidental lockout from restricted chars in single pass mode ( #1352 )
...
* prevent accidental lockout from restrict chars in single pass mode
* update error message
2024-05-10 17:29:49 -07:00
Timothy Carambat
98953d70b7
Fix typo leading to agent history in threads not being unique in same workspace ( #1350 )
2024-05-10 16:09:34 -07:00
Sean Hatfield
0a6a9e40c1
[FIX] Add max tokens field to generic OpenAI LLM connector ( #1345 )
...
* add max tokens field to generic openai llm connector
* add max_tokens property to generic openai agent provider
2024-05-10 14:49:02 -07:00
Sean Hatfield
d36c3ff8b2
[FEAT] Slash templates ( #1314 )
...
* WIP slash presets
* WIP slash command customization CRUD + validations complete
* backend slash command support
* fix permission setting on new slash commands
rework form submit and pattern on frontend
* Add field updates for hooks,
required=true to field
add user<>command constraint to keep them unique
enforce uniquness via teritary uid field on table for multi and non-multi user
* reset migration
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-05-10 12:35:33 -07:00
Timothy Carambat
81bc16cc39
More agent providers ( #1316 )
...
* add OpenRouter support
* add mistral agents
add perplexity agents
add textwebgenui agents
2024-05-08 16:04:18 -07:00
