Timothy Carambat
b23cb1a90f
Improve RAG results via chunkHeader append ( #1473 )
2024-05-21 14:43:39 -05:00
Timothy Carambat
cae6cee1b5
Do not go through LLM to embed when embedding documents ( #1428 )
2024-05-16 17:51:04 -07:00
Timothy Carambat
9655880cf0
Update all vector dbs to filter duplicate source documents that may be pinned ( #1122 )
...
* Update all vector dbs to filter duplicate parents
* cleanup
2024-04-17 18:04:39 -07:00
Timothy Carambat
24b523d5eb
append missing import for some vectordb providers ( #1066 )
2024-04-07 14:40:23 -07:00
Timothy Carambat
ce98ff4653
Enable customization of chunk length and overlap ( #1059 )
...
* Enable customization of chunk length and overlap
* fix onboarding link
show max limit in UI and prevent overlap >= chunk size
2024-04-06 16:38:07 -07:00
timothycarambat
718062d033
patch milvus/zilliz auto-generated collection name
...
resolves #1027
2024-04-03 12:34:23 -07:00
Timothy Carambat
44c71013c8
Enforce name requirements for Zilliz/Milvus ( #723 )
2024-02-14 13:01:05 -08:00
Sean Hatfield
56fa17caf2
create configurable topN per workspace ( #616 )
...
* create configurable topN per workspace
* Update TopN UI text
Fix fallbacks for all providers
Add SQLite CHECK to TOPN value
* merge with master
Update zilliz provider for variable TopN
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-18 12:34:20 -08:00
Timothy Carambat
658e7fa390
chore: Better VectorDb and Embedder error messages ( #620 )
...
* chore: propogate embedder and vectordb errors during document mutations
* add default value for errors on addDocuments
2024-01-18 11:40:48 -08:00
Timothy Carambat
d0a3f1e3e1
Fix present diminsions on vectorDBs to be inferred for providers who require it ( #605 )
2024-01-16 13:41:01 -08:00
Shuyoou
6faa0efaa8
Issue #543 support milvus vector db ( #579 )
...
* issue #543 support milvus vector db
* migrate Milvus to use MilvusClient instead of ORM
normalize env setup for docs/implementation
feat: embedder model dimension added
* update comments
---------
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-01-12 13:23:57 -08:00