kamp/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2024-11-19 04:30:10 +01:00
Code Issues Packages Projects Releases Wiki Activity
368 Commits 25 Branches 8 Tags 107 MiB
978cad476a
Commit Graph

368 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Timothy Carambat
5fa6145872
can now count and remove data in lancedb 0.1.12 so bumped version and added new functionality support (#155) 2023-07-20 13:09:56 -07:00
timothycarambat
ab9304b6dd move cloud deployment scripts and readmes into subfolder 2023-07-20 12:13:40 -07:00
Timothy Carambat
c1deca4928
[Fork] Batch embed by jwaltz (#153) 
* refactor: convert chunk embedding to one API call

* chore: lint

* fix chroma for batch and single vectorization of text

* Fix LanceDB multi and single vectorization

* Fix pinecone for single and multiple embeddings

---------

Co-authored-by: Jonathan Waltz <volcanicislander@gmail.com>
 2023-07-20 12:05:23 -07:00
Timothy Carambat
5a7d8add6f
[Fork] Additions on franzbischoff resolution on #122 (#152) 
* Related to Issue #122, Implemented custom prompt in workspace settings.

* run linter

* Remove code duplication for chat prompt injection

---------

Co-authored-by: Francisco Bischoff <franzbischoff@gmail.com>
 2023-07-20 11:14:23 -07:00
Olusegun Ajose
fdce3e99ea
Adding Digital Ocean Deployment using Terraform (#148) 
* Adding GCP Deployment Manager Template

* Adding GCP Deployment Manager Template

* Adding GCP Deployment Manager Template

* Update gcp/deployment/DEPLOY.md

Co-authored-by: David Blore <42894467+DavidBlore@users.noreply.github.com>

* Update gcp/deployment/DEPLOY.md

Co-authored-by: David Blore <42894467+DavidBlore@users.noreply.github.com>

* Update gcp/deployment/DEPLOY.md

Co-authored-by: David Blore <42894467+DavidBlore@users.noreply.github.com>

* Update DEPLOY.md

* Update DEPLOY.md

* Update DEPLOY.md

* Adding Digital Ocean Deployment using Terraform

* Adding Digital Ocean Deployment with Terraform

---------

Co-authored-by: David Blore <42894467+DavidBlore@users.noreply.github.com>
 2023-07-17 17:50:17 -07:00
Timothy Carambat
6d651db6d3
Enabled importing and exporting of entire AnythingLLM instance data (#146) 
* WIP on imports

* undo nodismiss for testing

* remove old keys modal screen
add helper text on import complete

* return default setting modal to keys
 2023-07-14 17:32:30 -07:00
timothycarambat
5b2c5cac08 make settings modal have tabs for future expansions 2023-07-14 15:04:25 -07:00
Olusegun Ajose
284fe6f356
Adding GCP Deployment Template (#142) 
* Adding GCP Deployment Manager Template

* Adding GCP Deployment Manager Template

* Adding GCP Deployment Manager Template

* Update gcp/deployment/DEPLOY.md

Co-authored-by: David Blore <42894467+DavidBlore@users.noreply.github.com>

* Update gcp/deployment/DEPLOY.md

Co-authored-by: David Blore <42894467+DavidBlore@users.noreply.github.com>

* Update gcp/deployment/DEPLOY.md

Co-authored-by: David Blore <42894467+DavidBlore@users.noreply.github.com>

* Update DEPLOY.md

* Update DEPLOY.md

* Update DEPLOY.md

---------

Co-authored-by: David Blore <42894467+DavidBlore@users.noreply.github.com>
 2023-07-14 10:15:05 -07:00
timothycarambat
c6d030f390 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2023-07-14 09:56:14 -07:00
timothycarambat
0207e147f1 update CFW launch with no credential option 2023-07-14 09:56:04 -07:00
AntonioCiolino
31e5db7490
Twitter Feature (#134) 
* .

* twitter feature update

* Key validation and operation
 2023-07-06 14:05:50 -07:00
Timothy Carambat
d7315b0e53
be able to parse relative and FQDN links from root reliabily (#138) 2023-07-05 14:40:54 -07:00
timothycarambat
032c9d27b6 UI updates and linting 2023-06-28 12:54:18 -07:00
AntonioCiolino
98d7266291
History per workspace (#126) 
* Enable saving history value per workspace

* added history

* added history

* Changes re: the PR for message limits from history
 2023-06-28 12:53:26 -07:00
Timothy Carambat
82d132427c
dump error message to frontend instead of generic error (#114) 2023-06-26 17:54:55 -07:00
Timothy Carambat
60a00843df
add ability to purge document from custom documents as well as cleanup its associated cache file (#113) 
* add ability to purge document from custom documents as well as cleanup its assoicated cache file

* update alert text
 2023-06-26 17:20:09 -07:00
Timothy Carambat
9d0becb2ee
Add chat/converstaion mode as the default chat mode for all Vector Databases (#112) 
* Add chat/converstaion mode as the default chat mode
Show menu for toggling options for chat/query/reset command
Show chat status below input
resolves #61

* remove console logs
 2023-06-26 15:08:47 -07:00
Timothy Carambat
a3f5a936e2
Enable debug mode of ENV at runtime (#111) 
* Enable debug mode of ENV at runtime
Update Storage README for those with SQLite issues

* add files
 2023-06-26 11:38:38 -07:00
mplawner
3efe55a720
Added mbox support (#106) 
* Update filetypes.py

Added mbox format

* Created new file

Added support for mbox files as used by many email services, including Google Takeout's Gmail archive.

* Update filetypes.py

* Update as_mbox.py
 2023-06-25 18:11:05 -07:00
AntonioCiolino
a52b0ae655
Updated Link scraper to avoid NoneType error. (#90) 
* Enable web scraping based on a urtl and a simple filter.

* ignore yarn

* Updated Link scraper to avoid NoneType error.
 2023-06-19 12:07:26 -07:00
frasergr
4072369f44
updated instructions in docker readme (#79) 2023-06-17 20:19:34 -07:00
frasergr
4079020de0
dockerfile cleanup; enforce text LF line endings (#81) 2023-06-17 20:18:01 -07:00
Timothy Carambat
3945a77290
Add mobile stylings to UI (#75) 
* initial chat pages mobile stylings

* fix sidebar

* manage workspace modal styles

* mobile styles v1
 2023-06-16 23:50:56 -07:00
AntonioCiolino
e7ba028497
Enable web scraping based on a urtl and a simple filter. (#73) 2023-06-16 17:29:11 -07:00
timothycarambat
81b2159329 reorder docs 2023-06-16 17:26:42 -07:00
Timothy Carambat
c4eb46ca19
Upload and process documents via UI + document processor in docker image (#65) 
* implement dnd uploader
show file upload progress
write files to hotdirector
build simple flaskAPI to process files one off

* move document processor calls to util
build out dockerfile to run both procs at the same time
update UI to check for document processor before upload
* disable pragma update on boot
* dockerfile changes

* add filetype restrictions based on python app support response and show rejected files in the UI

* cleanup

* stub migrations on boot to prevent exit condition

* update CF template for AWS deploy
 2023-06-16 16:01:27 -07:00
AntonioCiolino
537a6a91d2
Update __HOTDIR__.md (#70) 
fixed typo for text.
 2023-06-16 11:17:18 -07:00
Timothy Carambat
cf9bb99701
resolves #46 (#66) 
ignore storage folder changes for nodemon
 2023-06-16 01:29:26 -07:00
Preetesh Jain
74d7038a79
fix: add platform config in docker compose (#60) 2023-06-16 01:23:32 -07:00
Timothy Carambat
2a556c275c
Implement Workspace-specific setting configs + other technical features (#58) 
* 1. Define LLM Temperature as a workspace setting
2. Implement rudimentry table migration code for both new and existing repos to bring tables up to date
3. Trigger for workspace on update to update timestamp
4. Always fallback temp to 0.7
5. Extract WorkspaceModal into Tabbed content
6. Remove workspace name UNIQUE constraint (cannot be migrated :()
7. Add slug +seed when existing slug is already take
8. Seperate name from slug so display names can be changed

* remove blocking test return
 2023-06-14 23:12:59 -07:00
Skid Vis
4118c9dcf3
Blocks images in sitemaps from being parsed. (#56) 
* Adds ability to import sitemaps to include a website

* adds example sitemap url

* adds filter to bypass common image formats

* moves filetype ignoring to sitemap script
 2023-06-14 23:00:03 -07:00
Timothy Carambat
2403806949
add codeblock support for prompt replies and historical messages (#55) 
* add codeblock support for prompt replies and historical messages
add markdown-it

* Fix spacing for HTML rendering
 2023-06-14 13:35:55 -07:00
Skid Vis
bd32f97a21
Adds ability to import sitemaps to include a website (#51) 
* Adds ability to import sitemaps to include a website

* adds example sitemap url
 2023-06-14 11:04:17 -07:00
timothycarambat
040e0d3df7 remove chalk dep for cloudformation document generator 2023-06-14 11:02:46 -07:00
timothycarambat
668a49c826 update cf generation script to not crash docker deployment 2023-06-14 10:53:27 -07:00
Timothy Carambat
4dd1887bd1
Easy AWS cloud deployment for private instances via CloudFormation template (#52) 
* wip

* fix file ref

* update dockerfile

* mute chown

* add build script for AWS CF template construction
add comment about script and AWS deployment

* move aws stuff into its own folder

* edit readme
 2023-06-14 10:34:22 -07:00
Preetesh Jain
caea4ea1b2
Add support for CPU arch in Docker installation (#48) 
* feat: add argument for cpu arch in dockerfile

* feat: add argument for cpu arch in docker compose

* docs: add steps about cpu arch based docker build
 2023-06-14 09:29:11 -07:00
timothycarambat
ca8e8245fc remove lancedb logging 2023-06-14 00:27:19 -07:00
timothycarambat
5c933cba17 dont ignore frontend prod envs during docker build 2023-06-13 16:57:26 -07:00
Jonathan Waltz
84a5707d6d
refactor: convert insert loop to 1 insert stmt (#19) 
* fix: convert insert loop to 1 insert stmt

* chore: lint
 2023-06-13 14:07:58 -07:00
timothycarambat
c6f69fc0a6 add Docker setup to Readme.md 2023-06-13 13:25:56 -07:00
timothycarambat
e114a90a17 update package scripts 
update ignore for legacy repo copies
add docker instructions and use
 2023-06-13 13:19:17 -07:00
frasergr
9f33b3dfcb
Docker support (#34) 
* Updates for Linux for frontend/server

* frontend/server docker

* updated Dockerfile for deps related to node vectordb

* updates for collector in docker

* docker deps for ODT processing

* ignore another collector dir

* storage mount improvements; run as UID

* fix pypandoc version typo

* permissions fixes
 2023-06-13 11:26:11 -07:00
Tim Asp
ebd3a62866
update readme with build instructions (#41) 2023-06-12 21:56:29 -07:00
Matt Farmer
9092b0b55b
Fix link to Vector Caching in README.md (#38) 2023-06-12 21:48:10 -07:00
Tim Asp
6eff067c98
Fix small react and JS errors (#40) 
* Fix react html console errors

* Fix bug where clicking expand on empty directory throws error
 2023-06-12 21:46:36 -07:00
Fabio
d954d7a3d5
Fix pypandoc issue in requirements.txt (#23) 
Co-authored-by: Carvalho, Fabio <Fabio_Carvalho@comcast.com>
 2023-06-12 11:21:11 -07:00
timothycarambat
ef785af3f0 remove unused dep 2023-06-12 10:37:07 -07:00
Timothy Carambat
f9015df903
fix input color (#17) 2023-06-09 16:21:55 -07:00
Timothy Carambat
fa2b669940
resolves #14 (#15) 2023-06-09 12:59:22 -07:00