Commit Graph

10 Commits

Author SHA1 Message Date
Timothy Carambat
719521c307
Document Processor v2 (#442)
* wip: init refactor of document processor to JS

* add NodeJs PDF support

* wip: partity with python processor
feat: add pptx support

* fix: forgot files

* Remove python scripts totally

* wip:update docker to boot new collector

* add package.json support

* update dockerfile for new build

* update gitignore and linting

* add more protections on file lookup

* update package.json

* test build

* update docker commands to use cap-add=SYS_ADMIN so web scraper can run
update all scripts to reflect this
remove docker build for branch
2023-12-14 15:14:56 -08:00
Sean Hatfield
7edfccaf9a
Adding url uploads to document picker (#375)
* WIP adding url uploads to document picker

* fix manual script for uploading url to custom-documents

* fix metadata for url scraping

* wip url parsing

* update how async link scraping works

* docker-compose defaults added
no autocomplete on URLs

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2023-11-16 17:15:01 -08:00
timothycarambat
7d3d0e03c6 bind docker to docker/.env so dumps persist between restarts 2023-11-01 22:12:30 -07:00
timothycarambat
3b85c196e9 update docker instructions and dockerfile container name 2023-09-30 15:10:27 -07:00
Jean-Francois Laflamme
882b362213
Added support for host.docker.internal (ie: to use local chromadb ser… (#195)
Added support for host.docker.internal (ie: to use local chromadb server)
2023-08-16 17:01:50 -07:00
Timothy Carambat
c4eb46ca19
Upload and process documents via UI + document processor in docker image (#65)
* implement dnd uploader
show file upload progress
write files to hotdirector
build simple flaskAPI to process files one off

* move document processor calls to util
build out dockerfile to run both procs at the same time
update UI to check for document processor before upload
* disable pragma update on boot
* dockerfile changes

* add filetype restrictions based on python app support response and show rejected files in the UI

* cleanup

* stub migrations on boot to prevent exit condition

* update CF template for AWS deploy
2023-06-16 16:01:27 -07:00
Preetesh Jain
74d7038a79
fix: add platform config in docker compose (#60) 2023-06-16 01:23:32 -07:00
Timothy Carambat
4dd1887bd1
Easy AWS cloud deployment for private instances via CloudFormation template (#52)
* wip

* fix file ref

* update dockerfile

* mute chown

* add build script for AWS CF template construction
add comment about script and AWS deployment

* move aws stuff into its own folder

* edit readme
2023-06-14 10:34:22 -07:00
Preetesh Jain
caea4ea1b2
Add support for CPU arch in Docker installation (#48)
* feat: add argument for cpu arch in dockerfile

* feat: add argument for cpu arch in docker compose

* docs: add steps about cpu arch based docker build
2023-06-14 09:29:11 -07:00
frasergr
9f33b3dfcb
Docker support (#34)
* Updates for Linux for frontend/server

* frontend/server docker

* updated Dockerfile for deps related to node vectordb

* updates for collector in docker

* docker deps for ODT processing

* ignore another collector dir

* storage mount improvements; run as UID

* fix pypandoc version typo

* permissions fixes
2023-06-13 11:26:11 -07:00