Commit Graph

14 Commits

Author SHA1 Message Date
CloudRay
0e6bd030e9
Fix Docker container exit issue by changing ownership (#714)
Co-authored-by: cloud-ray <ray@cybersavvy.one>
2024-02-13 09:24:20 -08:00
Timothy Carambat
4f6d93159f
improve native embedder handling of large files (#584)
* improve native embedder handling of large files

* perf changes

* ignore storage tmp
2024-01-13 00:32:43 -08:00
Timothy Carambat
b2b2c2afe1
protect AWS CF deployments by automatically blocking metadata URL (#578) 2024-01-11 18:37:00 -08:00
Timothy Carambat
719521c307
Document Processor v2 (#442)
* wip: init refactor of document processor to JS

* add NodeJs PDF support

* wip: partity with python processor
feat: add pptx support

* fix: forgot files

* Remove python scripts totally

* wip:update docker to boot new collector

* add package.json support

* update dockerfile for new build

* update gitignore and linting

* add more protections on file lookup

* update package.json

* test build

* update docker commands to use cap-add=SYS_ADMIN so web scraper can run
update all scripts to reflect this
remove docker build for branch
2023-12-14 15:14:56 -08:00
Timothy Carambat
d094cc3c10
docs: update deployment templates to just pull the docker image (#445)
docs: update deployment templates to just pull the docker image and boot that instead of building
2023-12-13 19:55:23 -08:00
Timothy Carambat
1a6f599971
update docker build instructions (#412)
* update docker build instructions

* cleanup
2023-12-06 11:27:38 -08:00
timothycarambat
c3fa67bc86 Update AWS deployment 2023-10-29 13:06:43 -07:00
Timothy Carambat
9242578263
Aws docker fixes (#309)
* WIP aws fixes to latest changes;

* change default in docker env

* bump storage default for docker

* Updates to docker deployment
2023-10-29 11:03:41 -07:00
santini-cyber
d1fbe94a33
Instructions for https configuration on an AWS EC2 instance running A… (#276)
* Instructions for https configuration on an AWS EC2 instance running Amazon Linux 2023.

* Update aws_https_instructions.md

* Update aws_https_instructions.md
2023-10-20 11:10:50 -07:00
santini-cyber
e4a5fe5971
changing the build behavior in the aws cloudformation template from [… (#247)
changing the build behavior in the aws cloudformation template from [scripts-user, always] to [scripts-user, once-per-instance] so the userdata script is not run every time the server boots.
2023-09-25 20:51:39 -07:00
timothycarambat
320aefb687 drop support for dockerized image AMI 2023-07-26 18:14:17 -07:00
timothycarambat
c130f483d6 typo fix 2023-07-20 21:30:17 -07:00
timothycarambat
5eed8b66f5 update AWS launch to use public AMI 2023-07-20 16:40:48 -07:00
timothycarambat
ab9304b6dd move cloud deployment scripts and readmes into subfolder 2023-07-20 12:13:40 -07:00