2023-06-13 22:19:17 +02:00
# How to use Dockerized Anything LLM
Use the Dockerized version of AnythingLLM for a much faster and complete startup of AnythingLLM.
## Requirements
- Install [Docker ](https://www.docker.com/ ) on your computer or machine.
2023-11-18 05:15:11 +01:00
## Pull from Docker
`docker pull mintplexlabs/anythingllm:master`
`docker run -d -p 3001:3001 mintplexlabs/anythingllm:master`
Go to `http://localhost:3001` and you are now using AnythingLLm!
## Build locally from source
2023-06-13 22:19:17 +02:00
- `git clone` this repo and `cd anything-llm` to get to the root directory.
2023-10-29 19:03:41 +01:00
- `touch server/storage/anythingllm.db` to create empty SQLite DB file.
2023-06-13 22:19:17 +02:00
- `cd docker/`
2023-11-02 06:12:30 +01:00
- `cp .env.example .env` **you must do this before building**
2023-06-16 10:23:32 +02:00
- `docker-compose up -d --build` to build the image - this will take a few moments.
2023-06-14 18:29:11 +02:00
Your docker host will show the image as online once the build process is completed. This will build the app to `http://localhost:3001` .
2023-06-13 22:19:17 +02:00
## How to use the user interface
2023-06-14 18:29:11 +02:00
- To access the full application, visit `http://localhost:3001` in your browser.
2023-06-13 22:19:17 +02:00
2023-10-29 19:03:41 +01:00
## How to add files to my system using the standalone scripts
2023-06-18 05:19:34 +02:00
- Upload files from the UI in your Workspace settings
2023-06-14 18:29:11 +02:00
- To run the collector scripts to grab external data (articles, URLs, etc.)
2023-06-13 22:19:17 +02:00
- `docker exec -it --workdir=/app/collector anything-llm python main.py`
2023-06-18 05:19:34 +02:00
- To run the collector watch script to process files from the hotdir
2023-06-13 22:19:17 +02:00
- `docker exec -it --workdir=/app/collector anything-llm python watch.py`
- Upload [compliant files ](../collector/hotdir/__HOTDIR__.md ) to `./collector/hotdir` and they will be processed and made available in the UI.
2023-06-18 05:19:34 +02:00
## About UID and GID in the ENV
- The UID and GID are set to 1000 by default. This is the default user in the Docker container and on most host operating systems. If there is a mismatch between your host user UID and GID and what is set in the `.env` file, you may experience permission issues.
2023-06-13 22:19:17 +02:00
## ⚠️ Vector DB support ⚠️
2023-06-14 18:29:11 +02:00
Out of the box, all vector databases are supported. Any vector databases requiring special configuration are listed below.
2023-06-13 22:19:17 +02:00
### Using local ChromaDB with Dockerized AnythingLLM
- Ensure in your `./docker/.env` file that you have
```
#./docker/.env
...other configs
VECTOR_DB="chroma"
CHROMA_ENDPOINT='http://host.docker.internal:8000' # Allow docker to look on host port, not container.
2023-09-29 22:20:06 +02:00
# CHROMA_API_HEADER="X-Api-Key" // If you have an Auth middleware on your instance.
# CHROMA_API_KEY="sk-123abc"
2023-06-13 22:19:17 +02:00
...other configs
```
2023-08-15 20:37:03 +02:00
## Common questions and fixes
2023-08-15 20:36:07 +02:00
2023-08-15 20:37:03 +02:00
### API is not working, cannot login, LLM is "offline"?
2023-08-15 20:36:07 +02:00
You are likely running the docker container on a remote machine like EC2 or some other instance where the reachable URL
is not `http://localhost:3001` and instead is something like `http://193.xx.xx.xx:3001` - in this case all you need to do is add the following to your `frontend/.env.production` before running `docker-compose up -d --build`
```
# frontend/.env.production
GENERATE_SOURCEMAP=false
VITE_API_BASE="http://< YOUR_REACHABLE_IP_ADDRESS > :3001/api"
```
For example, if the docker instance is available on `192.186.1.222` your `VITE_API_BASE` would look like `VITE_API_BASE="http://192.186.1.222:3001/api"` in `frontend/.env.production` .
2023-08-15 20:37:03 +02:00
### Still not working?
2023-06-13 22:19:17 +02:00
[Ask for help on Discord ](https://discord.gg/6UyHPeGZAC )