Update README.md
This commit is contained in:
@@ -59,9 +59,9 @@ Edit `.env.local`:
|
||||
DATABASE_URL=postgresql://user:password@localhost:5432/loam
|
||||
JWT_SECRET=change-this-to-a-long-random-string-in-production
|
||||
|
||||
# Optional — defaults shown
|
||||
# Optional — recommended local model shown
|
||||
OLLAMA_URL=http://localhost:11434
|
||||
OLLAMA_MODEL=llama3.1:8b
|
||||
OLLAMA_MODEL=qwen3:32b
|
||||
```
|
||||
|
||||
### 3. Set up the database
|
||||
@@ -77,9 +77,11 @@ npm run db:seed
|
||||
### 4. Pull an Ollama model (optional)
|
||||
|
||||
```bash
|
||||
ollama pull llama3.1:8b
|
||||
ollama pull qwen3:32b
|
||||
```
|
||||
|
||||
`qwen3:32b` is the recommended local model for the recommendation endpoint on a 32GB VRAM GPU such as the AMD Radeon AI PRO R9700. Use `qwen3:14b` if you want faster responses or need a smaller memory footprint.
|
||||
|
||||
### 5. Run the dev server
|
||||
|
||||
```bash
|
||||
@@ -90,6 +92,53 @@ Open [http://localhost:3000](http://localhost:3000).
|
||||
|
||||
---
|
||||
|
||||
## Docker
|
||||
|
||||
Build and run the web app plus PostgreSQL:
|
||||
|
||||
```bash
|
||||
docker compose up --build
|
||||
```
|
||||
|
||||
The app is exposed at [http://localhost:3333](http://localhost:3333). The Compose stack provides `DATABASE_URL` and `JWT_SECRET` for the app container.
|
||||
|
||||
The Docker image installs dependencies with `npm ci --ignore-scripts`; Prisma generation runs later in the builder stage after `prisma/schema.prisma` has been copied into the image. The base image also installs OpenSSL so Prisma's native query engine works on Alpine.
|
||||
|
||||
### Ollama in a Separate Container
|
||||
|
||||
The app expects Ollama at `OLLAMA_URL`. If Ollama runs in another container, expose port `11434` and point the app at that service or host address.
|
||||
|
||||
For an AMD GPU with ROCm, a typical Ollama container launch is:
|
||||
|
||||
```bash
|
||||
docker run --rm -it \
|
||||
--device=/dev/kfd \
|
||||
--device=/dev/dri \
|
||||
--group-add video \
|
||||
--group-add render \
|
||||
-v ollama:/root/.ollama \
|
||||
-p 11434:11434 \
|
||||
ollama/ollama:rocm
|
||||
```
|
||||
|
||||
Then pull the recommended model:
|
||||
|
||||
```bash
|
||||
ollama pull qwen3:32b
|
||||
```
|
||||
|
||||
If the app runs in Docker Compose and Ollama is bound to the host on Linux, set:
|
||||
|
||||
```yaml
|
||||
environment:
|
||||
OLLAMA_URL: http://host.docker.internal:11434
|
||||
OLLAMA_MODEL: qwen3:32b
|
||||
extra_hosts:
|
||||
- "host.docker.internal:host-gateway"
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Project structure
|
||||
|
||||
```
|
||||
@@ -225,4 +274,4 @@ Android commands are run from `android/`:
|
||||
| `DATABASE_URL` | Yes | — | PostgreSQL connection string |
|
||||
| `JWT_SECRET` | Yes | — | Secret for signing session JWTs |
|
||||
| `OLLAMA_URL` | No | `http://localhost:11434` | Ollama server base URL |
|
||||
| `OLLAMA_MODEL` | No | `llama3.1:8b` | Model name for recommendations |
|
||||
| `OLLAMA_MODEL` | No | `llama3.1:8b` | Model name for recommendations. `qwen3:32b` is recommended for a 32GB VRAM local GPU. |
|
||||
|
||||
Reference in New Issue
Block a user