Add ollama service to docker compose

Author: kat

README.md

@@ -47,18 +47,24 @@ Choose models based on your system capabilities:
 | **Chat** | `phi3:mini` | ~2.3GB | 4GB | Low-resource systems |
 
 
+### Installation Options
+
+Choose your preferred installation method:
+
+### Option 1: Direct Installation
 
-### Prerequisites (Required for Both Installation Methods)
+**Prerequisite: Ollama (for local AI models)**
+
+Install Ollama
 
-**1. Install Ollama** (for local AI models):
 ```bash
 # macOS
 brew install ollama
 
 # Or download from https://ollama.com
 ```
+ Start Ollama and install required models
 
-**2. Start Ollama and install required models**:
 ```bash
 ollama serve
 
@@ -69,11 +75,7 @@ ollama pull nomic-embed-text
 ollama pull qwen3:14b
 ```
 
-### Installation Options
-
-Choose your preferred installation method:
 
-### Option 1: Direct Installation
 
 **Additional Prerequisites:**
 - Python 3.8+
@@ -106,7 +108,10 @@ Choose your preferred installation method:
 
 ### Option 2: Docker Installation
 
-**Additional Prerequisites:**
+With this option, you don't need to separately install Ollama, it will automatically
+get started by docker compose.
+
+**Prerequisites:**
 - Docker and Docker Compose
 
 **Installation Steps:**
@@ -122,7 +127,17 @@ Choose your preferred installation method:
    docker-compose up
    ```
 
-3. **Open your browser** to `http://localhost:8501`
+3. **Install models**
+
+   ```
+   # embedding model
+   docker exec -it ollama ollama pull nomic-embed-text
+   
+   # chat model
+   docker exec -it ollama ollama pull qwen3:14b
+   ```
+
+4. **Open your browser** to `http://localhost:8501`
 
 ## 📖 How to Use
 

docker-compose.yml

@@ -11,10 +11,19 @@ services:
       - "8501:8501"
     environment:
       # Configure Ollama connection (both env vars for compatibility)
-      - OLLAMA_HOST=http://host.docker.internal:11434
-      - OLLAMA_BASE_URL=http://host.docker.internal:11434
+      - OLLAMA_HOST=ollama:11434
+      - OLLAMA_BASE_URL=http://ollama:11434
     restart: unless-stopped
     volumes:
       - ./data:/app/data  # For persistent data storage
-    extra_hosts:
-      - "host.docker.internal:host-gateway" 
+
+  ollama:
+    image: docker.io/ollama/ollama:latest
+    container_name: ollama
+    pull_policy: always
+    tty: true
+    restart: always
+    environment:
+      - OLLAMA_KEEP_ALIVE=24h
+      - OLLAMA_HOST=0.0.0.0
+      - OLLAMA_PORT=11434