Bake-off M3: qwen3.8 vs qwen3.6 gemessen; Topologie korrigiert (Remote-GPU-Maschine)
Zwischenstand Bake-off (Antwortmodus, 35 Goldset-Fragen): qwen3.8:27b 100% Zitier-Praezision / 94,3% Verweigerung korrekt / 32s; qwen3.6:27B 94,3% / 85,7% / 43s (10 Regenerierungen) - klar schwächer. Topologie korrigiert: 100.103.83.12:11435 ist die Remote-GPU-Maschine (Tailscale, R9700), NICHT dieselbe wie die Dev-Maschine (deren localhost: 11434 ist ein eigener, fast leerer Ollama; URL-Nicht-auf-11434-Korrigieren in Skill/README/Config präzisiert). bge-m3 auf der GPU-Maschine gepullt. gemma4:26b-Lauf brach ab: auf der GPU-Maschine sterben seit dem Crash alle llama-server-Loads (API 500 'exit status 1'), auch bge-m3. Neustart dort noetig: sudo systemctl restart ollama. Danach mistral-small3.1:24b und gemma4:12B ausstehen.
This commit is contained in:
@@ -39,11 +39,13 @@ touches Odoo code, also apply `.agents/odoo19-development/SKILL.md`.
|
||||
|
||||
## System context (fixed facts)
|
||||
|
||||
- **Ollama server:** `http://100.103.83.12:11435` — the target instance
|
||||
(custom port, holds the model zoo: qwen3.8:27b, bge-m3, bake-off
|
||||
candidates). The same host also runs a near-empty instance on port
|
||||
11434 — do **not** "correct" the port to 11434. Verify with
|
||||
`curl http://100.103.83.12:11435/api/tags`.
|
||||
- **Ollama server:** `http://100.103.83.12:11435` — a **remote GPU
|
||||
machine** in the Tailscale network (development environment, Radeon
|
||||
AI Pro R9700) holding the model zoo: qwen3.8:27b, bge-m3, bake-off
|
||||
candidates. Do **not** "correct" the URL to localhost or port 11434 —
|
||||
a local Ollama on the dev machine's 11434 is a different, near-empty
|
||||
instance. Verify with `curl http://100.103.83.12:11435/api/tags`.
|
||||
Shell access for restarts/logs exists only on that machine.
|
||||
- **GPU:** AMD Radeon AI Pro R9700, 32 GB — keep the total resident
|
||||
budget (answer model + embeddings + KV cache) under ~28 GB.
|
||||
- **Models (provisional until bake-off, see protocol below):**
|
||||
|
||||
Reference in New Issue
Block a user