Update LLM model path to Big Data
This commit is contained in:
@@ -11,7 +11,7 @@ A decision-support skill for the orchestrator. Triage whether a subtask fits the
|
|||||||
|
|
||||||
| Layer | What | Where |
|
| Layer | What | Where |
|
||||||
|---|---|---|
|
|---|---|---|
|
||||||
| Model | Qwen3-Coder-30B-A3B-Instruct, UD-Q5_K_XL quant | `~/llm/models/` |
|
| Model | Qwen3-Coder-30B-A3B-Instruct, UD-Q5_K_XL quant | `/run/media/daniel/Big Data/llm/models/` |
|
||||||
| Inference | llama.cpp 9200 with Vulkan/RADV on AMD Radeon RX 7900 XTX | `systemctl --user … llama-server` (port 8080) |
|
| Inference | llama.cpp 9200 with Vulkan/RADV on AMD Radeon RX 7900 XTX | `systemctl --user … llama-server` (port 8080) |
|
||||||
| API translator | claude-code-router (Anthropic ↔ OpenAI) | `ccr` (port 3456) |
|
| API translator | claude-code-router (Anthropic ↔ OpenAI) | `ccr` (port 3456) |
|
||||||
| Wrapper | One-shot `claude --print` with `ANTHROPIC_BASE_URL=ccr` | `~/llm/scripts/local-coder-task.sh` |
|
| Wrapper | One-shot `claude --print` with `ANTHROPIC_BASE_URL=ccr` | `~/llm/scripts/local-coder-task.sh` |
|
||||||
|
|||||||
@@ -12,7 +12,7 @@ A decision-support skill for the orchestrator. Triage whether a subtask fits the
|
|||||||
| Layer | What | Where |
|
| Layer | What | Where |
|
||||||
|---|---|---|
|
|---|---|---|
|
||||||
| Host | `desktop-local` (daniel-desktop, Radeon RX 7900 XTX) | reached via `ssh desktop-local` |
|
| Host | `desktop-local` (daniel-desktop, Radeon RX 7900 XTX) | reached via `ssh desktop-local` |
|
||||||
| Model | Qwen3-Coder-30B-A3B-Instruct, UD-Q5_K_XL quant | `~/llm/models/` on desktop-local |
|
| Model | Qwen3-Coder-30B-A3B-Instruct, UD-Q5_K_XL quant | `/run/media/daniel/Big Data/llm/models/` on desktop-local |
|
||||||
| Inference | llama.cpp with Vulkan/RADV | `systemctl --user … llama-server` (port 8080, desktop-local) |
|
| Inference | llama.cpp with Vulkan/RADV | `systemctl --user … llama-server` (port 8080, desktop-local) |
|
||||||
| API translator | claude-code-router (Anthropic ↔ OpenAI) | `ccr` (port 3456, desktop-local) |
|
| API translator | claude-code-router (Anthropic ↔ OpenAI) | `ccr` (port 3456, desktop-local) |
|
||||||
| Wrapper | One-shot `claude --print` with `ANTHROPIC_BASE_URL=ccr` | `~/llm/scripts/local-coder-task.sh` on desktop-local |
|
| Wrapper | One-shot `claude --print` with `ANTHROPIC_BASE_URL=ccr` | `~/llm/scripts/local-coder-task.sh` on desktop-local |
|
||||||
|
|||||||
Reference in New Issue
Block a user