rdmpw3275m-changelog-20260823-0350-local-llm-fleet-maintenance
Upgraded ToshLLM on the four-Vega Mac Pro, installed the full Qwen 3.8 27B quantization set, and recorded an honest single-GPU canary after multi-GPU decode failures.
Changes
- Reconciled managed Claude/Codex/Gemini/FLEET path blocks with the
canonical
rdmsm4x:/Users/richh/devroots. - Completed
/Users/richh/dev_update.zsh; no outdated formulae remained. The greedy cask check retains only Raycast because its current cask is Apple-Silicon-only on this Intel host. - Repaired the Antigravity cask receipt collision; backup:
/Users/richh/.agent-coordination/backups/antigravity-cli-receipt-20260823T022649. - Upgraded ToshLLM 0.85.0 to verified 0.85.7; backup:
/Users/richh/.agent-coordination/backups/toshllm-v0.85.7-20260823T022006. - Installed and checksum-verified Qwen 3.8 27B Q4_K_M, Q8_0, and BF16
models plus their mmproj and MTP artifacts under
/Volumes/p4510a/models(eight files, approximately 113.7 GB total). Final manifest:/Volumes/p4510a/models/.qwen3.8-27b-install-v1.tsv. - Stopped the prior externally listening Tosh server and removed the
API key from process arguments; final privacy settings are
localNetworkDiscovery=falseandapiKeyEnabled=false. Settings backup:/Users/richh/.agent-coordination/backups/toshllm-settings-20260823T030154.
Benchmark findings
- ToshLLM enumerated all four 32 GB Radeon Pro Vega II GPUs, but Qwen
3.8 27B prompt decode returned
res=-3with four GPUs and with a bridged two-GPU pair across bounded Flash Attention/batch/peer-event variants. - A single selected Vega II Q4 canary completed: prompt 8.582 tok/s,
generation 0.318 tok/s, 99 GPU layers, 28 threads, Flash Attention off.
The artifact records
gpu_count=4andselected_gpu_count=1; it does not claim aggregate 128 GB VRAM utilization. - No Tosh community upload was made from this host because Tosh
0.85.7's payload reports all discrete GPUs and would not make the single
selected GPU sufficiently clear. The existing
gpt-oss-120bmodel and Qwen BF16 asset were preserved but not represented by invented benchmark numbers.
Permissions, undo, and owner actions
- TCC audit found SSH-wrapper Automation denied for Terminal, System Events, and RTTy; Ghostty-to-Notes Automation denied; and Homebrew zsh Full Disk Access denied. SSH Automation denials should remain. Ghostty-to-Notes and interactive zsh Full Disk Access are optional GUI owner choices if those local workflows are desired.
- Tosh anonymous signing identity remains pending on this host because the local TCC policy prevents the required GUI interaction over SSH. No attempt was made to bypass TCC.
- Restore Tosh 0.85.7 or settings from the dated backups above if required. Remove GGUF files only after manifest/hash review and an explicit owner decision.