You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
llama.cpp OpenAI-compatible server on Vulkan for AMD Strix Halo (gfx1151), GGUF weights pinned to GTT not VRAM. Serves poolside Laguna S 2.1, Gemma 4 and Qwen3.6 GGUFs on the stock Vulkan image, plus an opt-in ROCmFP4 + MTP stack (Ubuntu 26.04 + TheRock ROCm 7.13). Docker Compose, with real measured benchmarks.
Serve Poolside Laguna S 2.1 (NVFP4) on the NVIDIA DGX Spark (GB10) without hanging your box. Working stack, crash-safe configs, benchmarks, and the exact gotchas.
Poolside Laguna S 2.1: Run 1M Context Locally (Tested) - Complete overview, benchmarks, local setup guides (vLLM, SGLang, llama.cpp), and test suite for Laguna S 2.1 118B MoE.
Локальный LLM-провайдер для проекта slovo — Ollama c Laguna XS.2 (33B/3B MoE) в Docker с проброшенной NVIDIA GPU. Оптимизирован под single-user агентские сессии на RTX 4070 Ti SUPER + i9-11900K.