Engineering notes on local inference, heterogeneous computing, GPU kernels, speculative decoding, and hands-on benchmarks.https://www.lucebox.com/en-ushttps://www.lucebox.com/blog/ling3-flash-dgx-spark/https://www.lucebox.com/blog/ling3-flash-dgx-spark/Our Ling 3.0 Flash result on one DGX Spark: up to 36.4% faster prompt reading, near-tied ordinary generation, and 141.9 tok/s in the best matched DSpark case.Fri, 28 Aug 2026 12:00:00 GMThttps://www.lucebox.com/blog/qwen38-r9700/https://www.lucebox.com/blog/qwen38-r9700/The lucebox engine serves Qwen3.8-27B on a single AMD Radeon AI PRO R9700 with the DFlash2 block-diffusion drafter: up to 227 tok/s on code, 208 tok/s HumanEval average, and 3.8x llama.cpp decode running the same drafter, at 8-bit-class quality.Fri, 21 Aug 2026 12:00:00 GMThttps://www.lucebox.com/blog/tool-prefix-cache/https://www.lucebox.com/blog/tool-prefix-cache/Agent turns often resend thousands of tokens of tool definitions. Lucebox can now restore that stable prefix and process only the new conversation. On Qwen3.6-27B, median warm prefill was 1.04 seconds after a 50.35 second cold turn.Mon, 27 Jul 2026 12:00:00 GMThttps://www.lucebox.com/blog/deepseek-v4-asymmetric-parallelism/https://www.lucebox.com/blog/deepseek-v4-asymmetric-parallelism/51.1 tok/s on Lucebox versus our 14.09 tok/s average on one NVIDIA DGX Spark for the full 284B model. The complete $6,499 Lucebox costs 31% less than two DGX Sparks.Mon, 20 Jul 2026 12:00:00 GMThttps://www.lucebox.com/blog/deepseek-v4-strix-halo/https://www.lucebox.com/blog/deepseek-v4-strix-halo/The full DeepSeek V4 Flash target runs locally on AMD Ryzen AI MAX+ 395 with 128 GB unified memory, reaching up to 32 tok/s decode and roughly 250 tok/s indexed sparse prefill.Thu, 16 Jul 2026 12:00:00 GMThttps://www.lucebox.com/blog/laguna-xs21/https://www.lucebox.com/blog/laguna-xs21/poolside's coding MoE with its official DFlash drafter: 296 tok/s peak at short context, a flat 152 tok/s at 256K tokens, and prefill at 3,500 tok/s. Lossless speculative decoding, KVFlash paging, and two model-agnostic engine optimizations run on one 24 GB card.Sat, 11 Jul 2026 12:00:00 GMThttps://www.lucebox.com/blog/kvflash/https://www.lucebox.com/blog/kvflash/On Qwen3.6-27B the KV cache costs 4.6 GiB at 256K and drags decode to 13 tok/s. KVFlash pages cold 64-token chunks to host RAM bit-exact, holding decode at 38.6 tok/s from 64K to 256K with unchanged accuracy.Fri, 12 Jun 2026 12:00:00 GMThttps://www.lucebox.com/blog/docker/https://www.lucebox.com/blog/docker/A prebuilt image spans the RTX 2080 Ti through RTX 5090. The fat-binary compile happens once in CI instead of on your box, with two host dependencies, self-tuning, and build provenance included.Mon, 08 Jun 2026 12:00:00 GMThttps://www.lucebox.com/blog/spark/https://www.lucebox.com/blog/spark/A 33–35B MoE fires only a fraction of its experts per token but normally pays for all of them in VRAM. Spark keeps the active experts resident and swaps the rest, fitting Qwen3.6 35B-A3B and Laguna XS.2 on 16 GB GPUs.Fri, 05 Jun 2026 12:00:00 GMThttps://www.lucebox.com/blog/gemma-vs-deepseek/https://www.lucebox.com/blog/gemma-vs-deepseek/On ds4-eval-92, Gemma 4 26B on a 24 GB RTX 5090 Laptop ties DeepSeek V4 Flash on a 192 GB Mac at 78.3% and decodes about five times faster.Wed, 20 May 2026 12:00:00 GMThttps://www.lucebox.com/blog/client-harnesses/https://www.lucebox.com/blog/client-harnesses/Real-client profiles, launch scripts, and TQ3/DDTree results for OpenCode, Hermes, OpenClaw, Open WebUI, Codex, Claude Code, and Pi.Fri, 15 May 2026 12:00:00 GMThttps://www.lucebox.com/blog/amd/https://www.lucebox.com/blog/amd/DFlash and PFlash on the Ryzen AI MAX+ 395 iGPU reach 26.85 tok/s speculative decode and 20.2 seconds of prefill at 16K, a 2.51× end-to-end speedup over vanilla llama.cpp HIP on the same silicon.Tue, 12 May 2026 12:00:00 GMThttps://www.lucebox.com/blog/laguna/https://www.lucebox.com/blog/laguna/Poolside Laguna XS.2 was ported into DFlash and PFlash as the first MoE target supported by PFlash, reaching about 107 tok/s decode and 5.4× faster 128K prefill than llama.cpp on one RTX 3090.Fri, 08 May 2026 12:00:00 GMThttps://www.lucebox.com/blog/pflash/https://www.lucebox.com/blog/pflash/PFlash compresses a 128K prompt to 2.6K tokens with a small drafter before DFlash sees it, reducing cold time to first token from about 257 seconds to 24.8 seconds while preserving measured retrieval accuracy.Tue, 28 Apr 2026 12:00:00 GMThttps://www.lucebox.com/blog/dflash27b/https://www.lucebox.com/blog/dflash27b/A standalone C++ and ggml speculative decoder for Qwen3.5-27B Q4_K_M with a DFlash block-diffusion draft model and DDtree verifier, reaching up to 207 tok/s and supporting 128K context on 24 GB.Thu, 16 Apr 2026 12:00:00 GMThttps://www.lucebox.com/blog/egpu-myth/https://www.lucebox.com/blog/egpu-myth/tinygrad wrote an NVIDIA driver from scratch. We tested real models on an RTX 3090 over USB4 to measure whether an inexpensive eGPU dock can turn a Mac into an AI workstation.Tue, 14 Apr 2026 12:00:00 GMThttps://www.lucebox.com/blog/megakernel/https://www.lucebox.com/blog/megakernel/The first megakernel for hybrid DeltaNet and Attention LLMs fuses all 24 layers into one CUDA dispatch, reaching 1.87 tok/J and matching M5 Max efficiency at about twice the throughput on an RTX 3090.Mon, 13 Apr 2026 12:00:00 GMT