26 Iterations: Porting Cleanroom Kernels to Gemma 4
A single day of rapid iteration took the Gemma 4 port from a baseline to validated QKV fusion, invalidating several assumptions along the way.
A single day of rapid iteration took the Gemma 4 port from a baseline to validated QKV fusion, invalidating several assumptions along the way.
Fusing QKV, inlining norm-weight application, and pushing block loads through the Q4_K path.
The standalone backend finally produced inference after fixing ABI layout, shared-memory buffers, and a simple CPU fallback.
Removing the real IPEX library dependency one stub at a time, with a swarm automation overhaul in between.
47 commits and a progressive enablement series that ended with full local decode dispatch at 7.0 t/s and 100% correctness.
Prepping a GitHub-safe snapshot of the IPEX reimplementation and advancing the shim interposers.
Completing the IPEX kernel decompilation and stitching upstream llama.cpp together with a patched IPEX shim.
SLM-tiled GEMM, SPIR-V decompilation, and a corrected Q4_K dequant that finally produced coherent output.
Rebrand, hybrid llama-server build, IPEX reverse-engineering notes, and a sandbox with a parallel job queue.