Blog tag

#SYCL

9 posts tagged with SYCL.

← Back to all posts
2 min read

26 Iterations: Porting Cleanroom Kernels to Gemma 4

A single day of rapid iteration took the Gemma 4 port from a baseline to validated QKV fusion, invalidating several assumptions along the way.

SYCLKernelsLocal LLMPerformanceIteration
Read more
2 min read

All-Local 29 Tokens Per Second and Fused Norm Kernels

Fusing QKV, inlining norm-weight application, and pushing block loads through the Q4_K path.

SYCLKernelsPerformanceLocal LLMOptimization
Read more
2 min read

Standalone Inference Working: Shared Memory and a CPU Fallback

The standalone backend finally produced inference after fixing ABI layout, shared-memory buffers, and a simple CPU fallback.

SYCLKernelsABILocal LLMPerformance
Read more
2 min read

Chasing a Standalone Boot and Fixing a Docker Leak Along the Way

Removing the real IPEX library dependency one stub at a time, with a swarm automation overhaul in between.

SYCLC++DebuggingAutomationBenchmarking
Read more
2 min read

Enabling Local Dispatch Op by Op Until the Graph Ran Entirely on My Kernel

47 commits and a progressive enablement series that ended with full local decode dispatch at 7.0 t/s and 100% correctness.

SYCLKernelsPerformanceDebuggingLocal LLM
Read more
1 min read

Publishing ipex-from-scratch and Building a Shim Runtime

Prepping a GitHub-safe snapshot of the IPEX reimplementation and advancing the shim interposers.

SYCLC++Reverse EngineeringOpen SourceBenchmarking
Read more
2 min read

A Hybrid Build System and 42 Decompiled IPEX Modules

Completing the IPEX kernel decompilation and stitching upstream llama.cpp together with a patched IPEX shim.

SYCLCMakeReverse EngineeringBuild SystemsIntel
Read more
2 min read

Writing an ESIMD Fused Kernel From Reverse-Engineered Assembly

SLM-tiled GEMM, SPIR-V decompilation, and a corrected Q4_K dequant that finally produced coherent output.

SYCLESIMDKernelsReverse EngineeringPerformance
Read more
2 min read

Rebranding to ArcLab and Patching a Modern Jinja Parser Into llama-server

Rebrand, hybrid llama-server build, IPEX reverse-engineering notes, and a sandbox with a parallel job queue.

Local LLMSYCLIntelPythonTooling
Read more