okami.mom / llama-cpp-bonsai
llama.cpp fork for Ternary Bonsai 2 27B: MTP speculation, suffix cache reuse (SCR), q8 KV, two-slot fairness, fused DeltaNet kernels
Star
Fork 0
Watch
Open Closed
New
No issues yet.