scripts · llama-cpp-bonsai · Tangled

okami.mom / llama-cpp-bonsai

llama.cpp fork for Ternary Bonsai 2 27B: MTP speculation, suffix cache reuse (SCR), q8 KV, two-slot fairness, fused DeltaNet kernels

llama-cpp-bonsai scripts

4 folders · 40 files

Georgi Gerganov · ci : apply ccache-clear with older/min/dry-run to all ccache jobs (#27602) · 2mo ago

scripts : make the shell scripts cross-platform (#14341)

ci: hip-quality-check: update vgpr spill ignore list (#26859)

ci : bump ty to 0.0.33 (#22535)

common: migrate the deprecated --mmap/--no-mmap to --load-mode (#26934)

bench-models.sh

common: migrate the deprecated --mmap/--no-mmap to --load-mode (#26934)

llama : reorganize source code + improve CMake (#8006)

ccache-clear.sh

ci : apply ccache-clear with older/min/dry-run to all ccache jobs (#27602)

check-requirements.sh

scripts : make the shell scripts cross-platform (#14341)

compare-commits.sh

scripts: add sqlite3 check for compare-commits.sh (#15633)

compare-llama-bench.py

args: refactor mlock/mmap/directio into load-mode (#20834)

compare-logprobs.py

scripts: update corpus of compare-logprobs (#19326)

create_ops_docs.py

Docs: add instructions for adding backends (#14889)

refactor : remove libcurl, use OpenSSL when available (#18828)

scripts : make the shell scripts cross-platform (#14341)

gen-unicode-data.py

ci : bump ty to 0.0.26 (#21156)

get_chat_template.py

scripts: corrected encoding when getting chat template (#11866) (#11907)

build : pass all warning flags to nvcc via -Xcompiler (#5570)

get-hellaswag.sh

scripts : update get-hellaswag.sh and get-winogrande.sh (#20542)

scripts : make the shell scripts cross-platform (#14341)

get-wikitext-2.sh

scripts : improve get-wikitext-2.sh (#19952)

get-winogrande.sh

scripts : update get-hellaswag.sh and get-winogrande.sh (#20542)

git-bisect-run.sh

llama: end-to-end tests (#19802)

llama: end-to-end tests (#19802)

scripts : make the shell scripts cross-platform (#14341)

install-oneapi.bat

support SYCL backend windows build (#5208)

make-release-checks.sh

ci : restore release.yml check during make-release.yml (#27247)

make-release-desc.sh

ci : add nightly-tag.txt to make-release (#27485)

pr2wt : symlink .pi (#22386)

scripts : add release.sh for release preparation (#27497)

serve-static.js

refactor : remove libcurl, use OpenSSL when available (#18828)

server-bench.py

server-bench : add speed-bench for speculative decoding benchmarking (#23869)

server-test-function-call.py

common/autoparser: fixes for newline handling / forced tool calls (#22654)

server-test-model.py

Autoparser - complete refactoring of parser architecture (#18675)

server-test-parallel-tc.py

chat: fix parallel_tool_calls default setting based on model capabilities, add tests for parallel tool calls and structured outputs (#22217)

server-test-structured.py

parser: fix structured output bug (#22302)

vendor : update subprocess.h (#27409)

sync-ggml-am.sh

scripts : update sync scripts

scripts : update sync scripts

refactor : remove libcurl, use OpenSSL when available (#18828)

scripts : make the shell scripts cross-platform (#14341)

ui-assets.cmake

Prefer npm ci over install for security (#26601)

verify-checksum-models.py

convert.py : add python logging instead of print() (#6511)

scripts : allow wc2wt with an existing branch (#23189)