Something went wrong. Try again.
Routing embedding stack for Qwen3-Embedding-0.6B on Apple Silicon: orchestrator + MLX + llama.cpp backends
Something went wrong. Try again.
407 B · 15 lines
TOML
at main
12345678910111213141516[package]name = "llama-embed-server"version = "0.1.0"edition = "2021"
[dependencies]llama-cpp-2 = { git = "https://github.com/utilityai/llama-cpp-rs.git", rev = "881fe4d77674630f91e96f7c78058e5ae5cf1bf7" }axum.workspace = truetokio.workspace = trueserde.workspace = trueserde_json.workspace = truetracing.workspace = truetracing-subscriber.workspace = trueanyhow.workspace = truehf-hub = "0.5"