Something went wrong. Try again.
User-specific application configuration is traditionally stored in so called dotfiles, these are my own.
Something went wrong. Try again.
123456789101112131415# llama-server router process options (loaded by systemd via EnvironmentFile).# Sourced from the llama-server env-var twins of the CLI flags (see common/arg.cpp).# NOTE: --sleep-idle-seconds has NO env-var equivalent, so it must be passed on# the command line in the unit's ExecStart.
LLAMA_ARG_MODELS_MAX=1LLAMA_ARG_MODELS_AUTOLOAD=false# Listen address / portLLAMA_ARG_HOST=0.0.0.0LLAMA_ARG_PORT=9931
# GPU device selection (ROCm/HIP). Set to the index(es) of the GPU(s) to use.HIP_VISIBLE_DEVICES=0