kosa8 docs

Commands / kosa8 model

kosa8 model

Pull and serve local models (OpenAI- and Anthropic-compatible)

kosa8 pulls GGUF models from Hugging Face and serves them via llama.cpp on a fixed local port, exposing both OpenAI (/v1/chat/completions) and Anthropic (/v1/messages) compatible endpoints.

Subcommands

kosa8 model lsList locally stored models kosa8 model pullDownload a GGUF model from Hugging Face (org/repo[:quant]) kosa8 model pull-ociInstall a model published to an OCI registry kosa8 model pushPublish a local model to an OCI registry as an artifact kosa8 model rmDelete a local model kosa8 model serveServe a model on the local gateway until interrupted