Commands / kosa8 model

`kosa8 model`

Pull and serve local models (OpenAI- and Anthropic-compatible)

kosa8 pulls GGUF models from Hugging Face and serves them on a fixed local port, exposing both OpenAI (/v1/chat/completions) and Anthropic (/v1/messages) compatible endpoints.

Serving uses llamay (https://www.llamay.com) when it is installed and kosa8's own built-in engine otherwise, so a model that pulled can always be served. Pick one explicitly with model serve --backend llamay|engine.

Subcommands

kosa8 model checkMeasure a model and say whether the org policy lets it be served, and why kosa8 model lsList locally stored models kosa8 model pullDownload a GGUF model from Hugging Face (org/repo[:quant]) kosa8 model pull-ociInstall a model published to an OCI registry kosa8 model pushPublish a local model to an OCI registry as an artifact kosa8 model rmDelete a local model kosa8 model serveServe a model on the local gateway until interrupted kosa8 model signSign a model's weights digest, for an approved model list that requires a signer