Commands / kosa8 model serve
kosa8 model serve
Serve a model on the local gateway until interrupted
Usage
kosa8 serve NAME
Options
| Flag | Type | What it does | Default |
|---|---|---|---|
--backend | string | inference runtime: auto (llama-server if installed, else kosa8's own engine), llama, or engine | auto |