Runtime Control
Runtime administration for controllable inference backends. The current host-control implementation manages vLLM endpoints; other endpoint types remain visible through Models & Runtime without pretending they share vLLM-specific controls.
No container name is bound to this model profile.
Host Control Profiles
SSH connection records only. They no longer carry detached container/script allowlists; host actions use the exact container/script bound to the selected vLLM ModelProfile.
Controllable Runtime Endpoint Inventory
Only endpoints with RuntimeType=vllm are eligible vLLM hosts here.
| Endpoint / host | URL | Online | Model profiles on this endpoint |
|---|---|---|---|
GB10_1gb10_1GB10_1 | http://192.168.10.1:8003/v1 | online HTTP 200 OK | 1 gb10_1_vllm_qwen3_8_flash_next |
Runtime Model Binding Inventory
| Model profile | Endpoint | Host control | Container/script | Launch shape |
|---|---|---|---|---|
qwen3.8-flash-nextgb10_1_vllm_qwen3_8_flash_nextserved: qwen3.8-flash-next | GB10_1http://192.168.10.1:8003/v1 | | | port= ctx=240000 seqs= batch= gpu= kv= quant=NVFP4 |