Runtime Control

Runtime administration for controllable inference backends. The current host-control implementation manages vLLM endpoints; other endpoint types remain visible through Models & Runtime without pretending they share vLLM-specific controls.

No container name is bound to this model profile.

Host Control Profiles

SSH connection records only. They no longer carry detached container/script allowlists; host actions use the exact container/script bound to the selected vLLM ModelProfile.

Controllable Runtime Endpoint Inventory

Only endpoints with RuntimeType=vllm are eligible vLLM hosts here.

Endpoint / hostURLOnlineModel profiles on this endpoint
GB10_1
gb10_1
GB10_1
http://192.168.10.1:8003/v1online
HTTP 200 OK
1
gb10_1_vllm_qwen3_8_flash_next

Runtime Model Binding Inventory

Model profileEndpointHost controlContainer/scriptLaunch shape
qwen3.8-flash-next
gb10_1_vllm_qwen3_8_flash_next
served: qwen3.8-flash-next
GB10_1
http://192.168.10.1:8003/v1

port= ctx=240000 seqs= batch= gpu= kv= quant=NVFP4