Model Profiles
Profiles are ordered as endpoint name → runtime type → profile name. Each profile is bound to one exact endpoint/runtime pair.
Binding:
GB10_1_openai (openai_compatible) gb10_1_openai_openai_compatible_deepseek_v4_1_flash_1017_keys · record 1ca15124d6Use Refresh Models From Endpoints to query /v1/models. Discovery is scoped to the exact endpoint name/runtime pair.
Saved Model Records
This list is read directly from /persist/config/model_profiles.json. endpoints.json is never a model-profile source. Routing and /v1/models read this same file authority.
| Status | Endpoint / profile | Display name | Upstream | Record | Actions |
|---|---|---|---|---|---|
| PUBLISHED / routable | 5090 (lm_studio) nvidia_5090___qwen3.5-9b-uncensored-hauhaucs-aggressive | qwen3.5-9b-uncensored-hauhaucs-aggressive via NVIDIA 5090 | qwen3.5-9b-uncensored-hauhaucs-aggressive | legacy_21e | |
| PUBLISHED / routable | gb10_1 (vllm) gb10_1_vllm_qwen3_8_flash_next | qwen3.8-flash-next | qwen3.8-flash-next | legacy_21d | |
| PUBLISHED / routable | GB10_1_openai (openai_compatible) gb10_1_openai_openai_compatible_deepseek_v4_1_flash_1017 | deepseek-v4.1-flash-1017 | deepseek-v4.1-flash-1017 | ee2c5b75eb | |
| PUBLISHED / routable | GB10_1_openai (openai_compatible) gb10_1_openai_openai_compatible_deepseek_v4_1_flash_1017_keys | gb10_1_openai_openai_compatible_deepseek_v4_1_flash_1017_keys | deepseek-v4.1-flash-1017-keys | 1ca15124d6 | |
| PUBLISHED / routable | GB10_1_openai (openai_compatible) gb10_1_openai_openai_compatible_glm_5_3_flash_nvfp4_abliterated | glm-5.3-flash-nvfp4-abliterated | glm-5.3-flash-nvfp4-abliterated | 0672965ed9 |
Current Model Catalog
Ordered by endpoint name, runtime type, then profile name.
| Endpoint / profile | Display name | Upstream model | Online | Discovered | Preset | Benchmark | Metadata |
|---|---|---|---|---|---|---|---|
5090 (lm_studio) nvidia_5090___qwen3.5-9b-uncensored-hauhaucs-aggressive | qwen3.5-9b-uncensored-hauhaucs-aggressive via NVIDIA 5090 | qwen3.5-9b-uncensored-hauhaucs-aggressive | False | False | creative_brainstorming | — tok/s TTFT — ms | total / active B; ; ctx |
gb10_1 (vllm) gb10_1_vllm_qwen3_8_flash_next | qwen3.8-flash-next | qwen3.8-flash-next | True | False | glm_5_3_flash_speculative | 45.3 tok/s TTFT 175 ms | 6 total / 200 active B; NVFP4; 240000 ctx |
GB10_1_openai (openai_compatible) gb10_1_openai_openai_compatible_deepseek_v4_1_flash_1017 | deepseek-v4.1-flash-1017 | deepseek-v4.1-flash-1017 | True | False | general_assistant | 62.5 tok/s TTFT 234 ms | total / active B; ; 1000000 ctx |
GB10_1_openai (openai_compatible) gb10_1_openai_openai_compatible_deepseek_v4_1_flash_1017_keys | gb10_1_openai_openai_compatible_deepseek_v4_1_flash_1017_keys | deepseek-v4.1-flash-1017-keys | True | True | tool_call_safe | 75.3 tok/s TTFT 132 ms | total / active B; ; 1000000 ctx |
GB10_1_openai (openai_compatible) gb10_1_openai_openai_compatible_glm_5_3_flash_nvfp4_abliterated | glm-5.3-flash-nvfp4-abliterated | glm-5.3-flash-nvfp4-abliterated | True | False | glm_5_3_flash_speculative | 27.8 tok/s TTFT 274 ms | total / active B; ; ctx |