List ModelDeploymentConfigs By Workspace

GET

https://host.com/apis/models/v2/workspaces/:workspace/deployment-configs

GET

/apis/models/v2/workspaces/:workspace/deployment-configs

$ curl https://host.com/apis/models/v2/workspaces/workspace/deployment-configs \
>      -H "Content-Type: application/json"

1 {
2   "data": [
3     {
4       "name": "llama-3.1-8b",
5       "workspace": "research-team-alpha",
6       "created_at": "2024-01-15T09:30:00Z",
7       "updated_at": "2024-01-15T09:30:00Z",
8       "entity_version": 1,
9       "nim_deployment": {
10         "gpu": 2,
11         "model_type": "llm",
12         "lora_enabled": false,
13         "disk_size": "100Gi",
14         "image_name": "nvcr.io/nemo/llama",
15         "image_tag": "v3.1.0",
16         "model_namespace": "nvidia/llama",
17         "model_name": "llama-8b",
18         "model_revision": "main",
19         "model_provider": "hf",
20         "chat_template": "{% raw %}{{ user_input }}{% endraw %}",
21         "tool_call_config": {
22           "tool_call_parser": "openai",
23           "tool_call_plugin": "research-team-alpha/custom-tool-plugin",
24           "auto_tool_choice": true
25         },
26         "additional_envs": {
27           "NEMO_LOG_LEVEL": "INFO",
28           "MAX_BATCH_SIZE": "16"
29         },
30         "k8s_nim_operator_config": {
31           "resources": {
32             "requests": {
33               "cpu": "4",
34               "memory": "16Gi"
35             },
36             "limits": {
37               "cpu": "8",
38               "memory": "32Gi"
39             }
40           },
41           "tolerations": [
42             {
43               "key": "nvidia.com/gpu",
44               "operator": "Exists",
45               "effect": "NoSchedule"
46             }
47           ],
48           "node_selector": {
49             "node-type": "gpu-node",
50             "zone": "us-west1-a"
51           },
52           "startup_probe_grace_seconds": 600
53         },
54         "override_config": {}
55       },
56       "id": "d4f7a9b2-3c1e-4f8a-9b6d-2a7e5f9c1234",
57       "project": "urn:nemo:projects:alpha-research",
58       "description": "Deployment config for LLaMA 3.1 8B model with baseline settings.",
59       "model_entity_id": "model-entity-1234abcd"
60     }
61   ],
62   "pagination": {
63     "page": 1,
64     "page_size": 10,
65     "current_page_size": 1,
66     "total_pages": 1,
67     "total_results": 1
68   },
69   "sort": "created_at",
70   "filter": {}
71 }

List ModelDeploymentConfigs for a specific workspace. Returns only the latest version of each config.

Path parameters

workspacestringRequired

Query parameters

pageintegerOptionalDefaults to 1

Page number.

page_sizeintegerOptionalDefaults to 100

Page size.

sortstringOptionalDefaults to created_at

The field to sort by. To sort in decreasing order, use - in front of the field name.

filterobjectOptional

Filter deployment configs by workspace, project, model_entity_id, name, description, created_at, and updated_at.

Response

Return model deployment configurations for a workspace

datalist of objects

paginationobject

Pagination information.

sortstring

The field on which the results are sorted.

filtermap from strings to any

Filtering information.

Errors

422

Unprocessable Entity Error