Get Specific ModelDeploymentConfig Version

GET

https://host.com/apis/models/v2/workspaces/:workspace/deployment-configs/:config/versions/:name

GET

/apis/models/v2/workspaces/:workspace/deployment-configs/:config/versions/:name

$ curl https://host.com/apis/models/v2/workspaces/workspace/deployment-configs/config/versions/name \
>      -H "Content-Type: application/json"

1 {
2   "name": "llama-3.1-8b",
3   "workspace": "research-team",
4   "created_at": "2024-01-15T09:30:00Z",
5   "updated_at": "2024-02-20T14:45:00Z",
6   "entity_version": 3,
7   "nim_deployment": {
8     "gpu": 4,
9     "model_type": "llm",
10     "lora_enabled": false,
11     "disk_size": "100Gi",
12     "image_name": "nvcr.io/nvidia/nemo:llama-3.1",
13     "image_tag": "v3.1.0",
14     "model_namespace": "nvidia/llama",
15     "model_name": "llama-3.1-8b",
16     "model_revision": "main",
17     "model_provider": "hf",
18     "chat_template": "{% raw %}{{ user_input }}{% endraw %}",
19     "tool_call_config": {
20       "tool_call_parser": "openai",
21       "tool_call_plugin": "research-team/custom-tool-plugin",
22       "auto_tool_choice": true
23     },
24     "additional_envs": {
25       "NVIDIA_VISIBLE_DEVICES": "0,1,2,3",
26       "LOG_LEVEL": "INFO"
27     },
28     "k8s_nim_operator_config": {
29       "resources": {
30         "requests": {
31           "cpu": "8",
32           "memory": "32Gi"
33         },
34         "limits": {
35           "cpu": "16",
36           "memory": "64Gi"
37         }
38       },
39       "tolerations": [
40         {
41           "key": "nvidia.com/gpu",
42           "operator": "Exists",
43           "effect": "NoSchedule"
44         }
45       ],
46       "node_selector": {
47         "node-type": "gpu-node",
48         "zone": "us-west1-a"
49       },
50       "startup_probe_grace_seconds": 600
51     },
52     "override_config": {
53       "replicas": 2,
54       "autoscaling": {
55         "enabled": true,
56         "minReplicas": 1,
57         "maxReplicas": 5,
58         "targetCPUUtilizationPercentage": 70
59       }
60     }
61   },
62   "id": "d4f8a9b2-7c3e-4f1a-9b2d-3e5f7a1c9b8d",
63   "project": "nemo-project/v1",
64   "description": "Deployment config for LLaMA 3.1 8B model with optimized GPU usage",
65   "model_entity_id": "model-entity-12345"
66 }

Get a specific version of a ModelDeploymentConfig.

Path parameters

workspacestringRequired

configstringRequired

namestringRequired

Response

Return a specific version of a model deployment configuration

namestringformat: "^[\w\-.]+$"<=255 characters

Name of the entity. Name/workspace combo must be unique across all entities. Allowed characters: letters (a-z, A-Z), digits (0-9), underscores, hyphens, and dots.

workspacestringformat: "^[\w\-.]+$"<=255 characters

The workspace of the entity. Allowed characters: letters (a-z, A-Z), digits (0-9), underscores, hyphens, and dots.

created_atdatetime

The timestamp of model entity creation

updated_atdatetime

The timestamp of the last model entity update

entity_versioninteger

Version of this deployment config. Automatically managed.

nim_deploymentobject

Configuration for NIM-based deployment

idstring

Unique identifier for the deployment config

projectstringformat: "^[\w\-./]+$"<=255 characters

The URN of the project associated with this entity.

descriptionstring<=1000 characters

Optional description of the deployment configuration

model_entity_idstring<=255 characters

Optional reference to the base model entity ID for this deployment

Errors

422

Unprocessable Entity Error