Hardware and Software Requirements for NeMo Platform

View as Markdown

This page lists the requirements for the OSS local-install path for NeMo Platform 0.1.0. For the full compatibility table, see the Support Matrix.

The OSS 0.1.0 documentation is scoped to local setup with the Python package and nemo setup. Docker Compose, Helm, Kubernetes, and OpenShift deployment guides are not part of this release scope.

Local Setup Requirements

ComponentRequirementNotes
Python3.11, 3.12, or 3.13 (>=3.11,<3.14)Use an isolated virtual environment. Python 3.14 and later are not part of the OSS local-install support range.
Package installeruv recommended; pip supportedThe one-line installer sets up uv automatically when needed.
Operating systemRecent Linux or macOS releaseSee the Support Matrix for the supported OS list.
Memory8 GB RAM minimum16 GB or more is recommended for larger local workflows.
Disk space16 GB free disk space minimumAdditional space is needed for datasets, job outputs, and local model artifacts.
NetworkOutbound HTTPS accessRequired for package installation and hosted model-provider APIs.
Model providerNVIDIA Build, OpenAI, Anthropic, Google Gemini, Ollama, or a custom OpenAI-compatible endpointnemo setup configures one provider as part of the setup flow.
BrowserCurrent Chrome, Edge, Firefox, or SafariRequired for the Studio UI.

GPU Requirements

Local provider workflows do not require a local GPU. GPU requirements apply only when you run local model or GPU-accelerated workloads.

ComponentRequirementNotes
GPUNVIDIA data center GPU with 40 GB VRAM minimum; 80 GB recommendedA100 80GB, H100 80GB, and B200 180GB meet the recommended profile.
CUDACUDA 12.8 or laterGPU Python dependencies are built for CUDA 12.8.
NVIDIA driverCUDA 12.8-capable driver, R570 branch or laterSee the CUDA 12.8 release notes for exact driver minimums by operating system.
PlatformLinux x86_64Local NVIDIA GPU workloads are not supported on macOS or Windows.

Verify Your Environment

$python --version
$nemo --help
$curl -s http://localhost:8080/health/ready

For setup instructions, see Setup.