Rent NVIDIA H100 GPUs by the minute.
Training and fast inference. 80 GB per GPU, billed by the minute.
HopperDatacenter
H100 80GB PCIe
Training and fast inference
- VRAM
- 80 GB
- From
- $2.89/h
Canada
GPU Cloud · Secure
H100 rates per GPU-hour.
| GPU | VRAM | Countries | On demand | SpotInterruptible |
|---|---|---|---|---|
| H100 80GB SXM | 80 GB |
| from $4.95/h | Not in stock |
| H100 80GB PCIe | 80 GB |
| from $2.89/h | from $2.31/h |
| H100 80GB NVLink | 80 GB |
| Not in stock | from $2.29/h |
Prices on Nov 14, 2026, 20:35 UTC. US dollars, per GPU, before tax.
Community machines. Priced by their owners, per hour. Each rate in the console.Explore Community
The H100, in numbers.
- Architecture
- NVIDIA Hopper
- GPU memory
- 80 GB per GPUHBM3 (SXM)HBM2e (PCIe, NVLink)
- Memory bandwidth
- 3.35 TB/s (SXM)2 TB/s (PCIe, NVLink)
- Interconnect
- NVLink 4 · 900 GB/s (SXM)PCIe Gen5 (PCIe)PCIe Gen5 · NVLink bridge 600 GB/s (NVLink)
- Form factor
- H100 80GB SXM, H100 80GB PCIe, and H100 80GB NVLink
- Image
- Ubuntu 24.04 LTS, NVIDIA driver 570, CUDA 12.8
- Billing
- By the minute
What fits in 80 GB.
Open models on one H100, or split across up to 8.
| Model | 16-bit | 4-bit |
|---|---|---|
| Llama 3.1 8B Instruct | 1 GPUNeeds 19.5 GiB | 1 GPUNeeds 6.1 GiB |
| Mistral 7B Instruct v0.3 | 1 GPUNeeds 17.8 GiB | 1 GPUNeeds 5.7 GiB |
| Gemma 2 27B IT | 1 GPUNeeds 63.5 GiB | 1 GPUNeeds 17.9 GiB |
| Qwen2.5 32B Instruct | 1 GPUNeeds 74.8 GiB | 1 GPUNeeds 20.4 GiB |
| Mixtral 8x7B Instruct | 2 GPUsNeeds 106.0 GiB | 1 GPUNeeds 27.7 GiB |
| Llama 3.3 70B Instruct | 4 GPUsNeeds 160.3 GiB | 1 GPUNeeds 42.0 GiB |
| Qwen2.5 72B Instruct | 4 GPUsNeeds 165.0 GiB | 1 GPUNeeds 43.1 GiB |
| FLUX.1 [dev] | 1 GPUNeeds 38.9 GiB | 1 GPUNeeds 10.5 GiB |
| Whisper large-v3 | 1 GPUNeeds 4.5 GiB | 1 GPUNeeds 1.9 GiB |
Estimated by the GPU calculator for a 4,096-token context and one request: weights, KV cache and runtime overhead. Launch by workload
What runs well on the H100.
- LLM inferenceAn OpenAI-compatible endpoint with vLLM.
- Fine-tuningTrain on your data. Keep the weights.
- Batch jobsThousands of files, one session.
- RecipesvLLMServe an open-weight LLM with vLLM on a Node Lodge machine. Install with uv, start the OpenAI-compatible server, query it through an SSH tunnel.
- RecipesLoRA fine-tuningFine-tune an open-weight LLM with LoRA or QLoRA using the Hugging Face TRL CLI on a Node Lodge GPU, then copy the adapter off the machine.
Next to the H100.
About the H100.
- How much does an NVIDIA H100 cost per hour?
- From $2.89 per GPU-hour on demand on Nov 14, 2026, 20:35 UTC, in US dollars before tax. Spot, interruptible: from $2.29 per GPU-hour. Billed per minute from prepaid credit, with no minimum.
- How much memory does the H100 have?
- 80 GB of HBM3 and HBM2e per GPU. Memory bandwidth: 3.35 TB/s (SXM) and 2 TB/s (PCIe, NVLink).
- Where are H100 GPUs located?
- Countries: Canada, Finland, and United States. In partner datacenters, under Node Lodge Secure. The console shows the city of each machine.
- Which models run on one H100?
- At 16-bit: Llama 3.1 8B Instruct, Mistral 7B Instruct v0.3, Gemma 2 27B IT, Qwen2.5 32B Instruct, FLUX.1 [dev], and Whisper large-v3. At 4-bit: Llama 3.1 8B Instruct, Mistral 7B Instruct v0.3, Gemma 2 27B IT, Qwen2.5 32B Instruct, Mixtral 8x7B Instruct, Llama 3.3 70B Instruct, Qwen2.5 72B Instruct, FLUX.1 [dev], and Whisper large-v3. Size any other model with the GPU calculator.
Request access.
Tell us what you will run. Your access arrives by email.