Rent NVIDIA A100 GPUs by the minute.
Proven training workhorse. 80 GB per GPU, billed by the minute.
AmpereDatacenter
A100 80GB SXM
Proven training workhorse
- VRAM
- 80 GB
- From
- $2.01/h
United States
GPU Cloud · Secure
A100 rates per GPU-hour.
| GPU | VRAM | Countries | On demand | SpotInterruptible |
|---|---|---|---|---|
| A100 80GB SXM | 80 GB |
| from $2.01/h | Not in stock |
| A100 80GB PCIe | 80 GB |
| Not in stock | from $1.30/h |
| A100 80GB NVLink | 80 GB |
| Not in stock | Not in stock |
Prices on Nov 14, 2026, 20:35 UTC. US dollars, per GPU, before tax.
Community machines. Priced by their owners, per hour. Each rate in the console.Explore Community
The A100, in numbers.
- Architecture
- NVIDIA Ampere
- GPU memory
- 80 GB per GPUHBM2e
- Memory bandwidth
- 2.04 TB/s (SXM)1.94 TB/s (PCIe, NVLink)
- Interconnect
- NVLink 3 · 600 GB/s (SXM)PCIe Gen4 (PCIe)PCIe Gen4 · NVLink bridge 600 GB/s (NVLink)
- Form factor
- A100 80GB SXM, A100 80GB PCIe, and A100 80GB NVLink
- Image
- Ubuntu 24.04 LTS, NVIDIA driver 570, CUDA 12.8
- Billing
- By the minute
What fits in 80 GB.
Open models on one A100, or split across up to 8.
| Model | 16-bit | 4-bit |
|---|---|---|
| Llama 3.1 8B Instruct | 1 GPUNeeds 19.5 GiB | 1 GPUNeeds 6.1 GiB |
| Mistral 7B Instruct v0.3 | 1 GPUNeeds 17.8 GiB | 1 GPUNeeds 5.7 GiB |
| Gemma 2 27B IT | 1 GPUNeeds 63.5 GiB | 1 GPUNeeds 17.9 GiB |
| Qwen2.5 32B Instruct | 1 GPUNeeds 74.8 GiB | 1 GPUNeeds 20.4 GiB |
| Mixtral 8x7B Instruct | 2 GPUsNeeds 106.0 GiB | 1 GPUNeeds 27.7 GiB |
| Llama 3.3 70B Instruct | 4 GPUsNeeds 160.3 GiB | 1 GPUNeeds 42.0 GiB |
| Qwen2.5 72B Instruct | 4 GPUsNeeds 165.0 GiB | 1 GPUNeeds 43.1 GiB |
| FLUX.1 [dev] | 1 GPUNeeds 38.9 GiB | 1 GPUNeeds 10.5 GiB |
| Whisper large-v3 | 1 GPUNeeds 4.5 GiB | 1 GPUNeeds 1.9 GiB |
Estimated by the GPU calculator for a 4,096-token context and one request: weights, KV cache and runtime overhead. Launch by workload
What runs well on the A100.
- Fine-tuningTrain on your data. Keep the weights.
- LLM inferenceAn OpenAI-compatible endpoint with vLLM.
- Batch jobsThousands of files, one session.
- RecipesLoRA fine-tuningFine-tune an open-weight LLM with LoRA or QLoRA using the Hugging Face TRL CLI on a Node Lodge GPU, then copy the adapter off the machine.
- RecipesvLLMServe an open-weight LLM with vLLM on a Node Lodge machine. Install with uv, start the OpenAI-compatible server, query it through an SSH tunnel.
Next to the A100.
| GPU | VRAM | Memory | Architecture | From |
|---|---|---|---|---|
| H100 | 80 GB | HBM3, HBM2e | Hopper | $2.89/h |
| A100This page | 80 GB | HBM2e | Ampere | $2.01/h |
| RTX PRO 6000 | 96 GB | GDDR7 | Blackwell | $2.16/h |
About the A100.
- How much does an NVIDIA A100 cost per hour?
- From $2.01 per GPU-hour on demand on Nov 14, 2026, 20:35 UTC, in US dollars before tax. Spot, interruptible: from $1.30 per GPU-hour. Billed per minute from prepaid credit, with no minimum.
- How much memory does the A100 have?
- 80 GB of HBM2e per GPU. Memory bandwidth: 2.04 TB/s (SXM) and 1.94 TB/s (PCIe, NVLink).
- Where are A100 GPUs located?
- Countries: Canada and United States. In partner datacenters, under Node Lodge Secure. The console shows the city of each machine.
- Which models run on one A100?
- At 16-bit: Llama 3.1 8B Instruct, Mistral 7B Instruct v0.3, Gemma 2 27B IT, Qwen2.5 32B Instruct, FLUX.1 [dev], and Whisper large-v3. At 4-bit: Llama 3.1 8B Instruct, Mistral 7B Instruct v0.3, Gemma 2 27B IT, Qwen2.5 32B Instruct, Mixtral 8x7B Instruct, Llama 3.3 70B Instruct, Qwen2.5 72B Instruct, FLUX.1 [dev], and Whisper large-v3. Size any other model with the GPU calculator.
Request access.
Tell us what you will run. Your access arrives by email.