What are different GPUs

 H100 GPUs

8 GPU - 640 GB VRAM - 160 vCPU - 1920 GB RAM

Boot disk: 2 TB NVMe- Scratch disk: 40 TB NVMe

Cost $2.99/GPU/hr

NVIDIA H100

1 GPU - 80 GB VRAM - 20 vCPU - 240 GB RAM

Boot disk: 720 GB NVMe- Scratch disk: 5 TB NVMe

$3.39/GPU/hr

NVIDIA L40S

1 GPU - 48 GB VRAM - 8 vCPU - 64 GB RAM

Boot disk: 500 GB NVMe

Cost: $1.57 per hour 

NVIDIA RTX6000 ADA 

1 GPU - 48 GB VRAM - 8 vCPU - 64 GB RAM

Cost $1.89/GPU/hr

NVIDIA RTX4000 ADA

1 GPU - 20 GB VRAM - 8 vCPU - 32 GB RAM

Boot disk: 500 GB NVMe

Cost: $0.76/GPU/hr

What are models typically available for these GPUs 

Select an image

meta-llama/Llama

Details

172747345

3.1-70B-Instruct

Qwen/Qwen

Details

2-7B-Instruct

mistralai/Mixtral

Details

167625008

8x7B-Instruct-v0.1

mistralai/Mistral

Details

7B-Instruct-v0.3

NousResearch/Hermes

Details

172779495

3-Llama-3.1-70B

NousResearch/Nous

Details

Hermes-2-Mixtral-8x7B-DP0

google/gemma

Details

172758995

2-9b-it

DeepSeek/R1

Details

177155106

671B