GPU Utilization
31%
Memory Util.
27%
VRAM Usage
173 / 768 GB
Queue Depth
0
Node Count
1
Monthly Cost
$14,200.00
Network Configuration
VPC CIDR
10.5.0.0/16
Subnet
10.5.1.0/24
Private Endpoint
https://eu-de.osi-cloud.internal:8443
Scaling Configuration
Total GPUs
4
Total Nodes
1
Deployed Models
| Name | Model | Replicas | GPU Alloc. | Latency (P50/P99) | RPM | Tokens Today | Status |
|---|---|---|---|---|---|---|---|
| deepseek-v4-pro-compliance | DeepSeek V4 Pro | 1 | 2 | 220ms / 610ms | 180 | 5.6M | active |