GPU Utilization
89%
Memory Util.
76%
VRAM Usage
292 / 384 GB
Queue Depth
47
Node Count
2
Monthly Cost
$12,800.00
Network Configuration
VPC CIDR
10.3.0.0/16
Subnet
10.3.1.0/24
Private Endpoint
https://asia.osi-cloud.internal:8443
Scaling Configuration
Total GPUs
8
Total Nodes
2
Deployed Models
| Name | Model | Replicas | GPU Alloc. | Latency (P50/P99) | RPM | Tokens Today | Status |
|---|---|---|---|---|---|---|---|
| deepseek-v4-pro-asia | DeepSeek V4 Pro | 4 | 4 | 198ms / 520ms | 1.8K | 62.3M | scaling |