GPU Utilization
22%
Memory Util.
18%
VRAM Usage
58 / 320 GB
Queue Depth
0
Node Count
1
Monthly Cost
$8,600.00
Network Configuration
VPC CIDR
10.2.0.0/16
Subnet
10.2.1.0/24
Private Endpoint
https://staging.osi-cloud.internal:8443
Scaling Configuration
Total GPUs
4
Total Nodes
1
Deployed Models
| Name | Model | Replicas | GPU Alloc. | Latency (P50/P99) | RPM | Tokens Today | Status |
|---|---|---|---|---|---|---|---|
| qwen-coder-staging | Qwen 2.5 Coder 32B | 1 | 1 | 0ms / 0ms | 0 | 0 | idle |