BurstGPT Without Fails
Source: BurstGPT Hugging Face v1.1
Files
| file | rows |
|---|
| traces/burstgpt/data/BurstGPT_without_fails_1.csv | 1,404,294 |
| traces/burstgpt/data/BurstGPT_without_fails_2.csv | 3,784,213 |
Schema
`Timestamp`, `Request tokens`, `Response tokens`, `Model`, `Log Type`
Scale
| metric | value |
|---|
| requests | 5,188,507 |
| duration_s | 10,454,390.0 |
| avg_rps | 0.496 |
Graphs
burstgpt_without_fails_token_hist
burstgpt_without_fails_input_output_scatter
burstgpt_without_fails_arrival_rate
burstgpt_without_fails_model_counts
burstgpt_without_fails_log_type_counts
BurstGPT Long-Horizon Views
burstgpt_full_trace_rps_5min
burstgpt_full_trace_rps_1h
burstgpt_full_trace_rps_24h
burstgpt_full_trace_rps_7d
burstgpt_full_trace_rps_30d
burstgpt_daily_volume
burstgpt_hour_of_day
burstgpt_day_of_week
burstgpt_day_hour_heatmap
burstgpt_zoom_densest_1h
burstgpt_zoom_densest_6h
burstgpt_zoom_densest_24h
Token Statistics
| metric | mean | p50 | p90 | p95 | p99 | max |
|---|
| input | 359.2 | 218.0 | 607.0 | 1,102.0 | 2,991.0 | 31,407.0 |
| output | 60.077 | 7.000 | 149.0 | 251.0 | 727.0 | 12,472.0 |
| total | 419.3 | 230.0 | 774.0 | 1,487.0 | 3,160.0 | 31,924.0 |
input Buckets
| bucket | count | pct |
|---|
| 1-16 | 6,693 | 0.13% |
| 17-32 | 18,195 | 0.35% |
| 33-64 | 90,160 | 1.74% |
| 65-128 | 427,247 | 8.23% |
| 129-256 | 2,989,515 | 57.62% |
| 257-512 | 845,322 | 16.29% |
| 513-1024 | 536,671 | 10.34% |
| 1025-2048 | 138,795 | 2.68% |
| 2049-4096 | 133,566 | 2.57% |
| 4097-8192 | 1,940 | 0.04% |
| 8193-16384 | 380 | 0.01% |
| 16385-32768 | 23 | 0.00% |
output Buckets
| bucket | count | pct |
|---|
| 1-16 | 3,019,772 | 58.20% |
| 17-32 | 817,339 | 15.75% |
| 33-64 | 372,440 | 7.18% |
| 65-128 | 347,163 | 6.69% |
| 129-256 | 379,863 | 7.32% |
| 257-512 | 157,940 | 3.04% |
| 513-1024 | 57,053 | 1.10% |
| 1025-2048 | 31,498 | 0.61% |
| 2049-4096 | 5,243 | 0.10% |
| 4097-8192 | 180 | 0.00% |
| 8193-16384 | 16 | 0.00% |
total Buckets
| bucket | count | pct |
|---|
| 1-16 | 45 | 0.00% |
| 17-32 | 2,978 | 0.06% |
| 33-64 | 32,875 | 0.63% |
| 65-128 | 305,464 | 5.89% |
| 129-256 | 2,956,810 | 56.99% |
| 257-512 | 986,403 | 19.01% |
| 513-1024 | 518,431 | 9.99% |
| 1025-2048 | 199,298 | 3.84% |
| 2049-4096 | 178,440 | 3.44% |
| 4097-8192 | 7,272 | 0.14% |
| 8193-16384 | 464 | 0.01% |
| 16385-32768 | 27 | 0.00% |
Arrival Pattern
| window | nonempty_windows | mean/window | p95/window | p99/window | max/window |
|---|
| 1s | 2,260,499 | 2.295 | 6.000 | 10.000 | 41 |
| 60s | 113,402 | 45.753 | 209.0 | 343.0 | 1,104 |
| 300s | 28,077 | 184.8 | 928.2 | 1,543.0 | 4,703 |
| 3600s | 2,753 | 1,884.7 | 9,414.4 | 14,698.6 | 33,305 |
Model Counts
| model | count |
|---|
| ChatGPT | 4,886,031 |
| GPT-4 | 302,476 |
Log Type Counts
| log_type | count |
|---|
| Conversation log | 225,152 |
| API log | 4,963,355 |
Docs
`traces/burstgpt/README.md`