Show HN: A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)

4 months ago 28

Configuration

Protocol

API URL

API Key

Models (one per line)

Custom Prompts (one per line)

Test Rounds

Results

Model Prompt Round First Token (ms)Output Speed (t/s) Result Error Status

Statistics

Model Avg First Token (ms) Avg Output Speed (t/s) Success Rate

History Records

Real-time Result Viewer

deepseek-ai/DeepSeek-R1-0528 | Round 1 | Testing

First Token (ms) 0ms

Output Speed (t/s) 0 t/s

Tokens 0

Test Result Detail

- | Round - | -

-

First Token (ms) -

Output Speed (t/s) -

Tokens -

Read Entire Article