sgl-project/ genai-bench star history
Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
sgl-project/genai-bench has 335 GitHub stars as of . Source: GitHub's public API.