Name | Version | Summary | date |
---|---|---|---|
happy-vllm | 1.1.9 | happy_vllm is a REST API for vLLM, production ready | 2024-09-17 14:37:06 |
benchmark-llm-serving | 1.0.1 | A library to benchmark LLMs via their API exposure | 2024-06-24 07:58:35 |
hour | day | week | total |
---|---|---|---|
31 | 1235 | 9844 | 250696 |