Name | Version | Summary | date |
---|---|---|---|
happy-vllm | 1.1.9 | happy_vllm is a REST API for vLLM, production ready | 2024-09-17 14:37:06 |
benchmark-llm-serving | 1.0.1 | A library to benchmark LLMs via their API exposure | 2024-06-24 07:58:35 |
hour | day | week | total |
---|---|---|---|
37 | 1262 | 9864 | 250674 |