SGLang
An open source project for efficient serving and inference of large language models.
Overview
| Category | Ai |
| Self-Hostable | No |
| On-Prem | No |
An open source project for efficient serving and inference of large language models.
| Category | Ai |
| Self-Hostable | No |
| On-Prem | No |