discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
vllm-project/semantic-router
An open, programmable decision layer for models and compute.
History and source changes · Reports and owner responses · Compare
Similar
- GeeeekExplorer/nano-vllm
Nano vLLM
Why this match
topics inference, llm, pytorch; language differs: Go → Python; license differs: Apache-2.0 → MIT
- LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Why this match
topics inference, llm, pytorch; language differs: Go → Python
- NVIDIA/FasterTransformer
Transformer related optimization, including BERT, GPT
Why this match
topics pytorch, transformer; language differs: Go → C++
- huggingface/text-generation-inference
Large Language Model Text Generation Inference
Why this match
topics inference, pytorch, transformer; language differs: Go → Python
- kuangliu/pytorch-cifar
95.47% on CIFAR10 with PyTorch
Why this match
topics pytorch; language differs: Go → Python; license differs: Apache-2.0 → MIT
- meta-llama/llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Why this match
topics llm, pytorch, vllm; language differs: Go → Jupyter Notebook; license differs: Apache-2.0 → MIT
- ggml-org/whisper.cpp
Port of OpenAI's Whisper model in C/C++
Why this match
topics inference, transformer; language differs: Go → C++; license differs: Apache-2.0 → MIT
- vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
Why this match
topics inference, pytorch, transformer; language differs: Go → Python