discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
History and source changes · Reports and owner responses · Compare
Similar
- GeeeekExplorer/nano-vllm
Nano vLLM
Why this match
topics inference, pytorch, transformer; license differs: Apache-2.0 → MIT
- ATH-MaaS/Pixelle-Video
🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine
Why this match
topics image-generation, video-generation
- NVIDIA/FasterTransformer
Transformer related optimization, including BERT, GPT
Why this match
topics pytorch, transformer; language differs: Python → C++
- huggingface/text-generation-inference
Large Language Model Text Generation Inference
Why this match
topics inference, pytorch, transformer
- vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Why this match
topics inference, model-serving, pytorch
- kuangliu/pytorch-cifar
95.47% on CIFAR10 with PyTorch
Why this match
topics pytorch; license differs: Apache-2.0 → MIT
- ggml-org/whisper.cpp
Port of OpenAI's Whisper model in C/C++
Why this match
topics inference, transformer; language differs: Python → C++; license differs: Apache-2.0 → MIT
- codertimo/BERT-pytorch
Google AI 2018 BERT pytorch implementation
Why this match
topics pytorch, transformer