discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
magnitudedev/magnitude
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
History and source changes · Reports and owner responses · Compare