brainstate

intel/ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Python★ 8.8kApache-2.0archivedGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. kuangliu/pytorch-cifar

    95.47% on CIFAR10 with PyTorch

    Python★ 6.4kMITGitHub ↗

    Why this match

    topics pytorch; license differs: Apache-2.0 → MIT

  2. huggingface/peft

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Python★ 21.9kApache-2.0GitHub ↗

    Why this match

    topics llm, pytorch, transformers

  3. FareedKhan-dev/train-llm-from-scratch

    A straightforward method for training your LLM, from downloading data to generating text.

    Python★ 13.1kMITGitHub ↗

    Why this match

    topics llm, transformers; license differs: Apache-2.0 → MIT

  4. NielsRogge/Transformers-Tutorials

    This repository contains demos I made with the Transformers library by HuggingFace.

    Jupyter Notebook★ 11.8kMITGitHub ↗

    Why this match

    topics pytorch, transformers; language differs: Python → Jupyter Notebook; license differs: Apache-2.0 → MIT

  5. fastai/fastai

    The fastai deep learning library

    Jupyter Notebook★ 28.3kApache-2.0GitHub ↗

    Why this match

    topics gpu, pytorch; language differs: Python → Jupyter Notebook

  6. bitsandbytes-foundation/bitsandbytes

    Accessible large language models via k-bit quantization for PyTorch.

    Python★ 8.5kMITGitHub ↗

    Why this match

    topics llm, pytorch; license differs: Apache-2.0 → MIT

  7. GeeeekExplorer/nano-vllm

    Nano vLLM

    Python★ 16.3kMITGitHub ↗

    Why this match

    topics llm, pytorch; license differs: Apache-2.0 → MIT

  8. stas00/ml-engineering

    Machine Learning Engineering Open Book

    Python★ 19.7kCC-BY-SA-4.0GitHub ↗

    Why this match

    topics llm, pytorch, transformers; license differs: Apache-2.0 → CC-BY-SA-4.0