brainstate

FareedKhan-dev/train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

Python★ 13.1kMITGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. NVIDIA/Megatron-LM

    Ongoing research training transformer models at scale

    Python★ 18.3kGitHub ↗

    Why this match

    topics large-language-models, transformers

  2. 01-ai/Yi

    A series of large language models trained from scratch by developers @01-ai

    Jupyter Notebook★ 7.8kApache-2.0GitHub ↗

    Why this match

    topics large-language-models; language differs: Python → Jupyter Notebook; license differs: MIT → Apache-2.0

  3. stas00/ml-engineering

    Machine Learning Engineering Open Book

    Python★ 19.7kCC-BY-SA-4.0GitHub ↗

    Why this match

    topics large-language-models, llm, training; license differs: MIT → CC-BY-SA-4.0

  4. GreyDGL/PentestGPT

    Automated Penetration Testing Agentic Framework Powered by Large Language Models

    Python★ 16.3kMITGitHub ↗

    Why this match

    topics large-language-models, llm

  5. intel/ipex-llm

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Python★ 8.8kApache-2.0archivedGitHub ↗

    Why this match

    topics llm, transformers; license differs: MIT → Apache-2.0

  6. ZiChuanLan/meta-gateway

    OpenAI-compatible multi-channel LLM relay gateway with admin console

    Go★ 50MITGitHub ↗

    Why this match

    topics gemini, llm, openai; language differs: Python → Go

  7. eugeneyan/open-llms

    📋 A list of open LLMs available for commercial use.

    ★ 12.9kApache-2.0GitHub ↗

    Why this match

    topics large-language-models, llm; license differs: MIT → Apache-2.0

  8. zai-org/ChatGLM2-6B

    ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

    Python★ 15.5kGitHub ↗

    Why this match

    topics large-language-models, llm