discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
bojieli/ai-infra-book
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
History and source changes · Reports and owner responses · Compare
Similar
- liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Why this match
topics llm, llm-inference, llm-serving; language differs: Python → HTML
- mistralai/mistral-inference
Official inference library for Mistral models
Why this match
topics llm, llm-inference; language differs: Python → Jupyter Notebook
- Vonng/ddia
《Designing Data-Intensive Application》DDIA 第一版 / 第二版 中文翻译
Why this match
topics book, distributed-systems; license differs: Apache-2.0 → CC-BY-4.0
- intel/ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
Why this match
topics gpu, llm
- anthony-chaudhary/fak
Agentic Runtime
Why this match
topics kv-cache, llm-inference, llm-serving; language differs: Python → Go
- LukeMathWalker/zero-to-production
Code for "Zero To Production In Rust", a book on API development using Rust.
Why this match
topics book; language differs: Python → Rust
- Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
Why this match
topics llm, llm-inference; language differs: Python → C++; license differs: Apache-2.0 → MIT
- RongleXie/java-books-collections
:books:Java编程书籍收集分享。Java programming books collection to share.:rocket:
Why this match
topics book