Try our Chrome extension
Easily add the current web-page from your browser directly into your changedetection.io tool, more great features coming soon!
Chrome Webstore
Changedetection.io needs your support!
You can help us by supporting changedetection.io on these platforms;
- Rate us at AlternativeTo.net
- Star us on GitHub
- Follow us at Twitter/X
- G2 Software reviews
- Check us out on LinkedIn
- And tell your friends and colleagues :)
The more popular changedetection.io is, the more time we can dedicate to adding amazing features!
Many thanks :)
changedetection.io team
-
Share this link:
尚未 秒前
False
尚未 秒前
触发文本 忽略文本 阻止文本
7小时前
Skip to content
Navigation Menu
Sign in Appearance settings
* Platform
+ AI CODE CREATION
o GitHub Copilot Write better code with AI
o GitHub Copilot app Direct agents from issue to merge
o MCP Registry Integrate external tools
+ DEVELOPER WORKFLOWS
o Actions Automate any workflow
o Codespaces Instant dev environments
o Issues Plan and track work
o Code Review Manage code changes
o Code Quality Enforce quality at merge
+ APPLICATION SECURITY
o GitHub Advanced Security Find and fix vulnerabilities
o Code security Secure your code as you build
o Secret protection Stop leaks before they start
+ EXPLORE
o Why GitHub
o Documentation
o Blog
o Changelog
o Marketplace
View all features
* Solutions
+ BY COMPANY SIZE
o Enterprises
o Small and medium teams
o Startups
o Nonprofits
+ BY USE CASE
o App Modernization
o DevSecOps
o DevOps
o CI/CD
o View all use cases
+ BY INDUSTRY
o Healthcare
o Financial services
o Manufacturing
o Government
o View all industries
View all solutions
* Resources
+ EXPLORE BY TOPIC
o AI
o Software Development
o DevOps
o Security
o View all topics
+ EXPLORE BY TYPE
o Customer stories
o Events & webinars
o Ebooks & reports
o Business insights
o GitHub Skills
+ SUPPORT & SERVICES
o Documentation
o Customer support
o Community forum
o Trust center
o Partners
View all resources
* Open Source
+ COMMUNITY
o GitHub Sponsors Fund open source developers
+ PROGRAMS
o Security Lab
o Maintainer Community
o Accelerator
o GitHub Stars
o Archive Program
+ REPOSITORIES
o Topics
o Trending
o Collections
* Enterprise
+ ENTERPRISE SOLUTIONS
o Enterprise platform AI-powered developer platform
+ AVAILABLE ADD-ONS
o GitHub Advanced Security Enterprise-grade security features
o Copilot for Business Enterprise-grade AI features
o Premium Support Enterprise-grade 24/7 support
* Pricing
Type / to search
Sign in
Sign up Appearance settings
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
Uh oh!
There was an error while loading. Please reload this page.
ggml-org / llama.cpp Public
* Notifications You must be signed in to change notification settings
* Fork 21.5k
* Star 123k
* Code
* Issues 688
* Pull requests 1.3k
* Discussions
* Actions
* Projects
* Wiki
* Security and quality 13
* Insights
Additional navigation options
* Code
* Issues
* Pull requests
* Discussions
* Actions
* Projects
* Wiki
* Security and quality
* Insights
master
Branches Tags
Go to file
Code
Open more actions menu
Folders and files
Name Name Last commit message Last commit date
Latest commit
History
10,335 Commits
10,335 Commits
.devops .devops
.gemini .gemini
.github .github
.pi/ gg .pi/ gg
app app
benches benches
ci ci
cmake cmake
common common
conversion conversion
docs docs
examples examples
ggml ggml
gguf-py gguf-py
grammars grammars
include include
licenses licenses
media media
models models
pocs pocs
requirements requirements
scripts scripts
skills skills
src src
tests tests
tools tools
vendor vendor
.clang-format .clang-format
.clang-tidy .clang-tidy
.dockerignore .dockerignore
.ecrc .ecrc
.editorconfig .editorconfig
.flake8 .flake8
.gitignore .gitignore
.gitmodules .gitmodules
.pre-commit-config.yaml .pre-commit-config.yaml
AGENTS.md AGENTS.md
AUTHORS AUTHORS
CLAUDE.md CLAUDE.md
CMakeLists.txt CMakeLists.txt
CMakePresets.json CMakePresets.json
CODEOWNERS CODEOWNERS
CONTRIBUTING.md CONTRIBUTING.md
LICENSE LICENSE
Makefile Makefile
README.md README.md
SECURITY.md SECURITY.md
build-xcframework.sh build-xcframework.sh
convert_hf_to_gguf.py convert_hf_to_gguf.py
convert_hf_to_gguf_update.py convert_hf_to_gguf_update.py
convert_llama_ggml_to_gguf.py convert_llama_ggml_to_gguf.py
convert_lora_to_gguf.py convert_lora_to_gguf.py
flake.nix flake.nix
mypy.ini mypy.ini
pyproject.toml pyproject.toml
pyrightconfig.json pyrightconfig.json
requirements.txt requirements.txt
ty.toml ty.toml
View all files
Repository files navigation
*
* README
* Contributing
* MIT license
* Security
More items
llama.cpp
LLM inference in C/C++
manifesto / ggml / ops / maintainer PRs / dev branches / compile times / lib llama API / llama-server REST API
Quick start
A few options to get llama.cpp installed on your machine:
* Visit https://llama.app and follow the instructions
* Run with Docker - see our Docker documentation
* Download pre-built binaries from the releases page
* Build from source by cloning this repository - check out our build guide
Once installed:
# Download and run a model directly from Hugging Face
llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF
# Launch OpenAI-compatible API server
llama serve -hf ggml-org/Qwen3.5-0.8B-GGUF
VLM session with llama cli Built-in web UI against llama serve
Description
The main goal of llama.cpp is to enable LLM (and VLM) inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
* Plain C/C++ implementation without any dependencies
* Apple silicon is a first-class citizen - optimized via ARM NEON, Accelerate and Metal frameworks
* AVX, AVX2, AVX512 and AMX support for x86 architectures
* RVV, ZVFH, ZFH, ZICBOP and ZIHINTPAUSE support for RISC-V architectures
* 1.5-bit, 2-bit, 3-bit, 4-bit, 5-bit, 6-bit, and 8-bit integer quantization for faster inference and reduced memory use
* Custom CUDA kernels for running LLMs on NVIDIA GPUs (support for AMD GPUs via HIP and Moore Threads GPUs via MUSA)
* Vulkan and SYCL backend support
* CPU+GPU hybrid inference to partially accelerate models larger than the total VRAM capacity
The llama.cpp project is build on top of the ggml library.
Supported backends
Backend Target devices
BLAS All
BLIS All
CANN Ascend NPU
CUDA Nvidia GPU
HIP AMD GPU
Hexagon [In Progress] Snapdragon
IBM zDNN IBM Z & LinuxONE
MUSA Moore Threads GPU
Metal Apple Silicon
OpenCL Adreno GPU
OpenVINO [In Progress] Intel CPUs, GPUs, and NPUs
RPC All
SYCL Intel GPU
VirtGPU VirtGPU APIR
Vulkan GPU
WebGPU All
ZenDNN AMD CPU
Documentation
Tools
* cli
* completion
* server
* GBNF grammars
Development
* How to build
* Running on Docker
* Build on Android
* Multi-GPU usage
* Performance troubleshooting
* GGML tips & tricks
* XCFramework
* Completions
* Models
Contributing
* Contributors can open PRs
* Collaborators will be invited based on contributions
* Maintainers can push to branches in the llama.cpp repo and merge PRs into the master branch
* Any help with managing issues, PRs and projects is very appreciated!
* Read the CONTRIBUTING.md for more information
Acknowledgements
* yhirose/cpp-httplib - Single-header HTTP server, used by llama-server - MIT license
* stb-image - Single-header image format decoder, used by multimodal subsystem - Public domain
* nlohmann/json - Single-header JSON library, used by various tools/examples - MIT License
* miniaudio.h - Single-header audio format decoder, used by multimodal subsystem - Public domain
* subprocess.h - Single-header process launching solution for C and C++ - Public domain
About
LLM inference in C/C++
llama.app
Topics
ggml
Resources
Readme
MIT license
Contributing
Contributing
Security policy
Security policy
Activity
Custom properties
Stars
123.2k stars
Watchers
812 watching
Forks
21.5k forks
Report repository
Releases
Packages
Used by
Contributors
Languages
Footer
© 2026 GitHub, Inc.
Footer navigation
* Terms
* Privacy
* Security
* Status
* Community
* Docs
* Contact
* Manage cookies
* Do not share my personal information
You can’t perform that action at this time.
目前差异仅按文本比较，非图形对比，只提供最新截图。
截图需要支持截图的内容抓取器（如 Sockpuppetbrowser、Selenium 等）。