llama.cpp-0.4.0
LLM inference system
Back to search · Project homepage
Description
Inference of Meta's LLaMA model (and others) in pure C/C++ with
minimal setup and state-of-the-art performance on a wide range
of hardware
Package information
- Ports path
- misc/llama.cpp
- Package architecture
- amd64
- Maintainer
- Kirill A. Korinsky <kirill@korins.ky>
- Categories
- misc
- Available flavors
- None listed
- Only for architectures
- aarch64, amd64, arm, i386, mips64, mips64el, powerpc, powerpc64, riscv64, sparc64, alpha, hppa
These are ports metadata. Binary availability depends on the release, architecture and mirror. Build and test dependencies are not an installation checklist.
Direct dependencies
Library
Build
- devel/cmake/core STEM->=4
- devel/ninja