Skip to content

LLM inference in C/C++, with Nexa AI's support for audio language model and swift binding

License

Notifications You must be signed in to change notification settings

NexaAI/llama.cpp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Llama cpp

The original Llama cpp implementation is available at here.

To submit changes:

git add .
git commit -m "commit message"
git push origin master

To build this project:

make clean
cmake -B build
cmake --build build --config Release -j 24

Error handling

If you got below error for kompute:

fatal: cannot chdir to '../../../ggml/src/kompute': No such file or directory

You can fix it by running below command:

git reset ggml_llama/src/kompute

About

LLM inference in C/C++, with Nexa AI's support for audio language model and swift binding

Resources

License

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 60.1%
  • C 19.2%
  • Cuda 7.0%
  • Python 6.4%
  • Objective-C 2.4%
  • Metal 2.4%
  • Other 2.5%