netstandard2.0;net6.0;net7.0;net8.0
LLama
enable
10
AnyCPU;x64;Arm64
True
0.11.0
Rinne, Martin Evans, jlsantiago and all the other contributors in https://github.com/SciSharp/LLamaSharp/graphs/contributors.
SciSharp STACK
true
MIT, SciSharp STACK $([System.DateTime]::UtcNow.ToString(yyyy))
https://github.com/SciSharp/LLamaSharp
git
https://avatars3.githubusercontent.com/u/44989469?s=200&v=4
LLama, LLM, GPT, ChatGPT, NLP, AI, Chat Bot, SciSharp
LLamaSharp is a cross-platform library to run 🦙LLaMA/LLaVA model (and others) in your local device.
Based on [llama.cpp](https://github.com/ggerganov/llama.cpp), inference with LLamaSharp is efficient on both CPU and GPU.
With the higher-level APIs and RAG support, it's convenient to deploy LLM (Large Language Model) in your application with LLamaSharp.
LLamaSharp 0.11.0 added support for multi-modal (LLaVA), improved the BatchedExecutor and added state management of `ChatSession`.
MIT
packages
AnyCPU;x64;Arm64
LLamaSharp
Debug;Release;GPU
false
README.md
True