scisharp
/
LLamaSharp
Not watched
1
0
Fork 0
Code
Releases 17 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
981 Commits
8 Branches
333 MB
27 Download
 
 
 
 
 
 
Tree: a2e29d393c
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'a2e29d393c'
${ noResults }
LLamaSharp/LLama/Native
Martin Evans a2e29d393c Swapped `StatelessExecutor` to use `llama_decode`! 1 year ago
..
DecodeResult.cs Swapped `StatelessExecutor` to use `llama_decode`! 1 year ago
GGMLType.cs Added a comment on the type itself 1 year ago
GroupDisposable.cs - Added `GroupDisposable` to dispose a collection of items all together 1 year ago
LLamaBatch.cs - Removed some unused `eval` methods. 1 year ago
LLamaBeamView.cs Switched form using raw integers, to a `LLamaToken` struct 1 year ago
LLamaBeamsState.cs Debugging slowdown by removing some things: 2 years ago
LLamaContextParams.cs Updated binaries: 1 year ago
LLamaFtype.cs Initial changes required for GGUF support 2 years ago
LLamaGrammarElement.cs Improved test coverage. Discovered some issues: 2 years ago
LLamaKvCacheView.cs Code cleanup driven by R# suggestions: 1 year ago
LLamaLogLevel.cs Extract LLamaLogLevel, Remove Logger class 2 years ago
LLamaModelMetadataOverride.cs Fixed alignment of value fields in `LLamaModelMetadataOverride` 1 year ago
LLamaModelParams.cs - Added `GroupDisposable` to dispose a collection of items all together 1 year ago
LLamaModelQuantizeParams.cs Added the `pure` field to `LLamaModelQuantizeParams` (it's been added to llama.cpp) 1 year ago
LLamaNativeBatch.cs Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch. 1 year ago
LLamaPos.cs Code cleanup driven by R# suggestions: 1 year ago
LLamaSeqId.cs Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch. 1 year ago
LLamaToken.cs Added a test with examples of troublesome strings from 0.9.1 1 year ago
LLamaTokenData.cs made casts to/from int explicit, fixed places affected 1 year ago
LLamaTokenDataArray.cs made casts to/from int explicit, fixed places affected 1 year ago
LLamaTokenType.cs Code cleanup driven by R# suggestions: 1 year ago
NativeApi.BeamSearch.cs Code cleanup driven by R# suggestions: 1 year ago
NativeApi.Grammar.cs Switched form using raw integers, to a `LLamaToken` struct 1 year ago
NativeApi.Load.cs Moved some native methods to do with creating/destroying resources into their respective handles. There is **no** safe way to call most of these methods, everything must be done through through handles. 1 year ago
NativeApi.Quantize.cs Code cleanup driven by R# suggestions: 1 year ago
NativeApi.Sampling.cs Switched form using raw integers, to a `LLamaToken` struct 1 year ago
NativeApi.cs Moved some native methods into `SafeLlamaModelHandle`, these methods are all wrapped in safer accessors with no extra costs so there is no need to expose them. 1 year ago
NativeLibraryConfig.cs Code cleanup driven by R# suggestions: 1 year ago
RopeScalingType.cs Exposed YaRN scaling parameters in IContextParams 2 years ago
SafeLLamaContextHandle.cs Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch. 1 year ago
SafeLLamaGrammarHandle.cs Switched form using raw integers, to a `LLamaToken` struct 1 year ago
SafeLLamaHandleBase.cs Moved some native methods to do with creating/destroying resources into their respective handles. There is **no** safe way to call most of these methods, everything must be done through through handles. 1 year ago
SafeLlamaModelHandle.cs Merge pull request #438 from martindevans/cleanup_model_unnecessary_unsafe 1 year ago
SamplingApi.cs Switched form using raw integers, to a `LLamaToken` struct 1 year ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

C#/.NET上易用的LLM高性能推理框架，支持LLaMA和LLaVA系列模型。

C# Text Metal JavaScript HTML+Razor other