You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Yaohui Liu 1fca06dc7f
fix: n_gpu_layers miss in llama context.
2 years ago
..
LLamaContextParams.cs fix: n_gpu_layers miss in llama context. 2 years ago
LLamaFtype.cs feat: run quantization in csharp. 2 years ago
LLamaTokenData.cs feat: add the framework and basic usages. 2 years ago
LLamaTokenDataArray.cs feat: add the framework and basic usages. 2 years ago
NativeApi.Quantize.cs refactor: use official api of quantization instead. 2 years ago
NativeApi.Sampling.cs feat: add gpt model. 2 years ago
NativeApi.cs feat: add check for backend package. 2 years ago
NativeInfo.cs feat: add the framework and basic usages. 2 years ago
SafeLLamaContextHandle.cs feat: add get-embedding api to LLamaModel. 2 years ago
SafeLLamaHandleBase.cs feat: add get-embedding api to LLamaModel. 2 years ago
SamplingApi.cs feat: add gpt model. 2 years ago

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。

C# Text Metal JavaScript HTML+Razor other