scisharp
/
LLamaSharp
Not watched
1
0
Fork 0
Code
Releases 17 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
981 Commits
8 Branches
333 MB
42 Download
Tree: a2e29d393c
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'a2e29d393c'
${ noResults }
LLamaSharp/LLama/Native/LLamaTokenType.cs

LLamaTokenType.cs 298 B
Raw Normal View History

Code cleanup driven by R# suggestions: - Made `NativeApi` into a `static class` (it's not intended to be instantiated) - Moved `LLamaTokenType` enum out into a separate file - Made `LLamaSeqId` and `LLamaPos` into `record struct`, convenient to have equality etc
1 year ago
​
​
​
​
​
​
​
​
​
​
​
 123456789101112 
  1. namespace LLama.Native;

  2. 

  3. public enum LLamaTokenType

  4. {

  5.     LLAMA_TOKEN_TYPE_UNDEFINED = 0,

  6.     LLAMA_TOKEN_TYPE_NORMAL = 1,

  7.     LLAMA_TOKEN_TYPE_UNKNOWN = 2,

  8.     LLAMA_TOKEN_TYPE_CONTROL = 3,

  9.     LLAMA_TOKEN_TYPE_USER_DEFINED = 4,

  10.     LLAMA_TOKEN_TYPE_UNUSED = 5,

  11.     LLAMA_TOKEN_TYPE_BYTE = 6,

  12. }

C#/.NET上易用的LLM高性能推理框架，支持LLaMA和LLaVA系列模型。