You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

llama.native.llamatokentype.md 1.1 kB

12345678910111213141516171819202122232425
  1. # LLamaTokenType
  2. Namespace: LLama.Native
  3. Token Types
  4. ```csharp
  5. public enum LLamaTokenType
  6. ```
  7. Inheritance [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object) → [ValueType](https://docs.microsoft.com/en-us/dotnet/api/system.valuetype) → [Enum](https://docs.microsoft.com/en-us/dotnet/api/system.enum) → [LLamaTokenType](./llama.native.llamatokentype.md)<br>
  8. Implements [IComparable](https://docs.microsoft.com/en-us/dotnet/api/system.icomparable), [IFormattable](https://docs.microsoft.com/en-us/dotnet/api/system.iformattable), [IConvertible](https://docs.microsoft.com/en-us/dotnet/api/system.iconvertible)
  9. **Remarks:**
  10. C# equivalent of llama_token_get_type
  11. ## Fields
  12. | Name | Value | Description |
  13. | --- | --: | --- |
  14. | LLAMA_TOKEN_TYPE_UNDEFINED | 0 | No specific type has been set for this token |
  15. | LLAMA_TOKEN_TYPE_NORMAL | 1 | This is a "normal" token |
  16. | LLAMA_TOKEN_TYPE_UNKNOWN | 2 | An "unknown" character/text token e.g. &lt;unk&gt; |
  17. | LLAMA_TOKEN_TYPE_CONTROL | 3 | A special control token e.g. &lt;/s&gt; |