You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

llama.native.ropescalingtype.md 1.1 kB

12345678910111213141516171819202122232425
  1. # RopeScalingType
  2. Namespace: LLama.Native
  3. RoPE scaling type.
  4. ```csharp
  5. public enum RopeScalingType
  6. ```
  7. Inheritance [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object) → [ValueType](https://docs.microsoft.com/en-us/dotnet/api/system.valuetype) → [Enum](https://docs.microsoft.com/en-us/dotnet/api/system.enum) → [RopeScalingType](./llama.native.ropescalingtype.md)<br>
  8. Implements [IComparable](https://docs.microsoft.com/en-us/dotnet/api/system.icomparable), [IFormattable](https://docs.microsoft.com/en-us/dotnet/api/system.iformattable), [IConvertible](https://docs.microsoft.com/en-us/dotnet/api/system.iconvertible)
  9. **Remarks:**
  10. C# equivalent of llama_rope_scaling_type
  11. ## Fields
  12. | Name | Value | Description |
  13. | --- | --: | --- |
  14. | Unspecified | -1 | No particular scaling type has been specified |
  15. | None | 0 | Do not apply any RoPE scaling |
  16. | Linear | 1 | Positional linear interpolation, as described by kaikendev: https://kaiokendev.github.io/til#extending-context-to-8k |
  17. | Yarn | 2 | YaRN scaling: https://arxiv.org/pdf/2309.00071.pdf |