You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

llama.native.gpusplitmode.md 821 B

123456789101112131415161718192021222324
  1. # GPUSplitMode
  2. Namespace: LLama.Native
  3. ```csharp
  4. public enum GPUSplitMode
  5. ```
  6. Inheritance [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object) → [ValueType](https://docs.microsoft.com/en-us/dotnet/api/system.valuetype) → [Enum](https://docs.microsoft.com/en-us/dotnet/api/system.enum) → [GPUSplitMode](./llama.native.gpusplitmode.md)<br>
  7. Implements [IComparable](https://docs.microsoft.com/en-us/dotnet/api/system.icomparable), [IFormattable](https://docs.microsoft.com/en-us/dotnet/api/system.iformattable), [IConvertible](https://docs.microsoft.com/en-us/dotnet/api/system.iconvertible)
  8. **Remarks:**
  9. llama_split_mode
  10. ## Fields
  11. | Name | Value | Description |
  12. | --- | --: | --- |
  13. | None | 0 | Single GPU |
  14. | Layer | 1 | Split layers and KV across GPUs |
  15. | Row | 2 | split rows across GPUs |