|
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413 |
- # ModelParams
-
- Namespace: LLama.Common
-
- The parameters for initializing a LLama model.
-
- ```csharp
- public class ModelParams : LLama.Abstractions.ILLamaParams, LLama.Abstractions.IModelParams, LLama.Abstractions.IContextParams, System.IEquatable`1[[LLama.Common.ModelParams, LLamaSharp, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null]]
- ```
-
- Inheritance [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object) → [ModelParams](./llama.common.modelparams.md)<br>
- Implements [ILLamaParams](./llama.abstractions.illamaparams.md), [IModelParams](./llama.abstractions.imodelparams.md), [IContextParams](./llama.abstractions.icontextparams.md), [IEquatable<ModelParams>](https://docs.microsoft.com/en-us/dotnet/api/system.iequatable-1)
-
- ## Properties
-
- ### **ContextSize**
-
- ```csharp
- public Nullable<uint> ContextSize { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<UInt32>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **MainGpu**
-
- ```csharp
- public int MainGpu { get; set; }
- ```
-
- #### Property Value
-
- [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
-
- ### **SplitMode**
-
- ```csharp
- public GPUSplitMode SplitMode { get; set; }
- ```
-
- #### Property Value
-
- [GPUSplitMode](./llama.native.gpusplitmode.md)<br>
-
- ### **GpuLayerCount**
-
- ```csharp
- public int GpuLayerCount { get; set; }
- ```
-
- #### Property Value
-
- [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
-
- ### **Seed**
-
- ```csharp
- public uint Seed { get; set; }
- ```
-
- #### Property Value
-
- [UInt32](https://docs.microsoft.com/en-us/dotnet/api/system.uint32)<br>
-
- ### **UseMemorymap**
-
- ```csharp
- public bool UseMemorymap { get; set; }
- ```
-
- #### Property Value
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **UseMemoryLock**
-
- ```csharp
- public bool UseMemoryLock { get; set; }
- ```
-
- #### Property Value
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **ModelPath**
-
- ```csharp
- public string ModelPath { get; set; }
- ```
-
- #### Property Value
-
- [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
-
- ### **LoraAdapters**
-
- ```csharp
- public AdapterCollection LoraAdapters { get; set; }
- ```
-
- #### Property Value
-
- [AdapterCollection](./llama.abstractions.adaptercollection.md)<br>
-
- ### **LoraBase**
-
- ```csharp
- public string LoraBase { get; set; }
- ```
-
- #### Property Value
-
- [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
-
- ### **Threads**
-
- ```csharp
- public Nullable<uint> Threads { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<UInt32>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **BatchThreads**
-
- ```csharp
- public Nullable<uint> BatchThreads { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<UInt32>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **BatchSize**
-
- ```csharp
- public uint BatchSize { get; set; }
- ```
-
- #### Property Value
-
- [UInt32](https://docs.microsoft.com/en-us/dotnet/api/system.uint32)<br>
-
- ### **EmbeddingMode**
-
- ```csharp
- public bool EmbeddingMode { get; set; }
- ```
-
- #### Property Value
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **TensorSplits**
-
- ```csharp
- public TensorSplitsCollection TensorSplits { get; set; }
- ```
-
- #### Property Value
-
- [TensorSplitsCollection](./llama.abstractions.tensorsplitscollection.md)<br>
-
- ### **MetadataOverrides**
-
- ```csharp
- public List<MetadataOverride> MetadataOverrides { get; set; }
- ```
-
- #### Property Value
-
- [List<MetadataOverride>](https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.list-1)<br>
-
- ### **RopeFrequencyBase**
-
- ```csharp
- public Nullable<float> RopeFrequencyBase { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<Single>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **RopeFrequencyScale**
-
- ```csharp
- public Nullable<float> RopeFrequencyScale { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<Single>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **YarnExtrapolationFactor**
-
- ```csharp
- public Nullable<float> YarnExtrapolationFactor { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<Single>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **YarnAttentionFactor**
-
- ```csharp
- public Nullable<float> YarnAttentionFactor { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<Single>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **YarnBetaFast**
-
- ```csharp
- public Nullable<float> YarnBetaFast { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<Single>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **YarnBetaSlow**
-
- ```csharp
- public Nullable<float> YarnBetaSlow { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<Single>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **YarnOriginalContext**
-
- ```csharp
- public Nullable<uint> YarnOriginalContext { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<UInt32>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **YarnScalingType**
-
- ```csharp
- public Nullable<RopeScalingType> YarnScalingType { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<RopeScalingType>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **TypeK**
-
- ```csharp
- public Nullable<GGMLType> TypeK { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<GGMLType>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **TypeV**
-
- ```csharp
- public Nullable<GGMLType> TypeV { get; set; }
- ```
-
- #### Property Value
-
- [Nullable<GGMLType>](https://docs.microsoft.com/en-us/dotnet/api/system.nullable-1)<br>
-
- ### **NoKqvOffload**
-
- ```csharp
- public bool NoKqvOffload { get; set; }
- ```
-
- #### Property Value
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **DefragThreshold**
-
- ```csharp
- public float DefragThreshold { get; set; }
- ```
-
- #### Property Value
-
- [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
-
- ### **DoPooling**
-
- ```csharp
- public bool DoPooling { get; set; }
- ```
-
- #### Property Value
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **VocabOnly**
-
- ```csharp
- public bool VocabOnly { get; set; }
- ```
-
- #### Property Value
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **Encoding**
-
- ```csharp
- public Encoding Encoding { get; set; }
- ```
-
- #### Property Value
-
- [Encoding](https://docs.microsoft.com/en-us/dotnet/api/system.text.encoding)<br>
-
- ## Constructors
-
- ### **ModelParams(String)**
-
-
-
- ```csharp
- public ModelParams(string modelPath)
- ```
-
- #### Parameters
-
- `modelPath` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
- The model path.
-
- ## Methods
-
- ### **ToString()**
-
- ```csharp
- public string ToString()
- ```
-
- #### Returns
-
- [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
-
- ### **PrintMembers(StringBuilder)**
-
- ```csharp
- protected bool PrintMembers(StringBuilder builder)
- ```
-
- #### Parameters
-
- `builder` [StringBuilder](https://docs.microsoft.com/en-us/dotnet/api/system.text.stringbuilder)<br>
-
- #### Returns
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **GetHashCode()**
-
- ```csharp
- public int GetHashCode()
- ```
-
- #### Returns
-
- [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
-
- ### **Equals(Object)**
-
- ```csharp
- public bool Equals(object obj)
- ```
-
- #### Parameters
-
- `obj` [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object)<br>
-
- #### Returns
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **Equals(ModelParams)**
-
- ```csharp
- public bool Equals(ModelParams other)
- ```
-
- #### Parameters
-
- `other` [ModelParams](./llama.common.modelparams.md)<br>
-
- #### Returns
-
- [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
-
- ### **<Clone>$()**
-
- ```csharp
- public ModelParams <Clone>$()
- ```
-
- #### Returns
-
- [ModelParams](./llama.common.modelparams.md)<br>
|