# InferenceParams Namespace: LLama.Common The parameters used for inference. ```csharp public class InferenceParams : LLama.Abstractions.IInferenceParams, System.IEquatable`1[[LLama.Common.InferenceParams, LLamaSharp, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null]] ``` Inheritance [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object) → [InferenceParams](./llama.common.inferenceparams.md)
Implements [IInferenceParams](./llama.abstractions.iinferenceparams.md), [IEquatable<InferenceParams>](https://docs.microsoft.com/en-us/dotnet/api/system.iequatable-1) ## Properties ### **TokensKeep** number of tokens to keep from initial prompt ```csharp public int TokensKeep { get; set; } ``` #### Property Value [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)
### **MaxTokens** how many new tokens to predict (n_predict), set to -1 to inifinitely generate response until it complete. ```csharp public int MaxTokens { get; set; } ``` #### Property Value [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)
### **LogitBias** logit bias for specific tokens ```csharp public Dictionary LogitBias { get; set; } ``` #### Property Value [Dictionary<LLamaToken, Single>](https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.dictionary-2)
### **AntiPrompts** Sequences where the model will stop generating further tokens. ```csharp public IReadOnlyList AntiPrompts { get; set; } ``` #### Property Value [IReadOnlyList<String>](https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.ireadonlylist-1)
### **TopK** ```csharp public int TopK { get; set; } ``` #### Property Value [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)
### **TopP** ```csharp public float TopP { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **MinP** ```csharp public float MinP { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **TfsZ** ```csharp public float TfsZ { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **TypicalP** ```csharp public float TypicalP { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **Temperature** ```csharp public float Temperature { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **RepeatPenalty** ```csharp public float RepeatPenalty { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **RepeatLastTokensCount** ```csharp public int RepeatLastTokensCount { get; set; } ``` #### Property Value [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)
### **FrequencyPenalty** ```csharp public float FrequencyPenalty { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **PresencePenalty** ```csharp public float PresencePenalty { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **Mirostat** ```csharp public MirostatType Mirostat { get; set; } ``` #### Property Value [MirostatType](./llama.common.mirostattype.md)
### **MirostatTau** ```csharp public float MirostatTau { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **MirostatEta** ```csharp public float MirostatEta { get; set; } ``` #### Property Value [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)
### **PenalizeNL** ```csharp public bool PenalizeNL { get; set; } ``` #### Property Value [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)
### **Grammar** ```csharp public SafeLLamaGrammarHandle Grammar { get; set; } ``` #### Property Value [SafeLLamaGrammarHandle](./llama.native.safellamagrammarhandle.md)
### **SamplingPipeline** ```csharp public ISamplingPipeline SamplingPipeline { get; set; } ``` #### Property Value [ISamplingPipeline](./llama.sampling.isamplingpipeline.md)
## Constructors ### **InferenceParams()** ```csharp public InferenceParams() ``` ## Methods ### **ToString()** ```csharp public string ToString() ``` #### Returns [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)
### **PrintMembers(StringBuilder)** ```csharp protected bool PrintMembers(StringBuilder builder) ``` #### Parameters `builder` [StringBuilder](https://docs.microsoft.com/en-us/dotnet/api/system.text.stringbuilder)
#### Returns [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)
### **GetHashCode()** ```csharp public int GetHashCode() ``` #### Returns [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)
### **Equals(Object)** ```csharp public bool Equals(object obj) ``` #### Parameters `obj` [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object)
#### Returns [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)
### **Equals(InferenceParams)** ```csharp public bool Equals(InferenceParams other) ``` #### Parameters `other` [InferenceParams](./llama.common.inferenceparams.md)
#### Returns [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)
### **<Clone>$()** ```csharp public InferenceParams $() ``` #### Returns [InferenceParams](./llama.common.inferenceparams.md)