You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

llama.llamaparams.md 7.5 kB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349
  1. # LLamaParams
  2. Namespace: LLama
  3. ```csharp
  4. public struct LLamaParams
  5. ```
  6. Inheritance [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object) → [ValueType](https://docs.microsoft.com/en-us/dotnet/api/system.valuetype) → [LLamaParams](./llama.llamaparams.md)
  7. ## Fields
  8. ### **seed**
  9. ```csharp
  10. public int seed;
  11. ```
  12. ### **n_threads**
  13. ```csharp
  14. public int n_threads;
  15. ```
  16. ### **n_predict**
  17. ```csharp
  18. public int n_predict;
  19. ```
  20. ### **n_parts**
  21. ```csharp
  22. public int n_parts;
  23. ```
  24. ### **n_ctx**
  25. ```csharp
  26. public int n_ctx;
  27. ```
  28. ### **n_batch**
  29. ```csharp
  30. public int n_batch;
  31. ```
  32. ### **n_keep**
  33. ```csharp
  34. public int n_keep;
  35. ```
  36. ### **logit_bias**
  37. ```csharp
  38. public Dictionary<int, float> logit_bias;
  39. ```
  40. ### **top_k**
  41. ```csharp
  42. public int top_k;
  43. ```
  44. ### **top_p**
  45. ```csharp
  46. public float top_p;
  47. ```
  48. ### **tfs_z**
  49. ```csharp
  50. public float tfs_z;
  51. ```
  52. ### **typical_p**
  53. ```csharp
  54. public float typical_p;
  55. ```
  56. ### **temp**
  57. ```csharp
  58. public float temp;
  59. ```
  60. ### **repeat_penalty**
  61. ```csharp
  62. public float repeat_penalty;
  63. ```
  64. ### **repeat_last_n**
  65. ```csharp
  66. public int repeat_last_n;
  67. ```
  68. ### **frequency_penalty**
  69. ```csharp
  70. public float frequency_penalty;
  71. ```
  72. ### **presence_penalty**
  73. ```csharp
  74. public float presence_penalty;
  75. ```
  76. ### **mirostat**
  77. ```csharp
  78. public int mirostat;
  79. ```
  80. ### **mirostat_tau**
  81. ```csharp
  82. public float mirostat_tau;
  83. ```
  84. ### **mirostat_eta**
  85. ```csharp
  86. public float mirostat_eta;
  87. ```
  88. ### **model**
  89. ```csharp
  90. public string model;
  91. ```
  92. ### **prompt**
  93. ```csharp
  94. public string prompt;
  95. ```
  96. ### **path_session**
  97. ```csharp
  98. public string path_session;
  99. ```
  100. ### **input_prefix**
  101. ```csharp
  102. public string input_prefix;
  103. ```
  104. ### **input_suffix**
  105. ```csharp
  106. public string input_suffix;
  107. ```
  108. ### **antiprompt**
  109. ```csharp
  110. public List<string> antiprompt;
  111. ```
  112. ### **lora_adapter**
  113. ```csharp
  114. public string lora_adapter;
  115. ```
  116. ### **lora_base**
  117. ```csharp
  118. public string lora_base;
  119. ```
  120. ### **memory_f16**
  121. ```csharp
  122. public bool memory_f16;
  123. ```
  124. ### **random_prompt**
  125. ```csharp
  126. public bool random_prompt;
  127. ```
  128. ### **use_color**
  129. ```csharp
  130. public bool use_color;
  131. ```
  132. ### **interactive**
  133. ```csharp
  134. public bool interactive;
  135. ```
  136. ### **embedding**
  137. ```csharp
  138. public bool embedding;
  139. ```
  140. ### **interactive_first**
  141. ```csharp
  142. public bool interactive_first;
  143. ```
  144. ### **instruct**
  145. ```csharp
  146. public bool instruct;
  147. ```
  148. ### **penalize_nl**
  149. ```csharp
  150. public bool penalize_nl;
  151. ```
  152. ### **perplexity**
  153. ```csharp
  154. public bool perplexity;
  155. ```
  156. ### **use_mmap**
  157. ```csharp
  158. public bool use_mmap;
  159. ```
  160. ### **use_mlock**
  161. ```csharp
  162. public bool use_mlock;
  163. ```
  164. ### **mem_test**
  165. ```csharp
  166. public bool mem_test;
  167. ```
  168. ### **verbose_prompt**
  169. ```csharp
  170. public bool verbose_prompt;
  171. ```
  172. ## Constructors
  173. ### **LLamaParams(Int32, Int32, Int32, Int32, Int32, Int32, Int32, Dictionary&lt;Int32, Single&gt;, Int32, Single, Single, Single, Single, Single, Int32, Single, Single, Int32, Single, Single, String, String, String, String, String, List&lt;String&gt;, String, String, Boolean, Boolean, Boolean, Boolean, Boolean, Boolean, Boolean, Boolean, Boolean, Boolean, Boolean, Boolean, Boolean)**
  174. ```csharp
  175. LLamaParams(int seed, int n_threads, int n_predict, int n_parts, int n_ctx, int n_batch, int n_keep, Dictionary<int, float> logit_bias, int top_k, float top_p, float tfs_z, float typical_p, float temp, float repeat_penalty, int repeat_last_n, float frequency_penalty, float presence_penalty, int mirostat, float mirostat_tau, float mirostat_eta, string model, string prompt, string path_session, string input_prefix, string input_suffix, List<string> antiprompt, string lora_adapter, string lora_base, bool memory_f16, bool random_prompt, bool use_color, bool interactive, bool embedding, bool interactive_first, bool instruct, bool penalize_nl, bool perplexity, bool use_mmap, bool use_mlock, bool mem_test, bool verbose_prompt)
  176. ```
  177. #### Parameters
  178. `seed` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  179. `n_threads` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  180. `n_predict` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  181. `n_parts` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  182. `n_ctx` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  183. `n_batch` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  184. `n_keep` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  185. `logit_bias` [Dictionary&lt;Int32, Single&gt;](https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.dictionary-2)<br>
  186. `top_k` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  187. `top_p` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  188. `tfs_z` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  189. `typical_p` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  190. `temp` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  191. `repeat_penalty` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  192. `repeat_last_n` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  193. `frequency_penalty` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  194. `presence_penalty` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  195. `mirostat` [Int32](https://docs.microsoft.com/en-us/dotnet/api/system.int32)<br>
  196. `mirostat_tau` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  197. `mirostat_eta` [Single](https://docs.microsoft.com/en-us/dotnet/api/system.single)<br>
  198. `model` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  199. `prompt` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  200. `path_session` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  201. `input_prefix` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  202. `input_suffix` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  203. `antiprompt` [List&lt;String&gt;](https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.list-1)<br>
  204. `lora_adapter` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  205. `lora_base` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  206. `memory_f16` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  207. `random_prompt` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  208. `use_color` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  209. `interactive` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  210. `embedding` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  211. `interactive_first` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  212. `instruct` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  213. `penalize_nl` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  214. `perplexity` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  215. `use_mmap` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  216. `use_mlock` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  217. `mem_test` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  218. `verbose_prompt` [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>