You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

llama.instructexecutor.md 3.3 kB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142
  1. # InstructExecutor
  2. Namespace: LLama
  3. The LLama executor for instruct mode.
  4. ```csharp
  5. public class InstructExecutor : StatefulExecutorBase, LLama.Abstractions.ILLamaExecutor
  6. ```
  7. Inheritance [Object](https://docs.microsoft.com/en-us/dotnet/api/system.object) → [StatefulExecutorBase](./llama.statefulexecutorbase.md) → [InstructExecutor](./llama.instructexecutor.md)<br>
  8. Implements [ILLamaExecutor](./llama.abstractions.illamaexecutor.md)
  9. ## Properties
  10. ### **Model**
  11. The mode used by the executor.
  12. ```csharp
  13. public LLamaModel Model { get; }
  14. ```
  15. #### Property Value
  16. [LLamaModel](./llama.llamamodel.md)<br>
  17. ## Constructors
  18. ### **InstructExecutor(LLamaModel, String, String)**
  19. ```csharp
  20. public InstructExecutor(LLamaModel model, string instructionPrefix, string instructionSuffix)
  21. ```
  22. #### Parameters
  23. `model` [LLamaModel](./llama.llamamodel.md)<br>
  24. `instructionPrefix` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  25. `instructionSuffix` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  26. ## Methods
  27. ### **GetStateData()**
  28. ```csharp
  29. public ExecutorBaseState GetStateData()
  30. ```
  31. #### Returns
  32. [ExecutorBaseState](./llama.statefulexecutorbase.executorbasestate.md)<br>
  33. ### **LoadState(ExecutorBaseState)**
  34. ```csharp
  35. public void LoadState(ExecutorBaseState data)
  36. ```
  37. #### Parameters
  38. `data` [ExecutorBaseState](./llama.statefulexecutorbase.executorbasestate.md)<br>
  39. ### **SaveState(String)**
  40. ```csharp
  41. public void SaveState(string filename)
  42. ```
  43. #### Parameters
  44. `filename` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  45. ### **LoadState(String)**
  46. ```csharp
  47. public void LoadState(string filename)
  48. ```
  49. #### Parameters
  50. `filename` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  51. ### **GetLoopCondition(InferStateArgs)**
  52. ```csharp
  53. protected bool GetLoopCondition(InferStateArgs args)
  54. ```
  55. #### Parameters
  56. `args` [InferStateArgs](./llama.statefulexecutorbase.inferstateargs.md)<br>
  57. #### Returns
  58. [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  59. ### **PreprocessInputs(String, InferStateArgs)**
  60. ```csharp
  61. protected void PreprocessInputs(string text, InferStateArgs args)
  62. ```
  63. #### Parameters
  64. `text` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  65. `args` [InferStateArgs](./llama.statefulexecutorbase.inferstateargs.md)<br>
  66. ### **PostProcess(InferenceParams, InferStateArgs, IEnumerable`1&)**
  67. ```csharp
  68. protected bool PostProcess(InferenceParams inferenceParams, InferStateArgs args, IEnumerable`1& extraOutputs)
  69. ```
  70. #### Parameters
  71. `inferenceParams` [InferenceParams](./llama.common.inferenceparams.md)<br>
  72. `args` [InferStateArgs](./llama.statefulexecutorbase.inferstateargs.md)<br>
  73. `extraOutputs` [IEnumerable`1&](https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.ienumerable-1&)<br>
  74. #### Returns
  75. [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  76. ### **InferInternal(InferenceParams, InferStateArgs)**
  77. ```csharp
  78. protected void InferInternal(InferenceParams inferenceParams, InferStateArgs args)
  79. ```
  80. #### Parameters
  81. `inferenceParams` [InferenceParams](./llama.common.inferenceparams.md)<br>
  82. `args` [InferStateArgs](./llama.statefulexecutorbase.inferstateargs.md)<br>

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。