LLamaSharp/docs/xmldocs/llama.instructexecutor.md

• InstructExecutor
• • Properties
  • • Model
    • • Property Value
  • Constructors
  • • InstructExecutor(LLamaModel, String, String)
    • • Parameters
  • Methods
  • • GetStateData()
    • • Returns
    • LoadState(ExecutorBaseState)
    • • Parameters
    • SaveState(String)
    • • Parameters
    • LoadState(String)
    • • Parameters
    • GetLoopCondition(InferStateArgs)
    • • Parameters
      • Returns
    • PreprocessInputs(String, InferStateArgs)
    • • Parameters
    • PostProcess(InferenceParams, InferStateArgs, IEnumerable`1&)
    • • Parameters
      • Returns
    • InferInternal(InferenceParams, InferStateArgs)
    • • Parameters

InstructExecutor

Namespace: LLama

The LLama executor for instruct mode.

public class InstructExecutor : StatefulExecutorBase, LLama.Abstractions.ILLamaExecutor

Inheritance Object → StatefulExecutorBase → InstructExecutor

Implements ILLamaExecutor

Properties

Model

The mode used by the executor.

public LLamaModel Model { get; }

Property Value

LLamaModel

Constructors

InstructExecutor(LLamaModel, String, String)

public InstructExecutor(LLamaModel model, string instructionPrefix, string instructionSuffix)

Parameters

model LLamaModel

instructionPrefix String

instructionSuffix String

Methods

GetStateData()

public ExecutorBaseState GetStateData()

Returns

ExecutorBaseState

LoadState(ExecutorBaseState)

public void LoadState(ExecutorBaseState data)

Parameters

data ExecutorBaseState

SaveState(String)

public void SaveState(string filename)

Parameters

filename String

LoadState(String)

public void LoadState(string filename)

Parameters

filename String

GetLoopCondition(InferStateArgs)

protected bool GetLoopCondition(InferStateArgs args)

Parameters

args InferStateArgs

Returns

Boolean

PreprocessInputs(String, InferStateArgs)

protected void PreprocessInputs(string text, InferStateArgs args)

Parameters

text String

args InferStateArgs

PostProcess(InferenceParams, InferStateArgs, IEnumerable`1&)

protected bool PostProcess(InferenceParams inferenceParams, InferStateArgs args, IEnumerable`1& extraOutputs)

Parameters

inferenceParams InferenceParams

args InferStateArgs

extraOutputs IEnumerable`1&

Returns

Boolean

InferInternal(InferenceParams, InferStateArgs)

protected void InferInternal(InferenceParams inferenceParams, InferStateArgs args)

Parameters

inferenceParams InferenceParams

args InferStateArgs