LLamaSharp/docs/xmldocs/llama.abstractions.illamaexecutor.md

• ILLamaExecutor
• • Properties
  • • Model
    • • Property Value
  • Methods
  • • Infer(String, InferenceParams, CancellationToken)
    • • Parameters
      • Returns
    • InferAsync(String, InferenceParams, CancellationToken)
    • • Parameters
      • Returns

ILLamaExecutor

Namespace: LLama.Abstractions

A high level interface for LLama models.

public interface ILLamaExecutor

Properties

Model

The loaded model for this executor.

public abstract LLamaModel Model { get; }

Property Value

LLamaModel

Methods

Infer(String, InferenceParams, CancellationToken)

Infers a response from the model.

IEnumerable<string> Infer(string text, InferenceParams inferenceParams, CancellationToken token)

Parameters

text String

Your prompt

inferenceParams InferenceParams

Any additional parameters

token CancellationToken

A cancellation token.

Returns

IEnumerable<String>

InferAsync(String, InferenceParams, CancellationToken)

IAsyncEnumerable<string> InferAsync(string text, InferenceParams inferenceParams, CancellationToken token)

Parameters

text String

inferenceParams InferenceParams

token CancellationToken

Returns

IAsyncEnumerable<String>