You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
844 B
844 B
LLamaBeamView
Namespace: LLama.Native
Information about a single beam in a beam search
public struct LLamaBeamView
Inheritance Object → ValueType → LLamaBeamView
Fields
CumulativeProbability
Cumulative beam probability (renormalized relative to all beams)
public float CumulativeProbability;
EndOfBeam
Callback should set this to true when a beam is at end-of-beam.
public bool EndOfBeam;
Properties
Tokens
Tokens in this beam
public Span<LLamaToken> Tokens { get; }