You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
1.0 kB
1.0 kB
LLamaBeamsState
Namespace: LLama.Native
Passed to beam_search_callback function.
Whenever 0 < common_prefix_length, this number of tokens should be copied from any of the beams
(e.g. beams[0]) as they will be removed (shifted) from all beams in all subsequent callbacks.
public struct LLamaBeamsState
Inheritance Object → ValueType → LLamaBeamsState
Fields
CommonPrefixLength
Current max length of prefix tokens shared by all beams.
public ulong CommonPrefixLength;
LastCall
True iff this is the last callback invocation.
public bool LastCall;
Properties
Beams
The current state of each beam
public Span<LLamaBeamView> Beams { get; }