4 Commits (33827a1ba8b32ca8bd1c20c3e1a2e6b1be1b17f8)

Author SHA1 Message Date
  Martin Evans 91a7967869
`ReadOnlySpan<float>` in ISamplingPipeline (#538) 1 year ago
  Martin Evans 74a39188a2
Used `AnsiConsole` in a few more places: (#534) 1 year ago
  Scott W Harden 06ffe3ac95
LLama.Examples: improve model path prompt (#526) 1 year ago
  Martin Evans b0acecf080 Created a new `BatchedExecutor` which processes multiple "Conversations" in one single inference batch. This is faster, even when the conversations are unrelated, and is much faster if the conversations share some overlap (e.g. a common system prompt prefix). 1 year ago