19 Commits (rinne-dev)

Author SHA1 Message Date
  Martin Evans 2056078aef Initial changes required for GGUF support 2 years ago
  Martin Evans 93f24f8a51 Switched to properly typed `Encoding` property 2 years ago
  Martin Evans 759ae26f36
Merge branch 'master' into grammar_basics 2 years ago
  Martin Evans a9e6f21ab8 - Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring! 2 years ago
  Martin Evans 64416ca23c - Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`) 2 years ago
  Martin Evans f3511e390f WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving. 2 years ago
  Martin Evans 2c933c57a1 Fixed ModelOptions in Web project 2 years ago
  sa_ddam213 bac9cba01a InferenceParams abstractions 2 years ago
  sa_ddam213 2a04e31b7d ModelParams abstraction 2 years ago
  sa_ddam213 3fec7a63c7 Add Instruct and Stateless support 2 years ago
  sa_ddam213 a32a5e4ffe Decouple connectionId from ModelSession 2 years ago
  sa_ddam213 d9fbd56f10 Strongly type connection status 2 years ago
  sa_ddam213 ef8cf0b283 Add RequestVerificationToken logic fo ajax prefilter, Tidy up js cancel logic 2 years ago
  sa_ddam213 e574d89a40 Send prompt on Enter key 2 years ago
  sa_ddam213 a139423581 Move session management to service, Use ILLamaExecutor in session to make more versatile, scroll bug 2 years ago
  sa_ddam213 1ec59e120a Move session management to service, Infer cancel support 2 years ago
  sa_ddam213 fd215dce84 Update Readme 2 years ago
  sa_ddam213 21b685649f Add Readme 2 years ago
  sa_ddam213 0c6b213b0d Basic ASP.NET Core website example, Interactive started 2 years ago