18 Commits (64416ca23c261d92803fa8edc7746db779aa3ad4)

Author SHA1 Message Date
  Martin Evans 64416ca23c - Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`) 2 years ago
  Martin Evans f3511e390f WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving. 2 years ago
  Martin Evans 270c6d55ef
Merge pull request #88 from martindevans/fix_serialization_nan 2 years ago
  Martin Evans b5de3ee5aa Fixed some final mentions of "mirostate" instead of "mirostat" 2 years ago
  Martin Evans 0e5e00e300 Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`) 2 years ago
  Martin Evans cd3cf2b77d - Moved tokenization from `Utils.Tokenize` into `SafeLLamaContextHandle.Tokenize`, one less thing in `Utils`. 2 years ago
  sa_ddam213 bac9cba01a InferenceParams abstractions 2 years ago
  Martin Evans c64507cb41 Correctly passing through mu value to mirostate instead of resetting it every time. 2 years ago
  Yaohui Liu 1062fe1a7e
feat: upgrade the native libraries. 2 years ago
  Yaohui Liu 6c400e64c2
docs: publiash documentation 0.4. 2 years ago
  Yaohui Liu 2eb2d6df83
test: add 9 examples of the new version. 2 years ago
  Marcel 762fd7c1ae Fixed a typo in FixedSizeQueue 2 years ago
  Yaohui Liu a3b8186f20
feat: support save and load chat session. 2 years ago
  Yaohui Liu 3bf74ec9b9
feat: add chat session for refactored code. 2 years ago
  Yaohui Liu 908b79e855
feat: add stateless executor. 2 years ago
  Yaohui Liu e603a09137
fix: state loading and saving not working. 2 years ago
  Yaohui Liu 5679e08718
feat: add ILLamaExecutor.InferAsync. 2 years ago
  Yaohui Liu 264fb9a706
refactor: LLamaModel and LLamaExecutor. 2 years ago