26 Commits (rinne-dev)

Author SHA1 Message Date
  sa_ddam213 a5d742b72c
Fix Tokenize of new line, Remove space inserts 2 years ago
  Martin Evans 31287b5e6e Rewritten TokenToSpan/TokenToString to better fit the new way it's done in llama.cpp with a few different options: 2 years ago
  Martin Evans 0c98ae1955 Passing ctx to `llama_token_nl(_ctx)` 2 years ago
  Martin Evans a911b77dec Various minor changes, resolving about 100 ReSharper code quality warnings 2 years ago
  Martin Evans 829f32b27d - Added `Obsolete` attributes to the entire `OldVersion` namespace, so they can be removed in the future 2 years ago
  Martin Evans 2830e5755c - Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed. 2 years ago
  Martin Evans 759ae26f36
Merge branch 'master' into grammar_basics 2 years ago
  Martin Evans 4738c26299 - Reduced context size of test, to speed it up 2 years ago
  Martin Evans 64416ca23c - Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`) 2 years ago
  Martin Evans f3511e390f WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving. 2 years ago
  Martin Evans 270c6d55ef
Merge pull request #88 from martindevans/fix_serialization_nan 2 years ago
  Martin Evans b5de3ee5aa Fixed some final mentions of "mirostate" instead of "mirostat" 2 years ago
  Martin Evans 0e5e00e300 Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`) 2 years ago
  Martin Evans cd3cf2b77d - Moved tokenization from `Utils.Tokenize` into `SafeLLamaContextHandle.Tokenize`, one less thing in `Utils`. 2 years ago
  sa_ddam213 bac9cba01a InferenceParams abstractions 2 years ago
  Martin Evans c64507cb41 Correctly passing through mu value to mirostate instead of resetting it every time. 2 years ago
  Yaohui Liu 1062fe1a7e
feat: upgrade the native libraries. 2 years ago
  Yaohui Liu 6c400e64c2
docs: publiash documentation 0.4. 2 years ago
  Yaohui Liu 2eb2d6df83
test: add 9 examples of the new version. 2 years ago
  Marcel 762fd7c1ae Fixed a typo in FixedSizeQueue 2 years ago
  Yaohui Liu a3b8186f20
feat: support save and load chat session. 2 years ago
  Yaohui Liu 3bf74ec9b9
feat: add chat session for refactored code. 2 years ago
  Yaohui Liu 908b79e855
feat: add stateless executor. 2 years ago
  Yaohui Liu e603a09137
fix: state loading and saving not working. 2 years ago
  Yaohui Liu 5679e08718
feat: add ILLamaExecutor.InferAsync. 2 years ago
  Yaohui Liu 264fb9a706
refactor: LLamaModel and LLamaExecutor. 2 years ago