12 Commits (cd3cf2b77d36287f29d9a1b443413f283a6de20b)

Author SHA1 Message Date
  Martin Evans cd3cf2b77d - Moved tokenization from `Utils.Tokenize` into `SafeLLamaContextHandle.Tokenize`, one less thing in `Utils`. 2 years ago
  sa_ddam213 bac9cba01a InferenceParams abstractions 2 years ago
  Martin Evans c64507cb41 Correctly passing through mu value to mirostate instead of resetting it every time. 2 years ago
  Yaohui Liu 6c400e64c2
docs: publiash documentation 0.4. 2 years ago
  Yaohui Liu 2eb2d6df83
test: add 9 examples of the new version. 2 years ago
  Marcel 762fd7c1ae Fixed a typo in FixedSizeQueue 2 years ago
  Yaohui Liu a3b8186f20
feat: support save and load chat session. 2 years ago
  Yaohui Liu 3bf74ec9b9
feat: add chat session for refactored code. 2 years ago
  Yaohui Liu 908b79e855
feat: add stateless executor. 2 years ago
  Yaohui Liu e603a09137
fix: state loading and saving not working. 2 years ago
  Yaohui Liu 5679e08718
feat: add ILLamaExecutor.InferAsync. 2 years ago
  Yaohui Liu 264fb9a706
refactor: LLamaModel and LLamaExecutor. 2 years ago