10 Commits (c7d0dc915aae3d38d6adeeb22cfbff5cadfaf770)

Author SHA1 Message Date
  Martin Evans b0acecf080 Created a new `BatchedExecutor` which processes multiple "Conversations" in one single inference batch. This is faster, even when the conversations are unrelated, and is much faster if the conversations share some overlap (e.g. a common system prompt prefix). 1 year ago
  Philipp Bauer f669a4f5a7 Update the Chinese chat sample to use new ChatSession integration 1 year ago
  Martin Evans 4fc743c9ba
Merge branch 'master' into master 1 year ago
  Philipp Bauer 422605d980 Re-add ChatSession examples 2 years ago
  Philipp Bauer 73d1725954 Modified / updated ChatSession examples 2 years ago
  Rinne 934358a7b3
Merge branch 'master' of github.com:AsakusaRinne/LLamaSharp into fix_chinese 2 years ago
  Rinne 217c67b757
fix: chinese encoding error. 2 years ago
  xbotter 286904920b
update DefaultInferenceParams in WithLLamaSharpDefaults 2 years ago
  Martin Evans 479779e908 Some minor cleanup on example code: 2 years ago
  xbotter 521e36903c
🔀 Remove unused code and update examples 2 years ago