132 Commits (9bc129e252a87cdeb795366a6c1b423cf74f2cbb)

Author SHA1 Message Date
  Martin Evans b0acecf080 Created a new `BatchedExecutor` which processes multiple "Conversations" in one single inference batch. This is faster, even when the conversations are unrelated, and is much faster if the conversations share some overlap (e.g. a common system prompt prefix). 1 year ago
  Martin Evans 92b9bbe779 Added methods to `SafeLLamaContextHandle` for KV cache manipulation 1 year ago
  Martin Evans 96c26c25f5
Merge pull request #445 from martindevans/stateless_executor_llama_decode 1 year ago
  xbotter 90815ae7d8
bump sk & km 1 year ago
  Martin Evans 9fe878ae1f - Fixed example 1 year ago
  Martin Evans a2e29d393c Swapped `StatelessExecutor` to use `llama_decode`! 1 year ago
  Martin Evans 5b6e82a594 Improved the BatchedDecoding demo: 1 year ago
  Martin Evans 99969e538e - Removed some unused `eval` methods. 1 year ago
  Martin Evans 36a9335588 Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch. 1 year ago
  Martin Evans 42be9b136d Switched form using raw integers, to a `LLamaToken` struct 1 year ago
  Martin Evans a408335c44 Fixed broken build on master (just removing a namespace that no longer exists) 1 year ago
  dependabot[bot] f02b0500b5
build(deps): bump Microsoft.KernelMemory.Core and Microsoft.KernelMemory.Abstractions 1 year ago
  Martin Evans f0d7468b22
Merge pull request #356 from xbotter/deps/sk-rc3 1 year ago
  xbotter 40ac944fb5
Bump sk to 1.0.1 1 year ago
  Martin Evans b868b056f7 Added metadata overrides to `IModelParams` 1 year ago
  xbotter 8766fb1b03
Merge branch 'deps/sk-rc3' of https://github.com/xbotter/LLamaSharp into deps/sk-rc3 1 year ago
  xbotter 213b4be723
bump sk-1.0.0-rc4 1 year ago
  xbotter ce20b30e06
Merge branch 'SciSharp:master' into deps/sk-rc3 1 year ago
  Martin Evans bab6b65b61 Added a safe handle for LLamaKvCacheView 1 year ago
  Rinne fb75e06293
fix: output prefix of Chinese example. 1 year ago
  Rinne 836f071cd0
fix: Chinese example. 1 year ago
  xbotter 13a312b4ec
update sk to 1.0.0-rc3 & km to 0.18 1 year ago
  Philipp Bauer f669a4f5a7 Update the Chinese chat sample to use new ChatSession integration 1 year ago
  Philipp Bauer 2cc01efdae
Merge branch 'SciSharp:master' into master 1 year ago
  Martin Evans 4fc743c9ba
Merge branch 'master' into master 1 year ago
  Philipp Bauer 422605d980 Re-add ChatSession examples 2 years ago
  Philipp Bauer 73d1725954 Modified / updated ChatSession examples 2 years ago
  Philipp Bauer f1eac82ecc Update target frameworks with .NET 8 2 years ago
  xbotter a2b26faa7a
🔧 Refactor chat completion implementation 1 year ago
  dependabot[bot] 36adc4af32
build(deps): bump Spectre.Console from 0.47.0 to 0.48.0 2 years ago
  Rinne 605d1ddb3f
revert a change. 2 years ago
  Rinne 934358a7b3
Merge branch 'master' of github.com:AsakusaRinne/LLamaSharp into fix_chinese 2 years ago
  Rinne 217c67b757
fix: chinese encoding error. 2 years ago
  xbotter d1e2a4750b
🔧 Update KernelMemory configuration 2 years ago
  dependabot[bot] 20a0dc7ac6
build(deps): bump Microsoft.Extensions.Logging.Console 2 years ago
  Rinne c94aeabc4b
Merge pull request #307 from xbotter/sm-default-config 2 years ago
  xbotter 286904920b
update DefaultInferenceParams in WithLLamaSharpDefaults 2 years ago
  xbotter 1056e13414
fix examples 2 years ago
  xbotter 15db931a66
bump semantic kernel 1.0.0-beta8 2 years ago
  Martin Evans 9905baa7c4
Merge pull request #300 from martindevans/minor_demos_cleanup 2 years ago
  Martin Evans 1dd4c6ab7a
Merge pull request #296 from xbotter/deps/sk_1.0.0-beta6 2 years ago
  Martin Evans 479779e908 Some minor cleanup on example code: 2 years ago
  xbotter 6c31f69720
bump semantic kernel to 1.0.0-beta-6 2 years ago
  xbotter 521e36903c
🔀 Remove unused code and update examples 2 years ago
  Martin Evans a9d1f6cb47 - Renamed `NativeLibraryConfig.Default` to `NativeLibraryConfig.Instance`. It's not default any more as soon as you call `WithX`! 2 years ago
  Yaohui Liu d7675f7936
Merge branch 'master' of github.com:AsakusaRinne/LLamaSharp into cuda_detection 2 years ago
  Yaohui Liu cb5fb210b1
feat: optimize apis for cuda feature detection. 2 years ago
  SignalRT fb95bbb4e0 Merge remote-tracking branch 'upstream/master' into RuntimeDetection 2 years ago
  SignalRT 6de8d6219a Change SemanticKernel version to beta1 on Examples 2 years ago
  Rinne 14b5994c93
Merge branch 'master' into add_kernel_memory_pkg 2 years ago