6 Commits (b9444452ebd15f9a35a1cef304865f0287a8fc43)

Author SHA1 Message Date
  Martin Evans 36a9335588 Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch. 1 year ago
  Martin Evans 42be9b136d Switched form using raw integers, to a `LLamaToken` struct 1 year ago
  Martin Evans b6d242193e Debugging slowdown by removing some things: 2 years ago
  Martin Evans a024d2242e It works! 2 years ago
  Martin Evans b306ac23dd Added `Decode` method to `SafeLLamaContextHandle` 2 years ago
  Martin Evans 9e958e896b safe handle for batch 2 years ago