5 Commits (36a9335588a45fd9a038dfc1b5c576dd002551cc)

Author SHA1 Message Date
  Martin Evans 36a9335588 Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch. 1 year ago
  Martin Evans 42be9b136d Switched form using raw integers, to a `LLamaToken` struct 1 year ago
  Martin Evans b868b056f7 Added metadata overrides to `IModelParams` 1 year ago
  Martin Evans 479779e908 Some minor cleanup on example code: 2 years ago
  xbotter 521e36903c
🔀 Remove unused code and update examples 2 years ago