8 Commits (9fe878ae1fb392e2b9f648a89f843b2a13c0dd1a)

Author SHA1 Message Date
  Martin Evans 9fe878ae1f - Fixed example 1 year ago
  Martin Evans 5b6e82a594 Improved the BatchedDecoding demo: 1 year ago
  Martin Evans 99969e538e - Removed some unused `eval` methods. 1 year ago
  Martin Evans 36a9335588 Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch. 1 year ago
  Martin Evans 42be9b136d Switched form using raw integers, to a `LLamaToken` struct 1 year ago
  Martin Evans b868b056f7 Added metadata overrides to `IModelParams` 1 year ago
  Martin Evans 479779e908 Some minor cleanup on example code: 2 years ago
  xbotter 521e36903c
🔀 Remove unused code and update examples 2 years ago