8 Commits (a2e29d393c1d23c9b1e163087815e206203083e3)

Author SHA1 Message Date
  Martin Evans a2e29d393c Swapped `StatelessExecutor` to use `llama_decode`! 1 year ago
  Martin Evans 5b6e82a594 Improved the BatchedDecoding demo: 1 year ago
  Martin Evans 99969e538e - Removed some unused `eval` methods. 1 year ago
  Martin Evans 36a9335588 Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch. 1 year ago
  Martin Evans 42be9b136d Switched form using raw integers, to a `LLamaToken` struct 1 year ago
  Martin Evans b868b056f7 Added metadata overrides to `IModelParams` 1 year ago
  Martin Evans 479779e908 Some minor cleanup on example code: 2 years ago
  xbotter 521e36903c
🔀 Remove unused code and update examples 2 years ago