LLamaSharp

333 MB

Tree: b9444452eb

Author	SHA1	Message	Date
Martin Evans	36a9335588	Removed `LLamaBatchSafeHandle` (using unmanaged memory, created by llama.cpp) and replaced it with a fully managed `LLamaBatch`. Modified the `BatchedDecoding` example to use new managed batch.	1 year ago
Martin Evans	42be9b136d	Switched form using raw integers, to a `LLamaToken` struct	1 year ago
Martin Evans	b6d242193e	Debugging slowdown by removing some things: - Removed all `record struct` uses in native code - Removed usage of `readonly` in native structs Minor fix: - Added sequential layout to `LLamaModelQuantizeParams`	2 years ago
Martin Evans	a024d2242e	It works! had to update binary to `b1426`	2 years ago
Martin Evans	b306ac23dd	Added `Decode` method to `SafeLLamaContextHandle`	2 years ago
Martin Evans	9e958e896b	safe handle for batch	2 years ago