LLamaSharp

333 MB

Tree: 829f32b27d

Author	SHA1	Message	Date
Martin Evans	64416ca23c	- Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`) - Integrated grammar into sampling - Added a test for the grammar sampling	2 years ago
sa_ddam213	372894e1d4	Expose some native classes	2 years ago
Martin Evans	ec49bdd6eb	- Most importantly: Fixed issue in `SamplingApi`, `Memory` was pinned, but never unpinned! - Moved repeated code to convert `LLamaTokenDataArray` into a `LLamaTokenDataArrayNative` into a helper method. - Modified all call sites to dispose the `MemoryHandle` - Saved one copy of the `List<LLamaTokenData>` into a `LLamaTokenData[]` in `LlamaModel`	2 years ago
Yaohui Liu	00d91cf99e	refactor: some parts of code of LLamaModel.	2 years ago
Yaohui Liu	d6a7997e46	feat: add gpt model.	2 years ago
Yaohui Liu	5a79edeb51	feat: add the framework and basic usages.	2 years ago