LLamaSharp

333 MB

Branch: rinne-dev

Author	SHA1	Message	Date
Rinne	4e83e48ad1	Merge pull request #122 from martindevans/gguf Add GGUF support	2 years ago
Martin Evans	a70c7170dd	- Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system. - Made all the mechanics of grammar parsing (GBNFGrammarParser, ParseState) internal. Just call `Grammar.Parse("whatever")`. - Added a `GrammarRule` class which validates elements on construction (this allows constructing grammar without parsing GBNF). - It should be impossible for a `GrammarRule` to represent an invalid rule.	2 years ago
Martin Evans	2056078aef	Initial changes required for GGUF support	2 years ago
Martin Evans	cf4754db44	Removed unnecessary parameters from some low level sampler methods	2 years ago
Martin Evans	4738c26299	- Reduced context size of test, to speed it up - Removed some unnecessary `ToArray` calls - Initial pass on LLamaStatelessExecutor, the context overflow management is broken but I think I found where it's ported from	2 years ago
Martin Evans	91bcefc852	comment on IModelParamsExtensions	2 years ago
Martin Evans	9cdc72aa67	Fixed `ToLlamaContextParams` using the wrong parameter for `use_mmap`	2 years ago
sa_ddam213	2d1269cae9	Access to IModelParamsExtensions	2 years ago
Martin Evans	f2499371ea	Pulled conversion of a `IModelParams` into a `LLamaContextParams` out into an extension method which can be used in other places.	2 years ago
Martin Evans	18462beb31	- Removed the `Update` and `GetOrDefault` extension methods (they were unused). - Renamed `DictionaryExtensions` to `KeyValuePairExtensions`, since nothing in that file extends dictionary any more!	2 years ago
Yaohui Liu	00d91cf99e	refactor: some parts of code of LLamaModel.	2 years ago

11 Commits (rinne-dev)