LLamaSharp

Commit Graph

Author	SHA1	Message	Date
Martin Evans	9daf586ba8	Assorted cleanup leftover after the huge change in the last PR (comments, syntax style, etc)	2 years ago
Martin Evans	d8434ea9d6	Merge pull request #185 from martindevans/wip_major_api_change Major llama.cpp API Change	2 years ago
Martin Evans	b8f0eff080	- Added `GetCharCountImpl` tests, fixed handling of empty strings - Added ifdef to remove `Deconstruct` extension on everything except `NETSTANDARD2_0`	2 years ago
Martin Evans	2a38808bca	- Added threads to context params, replaced all thread args with `uint?` - Replaced all binaries	2 years ago
Martin Evans	4e9b1f8cdc	- Split extension methods into separate files	2 years ago
Martin Evans	669ae47ef7	- Split parameters into two interfaces - params contains a list of loras, instead of just one	2 years ago
Martin Evans	bca55eace0	Initial changes to match the llama.cpp changes	2 years ago
Martin Evans	08f1615e60	- Converted LLamaStatelessExecutor to run `Exec` calls inside an awaited task. This unblocks async callers while the model is being evaluated. - Added a "spinner" to the `StatelessModeExecute` demo, which spins while waiting for the next token (demonstrating that it's not blocked).	2 years ago
Martin Evans	fe54f6764f	- Added unit tests for extension methods - Removed unused `AddRangeSpan` extension	2 years ago
Martin Evans	d08a125020	Using the `TokensEndsWithAnyString` extensions for antiprompt checking in instruct executor. Simpler and more efficient.	2 years ago
Martin Evans	77bd090150	Simplified `LLamaInteractExecutor` antiprompt matching by using new extension method	2 years ago
Martin Evans	614ba40948	- Added a `TokensEndsWithAnyString` extension to `IReadOnlyList<int>` which efficiently checks if a set of tokens ends with one of a set of strings. - Minimal amount of characters converted - Allocation free - Added `TokensToSpan` to `SafeLlamaModelHandle` which converts as many tokens as possible into a character span - Allocation free	2 years ago
Rinne	4e83e48ad1	Merge pull request #122 from martindevans/gguf Add GGUF support	2 years ago
Martin Evans	a70c7170dd	- Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system. - Made all the mechanics of grammar parsing (GBNFGrammarParser, ParseState) internal. Just call `Grammar.Parse("whatever")`. - Added a `GrammarRule` class which validates elements on construction (this allows constructing grammar without parsing GBNF). - It should be impossible for a `GrammarRule` to represent an invalid rule.	2 years ago
Martin Evans	2056078aef	Initial changes required for GGUF support	2 years ago
Martin Evans	cf4754db44	Removed unnecessary parameters from some low level sampler methods	2 years ago
Martin Evans	4738c26299	- Reduced context size of test, to speed it up - Removed some unnecessary `ToArray` calls - Initial pass on LLamaStatelessExecutor, the context overflow management is broken but I think I found where it's ported from	2 years ago
Martin Evans	91bcefc852	comment on IModelParamsExtensions	2 years ago
Martin Evans	9cdc72aa67	Fixed `ToLlamaContextParams` using the wrong parameter for `use_mmap`	2 years ago
sa_ddam213	2d1269cae9	Access to IModelParamsExtensions	2 years ago
Martin Evans	f2499371ea	Pulled conversion of a `IModelParams` into a `LLamaContextParams` out into an extension method which can be used in other places.	2 years ago
Martin Evans	18462beb31	- Removed the `Update` and `GetOrDefault` extension methods (they were unused). - Renamed `DictionaryExtensions` to `KeyValuePairExtensions`, since nothing in that file extends dictionary any more!	2 years ago
Yaohui Liu	00d91cf99e	refactor: some parts of code of LLamaModel.	2 years ago

23 Commits (e89ca5cc17bf9cccdaf24e5b4ac78c0b7183e7a2)