LLamaSharp

Commit Graph

Author	SHA1	Message	Date
Martin Evans	31244ae691	Merge branch 'master' into YaRN_scaling_parameters	2 years ago
Martin Evans	db1bc741b0	Modified `ContextSize` in parameters to be nullable. A null value means autodetect from the model.	2 years ago
Martin Evans	04ee64a6be	Exposed YaRN scaling parameters in IContextParams	2 years ago
Martin Evans	529b06b35b	- Fixed rope frequency/base to use the values in the model by default, instead of always overriding them by default!	2 years ago
Martin Evans	321d0b58c4	Merge pull request #202 from martindevans/multi_gpu Multi GPU	2 years ago
Martin Evans	f6a472ae86	Setting the default seed to `0xFFFFFFFF` (no seed, randomised)	2 years ago
Martin Evans	f621ec67e8	Fixed serialization	2 years ago
Martin Evans	b4e7f64e76	Added System.Text.Json serialization for `TensorSplitsCollectionConverter`	2 years ago
Martin Evans	281e58f059	Fixed default value	2 years ago
Martin Evans	6a4cd506bd	Added a safe `TensorSplitsCollection` to the params which prevents incorrectly setting the `tensor_splits` collection	2 years ago
Martin Evans	9daf586ba8	Assorted cleanup leftover after the huge change in the last PR (comments, syntax style, etc)	2 years ago
Martin Evans	2a38808bca	- Added threads to context params, replaced all thread args with `uint?` - Replaced all binaries	2 years ago
Martin Evans	669ae47ef7	- Split parameters into two interfaces - params contains a list of loras, instead of just one	2 years ago
Martin Evans	bca55eace0	Initial changes to match the llama.cpp changes	2 years ago
Martin Evans	b47977300a	Removed one more unused parameter	2 years ago
Martin Evans	a1b0349561	Removed `ModelAlias` property (unused)	2 years ago
Martin Evans	2056078aef	Initial changes required for GGUF support	2 years ago
Martin Evans	77aa5fa0d0	Added `JsonConverter` attribute, so System.Text.Json serialization is seamless	2 years ago
Martin Evans	ee772a2921	added `using` statement instead of full qualification	2 years ago
Martin Evans	93f24f8a51	Switched to properly typed `Encoding` property	2 years ago
Martin Evans	29df14cd9c	Converted ModelParams into a `record` class. This has several advantages: - Equality, hashing etc all implemented automatically - Default values are defined in just one place (the properties) instead of the constructor as well - Added test to ensure that serialization works properly	2 years ago
Martin Evans	2830e5755c	- Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed. - Deleted `NativeInfo` (internal class, not used anywhere)	2 years ago
Erin Loy	8f0b52eb09	Re-renaming some arguments to allow for easy deserialization from appsettings.json.	2 years ago
Martin Evans	a9e6f21ab8	- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring! - Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around	2 years ago
Erin Loy	592a80840b	renamed some arguments in ModelParams constructor so that classcan be serialized easily	2 years ago
Martin Evans	685eb3b9c2	Replaced `nint` with `float[]?` in Model params, which is much more user friendly!	2 years ago
sa_ddam213	2a04e31b7d	ModelParams abstraction	2 years ago
SignalRT	348f2c7d72	Update llama.cpp binaries to 5f631c2 and align the context to that version It solves the problem with netstandard2 (is it really netstandard2 a thing right now?) Change context to solve problems. `5f631c2679`	2 years ago
Yaohui Liu	1062fe1a7e	feat: upgrade the native libraries.	2 years ago
Yaohui Liu	3bf74ec9b9	feat: add chat session for refactored code.	2 years ago

30 Commits (31244ae69131f312f01ea9d10d175ac7b58657d3)