LLamaSharp

Commit Graph

Author	SHA1	Message	Date
Rinne	495177fd0f	fix: typos.	1 year ago
Martin Evans	a8ba9f05b3	March Binary Update (#565 ) * Updated binaries to llama.cpp `3ab8b3a92ede46df88bc5a2dfca3777de4a2b2b6` (build run: https://github.com/SciSharp/LLamaSharp/actions/runs/8118890586) * Added abort callback * Added properties to get/set thread count on `LLamaContext` * Fixed LLamaLogLevel numbering	1 year ago
Martin Evans	15a98b36d8	Updated everything to work with llama.cpp `ce32060198`	1 year ago
Martin Evans	9b995510d6	Removed all setters in `IModelParams` and `IContextParams`, allowing implementations to be immutable.	1 year ago
Martin Evans	8416cb866a	Improved exceptions in IModelParams for unknown KV override types.	1 year ago
Martin Evans	f860f88c36	Code cleanup driven by R# suggestions: - Made `NativeApi` into a `static class` (it's not intended to be instantiated) - Moved `LLamaTokenType` enum out into a separate file - Made `LLamaSeqId` and `LLamaPos` into `record struct`, convenient to have equality etc	1 year ago
Martin Evans	2cded1b296	Fixed alignment of value fields in `LLamaModelMetadataOverride`	1 year ago
Martin Evans	199b4418c3	Fixed JSON serialization for ModelParams	1 year ago
Martin Evans	2f0deeadcd	Implemented serialization for `MetadataOverride`. Deserialization is broken (converter is never called)	1 year ago
Martin Evans	b868b056f7	Added metadata overrides to `IModelParams`	1 year ago
xbotter	340bbbcf48	Move JSON converter for TensorSplitsCollection	1 year ago
Martin Evans	e47431ed80	Modified `TensorSplitsCollection` so it accepts any number of splits, as long as it doesn't exceed the number of supported devices	2 years ago
Martin Evans	f621ec67e8	Fixed serialization	2 years ago
Martin Evans	768747c652	spelling	2 years ago
Martin Evans	b4e7f64e76	Added System.Text.Json serialization for `TensorSplitsCollectionConverter`	2 years ago
Martin Evans	6a4cd506bd	Added a safe `TensorSplitsCollection` to the params which prevents incorrectly setting the `tensor_splits` collection	2 years ago
Martin Evans	9daf586ba8	Assorted cleanup leftover after the huge change in the last PR (comments, syntax style, etc)	2 years ago
Martin Evans	2a38808bca	- Added threads to context params, replaced all thread args with `uint?` - Replaced all binaries	2 years ago
Martin Evans	669ae47ef7	- Split parameters into two interfaces - params contains a list of loras, instead of just one	2 years ago
Martin Evans	bca55eace0	Initial changes to match the llama.cpp changes	2 years ago
Martin Evans	b47977300a	Removed one more unused parameter	2 years ago
Martin Evans	a1b0349561	Removed `ModelAlias` property (unused)	2 years ago
Martin Evans	2056078aef	Initial changes required for GGUF support	2 years ago
Martin Evans	a911b77dec	Various minor changes, resolving about 100 ReSharper code quality warnings	2 years ago
Martin Evans	93f24f8a51	Switched to properly typed `Encoding` property	2 years ago
Martin Evans	a9e6f21ab8	- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring! - Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around	2 years ago
Martin Evans	685eb3b9c2	Replaced `nint` with `float[]?` in Model params, which is much more user friendly!	2 years ago
sa_ddam213	2a04e31b7d	ModelParams abstraction	2 years ago

28 Commits (master)