LLamaSharp

Commit Graph

Author	SHA1	Message	Date
Martin Evans	9cdc72aa67	Fixed `ToLlamaContextParams` using the wrong parameter for `use_mmap`	2 years ago
Martin Evans	2b2d3af26b	Moved `Eval` out of `Utils` and into `SafeLLamaContextHandle`	2 years ago
Martin Evans	0e5e00e300	Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`)	2 years ago
Martin Evans	2d811b2603	- Moved `GetLogits` into `SafeLLamaContextHandle` - Added disposal check into `SafeLLamaContextHandle`	2 years ago
Martin Evans	cd3cf2b77d	- Moved tokenization from `Utils.Tokenize` into `SafeLLamaContextHandle.Tokenize`, one less thing in `Utils`. - Also refactored it to return an `int[]` instead of an `IEnumerable<int>`, solving the "multiple enumeration" problems at the source!	2 years ago
Martin Evans	f2499371ea	Pulled conversion of a `IModelParams` into a `LLamaContextParams` out into an extension method which can be used in other places.	2 years ago
Martin Evans	f1111a9f8b	Using a pin instead of a `fixed` block	2 years ago
Martin Evans	685eb3b9c2	Replaced `nint` with `float[]?` in Model params, which is much more user friendly!	2 years ago
sa_ddam213	e46646b8db	Merge branch 'master' of https://github.com/SciSharp/LLamaSharp into upstream_master	2 years ago
sa_ddam213	372894e1d4	Expose some native classes	2 years ago
sa_ddam213	2a04e31b7d	ModelParams abstraction	2 years ago
SignalRT	348f2c7d72	Update llama.cpp binaries to 5f631c2 and align the context to that version It solves the problem with netstandard2 (is it really netstandard2 a thing right now?) Change context to solve problems. `5f631c2679`	2 years ago
sa_ddam213	3e252c81f6	LLamaContextParams epsilon and tensor split changes	2 years ago
Martin Evans	44b1e93609	Moved LoRA loading into `SafeLlamaModelHandle`	2 years ago
Martin Evans	f16aa58e12	Updated to use the new loading system in llama (llama_state). This new system has split model weights and contexts into two separate things, allowing one set of weights to be shared between many contexts. This change _only_ implements the low level API and makes no effort to update the LlamaSharp higher level abstraction. It is built upon llama `b3f138d`, necessary DLLs are not included in this commit.	2 years ago
Yaohui Liu	1062fe1a7e	feat: upgrade the native libraries.	2 years ago
Yaohui Liu	3bf74ec9b9	feat: add chat session for refactored code.	2 years ago
Yaohui Liu	264fb9a706	refactor: LLamaModel and LLamaExecutor.	2 years ago
Yaohui Liu	3a62f087fe	fix: encoding error when using other languages.	2 years ago
Yaohui Liu	e21589afa6	fix: n_gpu_layers not work in latest commit.	2 years ago
Yaohui Liu	18c2ff2395	refactor: instruct mode and examples.	2 years ago
Yaohui Liu	d6bd1b7107	fix: add check for model file path.	2 years ago
Yaohui Liu	afedd3c949	fix: errors when input is not English or too long.	2 years ago
Yaohui Liu	1fca06dc7f	fix: n_gpu_layers miss in llama context.	2 years ago
Yaohui Liu	fce10f3c4f	feat: add ChatSession.	2 years ago
Yaohui Liu	d6a7997e46	feat: add gpt model.	2 years ago

26 Commits (a67ea36dd9cf91c93d5a2fa4e6a82b7d4cb15b89)