LLamaSharp

333 MB

Branch: rinne-dev

Author	SHA1	Message	Date
SignalRT	fb007e5921	Changes to compile in VS Mac + change model to llama2 This commit includes changes to compile en VS Mac + changest to use llama2 not codellama. It includes MacOS binaries in memory and metal	2 years ago
Martin Evans	95dc12dd76	Switched to codellama-7b.gguf in tests (probably temporarily)	2 years ago
Martin Evans	0c98ae1955	Passing ctx to `llama_token_nl(_ctx)`	2 years ago
Martin Evans	2830e5755c	- Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed. - Deleted `NativeInfo` (internal class, not used anywhere)	2 years ago
Martin Evans	a9e6f21ab8	- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring! - Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around	2 years ago
Martin Evans	1b35be2e0c	Added some additional basic tests	2 years ago