LLamaSharp

333 MB

Tree: bff41eef37

Author	SHA1	Message	Date
Martin Evans	a9e6f21ab8	- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring! - Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around	2 years ago
Martin Evans	e2fe08a9a2	Added a higher level `LLamaWeights` wrapper around `SafeLlamaModelHandle`	2 years ago
Martin Evans	f31bdf6b93	Using the right context for Bob	2 years ago
Martin Evans	f3511e390f	WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving. The biggest single change is renaming `LLamaModel` to `LLamaContext`	2 years ago