193 Commits (86398d400da99dbe5669ff43dba2deb66f82fc68)

Author SHA1 Message Date
  Martin Evans 826c6aaec3 cleaned up higher level code using the sampling API: 2 years ago
  Martin Evans cf4754db44 Removed unnecessary parameters from some low level sampler methods 2 years ago
  Martin Evans f70525fec2 Two small improvements to the native sampling API: 2 years ago
  Martin Evans a911b77dec Various minor changes, resolving about 100 ReSharper code quality warnings 2 years ago
  Martin Evans 5a6c6de0dc
Merge pull request #115 from martindevans/model_params_record 2 years ago
  Martin Evans 70be6c7368 Removed `virtual` method in newly sealed class 2 years ago
  Martin Evans ebacdb666d - Moved the lower level state get/set methods onto SafeLLamaContextHandle 2 years ago
  Martin Evans 77aa5fa0d0 Added `JsonConverter` attribute, so System.Text.Json serialization is seamless 2 years ago
  Martin Evans df80ec9161
Merge pull request #97 from martindevans/embedder_tests 2 years ago
  Martin Evans 058c4e84b1 Rewritten LLamaEmbedder to use `LLamaContext` instead of the lower level handles 2 years ago
  Martin Evans 829f32b27d - Added `Obsolete` attributes to the entire `OldVersion` namespace, so they can be removed in the future 2 years ago
  Martin Evans ee772a2921 added `using` statement instead of full qualification 2 years ago
  Martin Evans 93f24f8a51 Switched to properly typed `Encoding` property 2 years ago
  zombieguy 45b01d5a78 Improved type conversion 2 years ago
  Martin Evans 29df14cd9c Converted ModelParams into a `record` class. This has several advantages: 2 years ago
  Martin Evans 2830e5755c - Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed. 2 years ago
  Martin Evans 854532c08e
Merge pull request #112 from martindevans/classifier_free_guidance 2 years ago
  Martin Evans 4b7d718551 Added native symbol for CFG 2 years ago
  Erin Loy 8f0b52eb09 Re-renaming some arguments to allow for easy deserialization from appsettings.json. 2 years ago
  Martin Evans 9fc17f3136 Fixed unit tests 2 years ago
  Martin Evans 759ae26f36
Merge branch 'master' into grammar_basics 2 years ago
  Martin Evans a9e6f21ab8 - Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring! 2 years ago
  Martin Evans e7b217f462 Fixed out of context logic 2 years ago
  Martin Evans 4738c26299 - Reduced context size of test, to speed it up 2 years ago
  Martin Evans ae8ef17a4a - Added various convenience overloads to `LLamaContext.Eval` 2 years ago
  Erin Loy 592a80840b renamed some arguments in ModelParams constructor so that classcan be serialized easily 2 years ago
  Martin Evans 64416ca23c - Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`) 2 years ago
  Martin Evans 0294bb1303 Some of the basics of the grammar API 2 years ago
  Rinne 62331852bc
Merge pull request #90 from martindevans/proposal_multi_context 2 years ago
  zombieguy 10f88ebd0e
Potential fix for .Net Framework issues (#103) 2 years ago
  Martin Evans 7ebff89f68
Merge pull request #101 from martindevans/llama_sample_classifier_free_guidance 2 years ago
  Martin Evans 6c84accce8 Added `llama_sample_classifier_free_guidance` method from native API 2 years ago
  Martin Evans afe559ef1c Added comments to `Logger` and fixed some nullability warnings 2 years ago
  Martin Evans 6473f8d5e5 Temporarily added a `Console.WriteLine` into the test, to print the embedding vector for "cat" in CI 2 years ago
  Martin Evans 1b35be2e0c Added some additional basic tests 2 years ago
  Martin Evans f5a260926f Renamed `EmbeddingCount` to `EmbeddingSize` in higher level class 2 years ago
  Martin Evans 479ff57853 Renamed `EmbeddingCount` to `EmbeddingSize` 2 years ago
  Martin Evans d0a7a8fcd6 - Cleaned up disposal in LLamaContext 2 years ago
  Martin Evans 4d741d24f2 Marked old `LLamaContext` constructor obsolete 2 years ago
  Martin Evans 20bdc2ec6f - Apply LoRA in `LLamaWeights.LoadFromFile` 2 years ago
  Martin Evans e2fe08a9a2 Added a higher level `LLamaWeights` wrapper around `SafeLlamaModelHandle` 2 years ago
  Martin Evans fda7e1c038 Fixed mirostat/mirostate 2 years ago
  Martin Evans f3511e390f WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving. 2 years ago
  Martin Evans d7f971fc22 Improved `NativeApi` file a bit: 2 years ago
  Martin Evans 841cf88e3b
Merge pull request #96 from martindevans/minor_quantizer_improvements 2 years ago
  Martin Evans ce325b49c7 Rewritten comments 2 years ago
  Martin Evans b69f4bc40e - Expanded range of supported types in quantizer to match llama.cpp 2 years ago
  sa_ddam213 a67ea36dd9 Typo and formatting 2 years ago
  sa_ddam213 726987b761 Add native logging output 2 years ago
  Martin Evans acd91341e6 Added lots of comments to all the LLamaFtype variants 2 years ago