92 Commits (3d76ef7b6ab554277bd44df4857a3b2014758fb7)

Author SHA1 Message Date
  Rinne 495177fd0f fix: typos. 1 year ago
  Martin Evans c325ac9127
April 2024 Binary Update (#662) 1 year ago
  Rinne b677cdc6a3
Merge pull request #560 from eublefar/feature/chat-session-state-management 1 year ago
  eublefar d88f9e1199 Return null executor state if it's serialized in an old way 1 year ago
  eublefar a31391edd7 Polymorphic serialization for executor state and transforms 1 year ago
  eublefar 5f3803d23c Make state editable by the user, add deepcopy to fields that require it 1 year ago
  Martin Evans a8ba9f05b3
March Binary Update (#565) 1 year ago
  Martin Evans 15a98b36d8 Updated everything to work with llama.cpp ce32060198 1 year ago
  Martin Evans 42be9b136d Switched form using raw integers, to a `LLamaToken` struct 1 year ago
  Martin Evans f860f88c36 Code cleanup driven by R# suggestions: 1 year ago
  Martin Evans 199b4418c3 Fixed JSON serialization for ModelParams 1 year ago
  Martin Evans b868b056f7 Added metadata overrides to `IModelParams` 1 year ago
  Martin Evans 439d14a061 Updated binaries: 1 year ago
  xbotter 340bbbcf48
Move JSON converter for TensorSplitsCollection 1 year ago
  Martin Evans 01c7f1b4da
Update LLama/Common/ModelParams.cs 1 year ago
  Martin Evans e6148c952e Fixed encoding of `Encoding` 1 year ago
  Martin Evans d87d654a34
Merge pull request #348 from martindevans/new_object_based_sampling_pipeline 1 year ago
  Martin Evans b34f72a883 - Added `SamplingPipeline` to inference params which overrides all other options with an entirely custom pipeline. 1 year ago
  Philipp Bauer 67e6d633fd Rebuild ChatSession class 2 years ago
  Martin Evans 8540c8d220
Merge pull request #312 from martindevans/removed_obsolete_modelparams_constructor 2 years ago
  Martin Evans c74f463d8e Removed the obsolete constructor in `ModelParams`, it was marked obsolete 3 months ago. 2 years ago
  Martin Evans 48c5039054 Improved test coverage. Discovered some issues: 2 years ago
  Martin Evans 89fef05362 This commit (5fe721bdbe) accidentally removed a load of stuff that it shouldn't. Fixed that. 2 years ago
  Martin Evans e3468d04f0
Merge pull request #277 from martindevans/feature/min_p 2 years ago
  Martin Evans d743516070 - Added support for the MinP sampler 2 years ago
  SignalRT 97006a214f Merge remote-tracking branch 'upstream/master' into RuntimeDetection 2 years ago
  Martin Evans 31244ae691
Merge branch 'master' into YaRN_scaling_parameters 2 years ago
  SignalRT 5fe721bdbe Revert "Merge branch 'pr/268' into RuntimeDetection" 2 years ago
  Martin Evans db1bc741b0 Modified `ContextSize` in parameters to be nullable. A null value means autodetect from the model. 2 years ago
  Udayshankar Ravikumar 4071c1f5fc Updated preprocessor directives 2 years ago
  Martin Evans 04ee64a6be Exposed YaRN scaling parameters in IContextParams 2 years ago
  Udayshankar Ravikumar 1dad1ff834 Enhance framework compatibility 2 years ago
  Martin Evans 529b06b35b - Fixed rope frequency/base to use the values in the model by default, instead of always overriding them by default! 2 years ago
  Martin Evans c786fb0ec8 Using `IReadOnlyList` instead of `IEnumerable` in `IInferenceParams` 2 years ago
  Martin Evans 321d0b58c4
Merge pull request #202 from martindevans/multi_gpu 2 years ago
  Martin Evans f6a472ae86 Setting the default seed to `0xFFFFFFFF` (no seed, randomised) 2 years ago
  Martin Evans f621ec67e8 Fixed serialization 2 years ago
  Martin Evans b4e7f64e76 Added System.Text.Json serialization for `TensorSplitsCollectionConverter` 2 years ago
  Martin Evans 281e58f059 Fixed default value 2 years ago
  Martin Evans 6a4cd506bd Added a safe `TensorSplitsCollection` to the params which prevents incorrectly setting the `tensor_splits` collection 2 years ago
  Martin Evans 9daf586ba8 Assorted cleanup leftover after the huge change in the last PR (comments, syntax style, etc) 2 years ago
  Martin Evans 2a38808bca - Added threads to context params, replaced all thread args with `uint?` 2 years ago
  Martin Evans 669ae47ef7 - Split parameters into two interfaces 2 years ago
  Martin Evans bca55eace0 Initial changes to match the llama.cpp changes 2 years ago
  redthing1 296ba607de
make InferenceParams a record so we can use with 2 years ago
  Martin Evans b1e9d8240d
Merge pull request #149 from martindevans/removed_unused_inference_params 2 years ago
  Martin Evans b47977300a Removed one more unused parameter 2 years ago
  Martin Evans a1b0349561 Removed `ModelAlias` property (unused) 2 years ago
  sa_ddam213 09d8f434f2
Extract LLamaLogLevel, Remove Logger class 2 years ago
  Martin Evans 77bd090150 Simplified `LLamaInteractExecutor` antiprompt matching by using new extension method 2 years ago