96 Commits (refactor_v1.0)

Author SHA1 Message Date
  Martin Evans d87d654a34
Merge pull request #348 from martindevans/new_object_based_sampling_pipeline 1 year ago
  dependabot[bot] 85dc43dde0
build(deps): bump xunit from 2.6.2 to 2.6.3 1 year ago
  dependabot[bot] 8fb4476813
build(deps): bump xunit.runner.visualstudio from 2.5.4 to 2.5.5 1 year ago
  Martin Evans 835958398c - Removed the object wrappers and configurable pipeline, they can be better written in code. 1 year ago
  Martin Evans 3afc007499 - Added "protected" logits, instead of the awkward save/load mechanism 1 year ago
  dependabot[bot] 6d86219d71
build(deps): bump xunit.runner.visualstudio from 2.5.3 to 2.5.4 2 years ago
  Rinne cf4edeac55
Merge pull request #315 from futzy314/fix-ai-request-settings 2 years ago
  Martin Evans 597188c236
Merge pull request #316 from martindevans/update_binaries_nov 2 years ago
  Ian Foutz b2bf59d8d5 Unit tests added 2 years ago
  dependabot[bot] 41292b4b32
build(deps): bump xunit from 2.6.1 to 2.6.2 2 years ago
  Martin Evans 77003d763e Added new symbols from llama.h 2 years ago
  Martin Evans 48c5039054 Improved test coverage. Discovered some issues: 2 years ago
  dependabot[bot] f68aa777f1
build(deps): bump Microsoft.NET.Test.Sdk from 17.7.2 to 17.8.0 2 years ago
  dependabot[bot] b7893317f5
build(deps): bump xunit.runner.visualstudio from 2.5.0 to 2.5.3 2 years ago
  dependabot[bot] b20c3ecda5
build(deps): bump xunit from 2.5.0 to 2.6.1 2 years ago
  Martin Evans 09bc688b3c Skipped slow test again 2 years ago
  Martin Evans cdf20d3c7a Added timing to stateless test 2 years ago
  Martin Evans 7e3cde4c13 Moved helper methods into `LLamaBatchSafeHandle` 2 years ago
  Martin Evans ccb8afae46 Cleaned up stateless executor as preparation for changing it to use the new batched decoding system. 2 years ago
  Martin Evans 321d0b58c4
Merge pull request #202 from martindevans/multi_gpu 2 years ago
  Martin Evans d5874a279c Updated test runner to latest version 2 years ago
  Martin Evans 51d4411a58 Added two new classes for detokenization tasks: 2 years ago
  Martin Evans efdf3d630c - Removed all `TokenToString` methods (it's never correct to use them, because sometimes one single character may be represented by multiple tokens). 2 years ago
  Martin Evans 1d0620e634 Created a test that "roundtrips" strings through tokenization. This reveals some flaws with certain characters 2 years ago
  Martin Evans b4e7f64e76 Added System.Text.Json serialization for `TensorSplitsCollectionConverter` 2 years ago
  Martin Evans e89ca5cc17 Fixed a few minor warnings 2 years ago
  Martin Evans d8434ea9d6
Merge pull request #185 from martindevans/wip_major_api_change 2 years ago
  Martin Evans 1f8c94e386 Added in the `special` parameter to the tokenizer (introduced in https://github.com/ggerganov/llama.cpp/pull/3538) 2 years ago
  Martin Evans efb0664df0 - Added new binaries 2 years ago
  Martin Evans b8f0eff080 - Added `GetCharCountImpl` tests, fixed handling of empty strings 2 years ago
  Martin Evans 45118520fa - Improved coverage of `GBNFGrammarParser` up to 96% 2 years ago
  Martin Evans 9f694c584c Further improved grammar parser test coverage (up to 92%) 2 years ago
  Martin Evans bff41eef37 Added some more coverage of `GrammarRule`, checking that invalid rules are rejected 2 years ago
  Martin Evans 2a38808bca - Added threads to context params, replaced all thread args with `uint?` 2 years ago
  Martin Evans 669ae47ef7 - Split parameters into two interfaces 2 years ago
  Martin Evans 9a0a0ae9fe Removed cloning support 2 years ago
  Martin Evans 0d40338692 Fixed out-of-context handling in stateless executor 2 years ago
  Martin Evans ce1fc51163 Added some more native methods 2 years ago
  Martin Evans bca55eace0 Initial changes to match the llama.cpp changes 2 years ago
  Martin Evans fe54f6764f - Added unit tests for extension methods 2 years ago
  Martin Evans 3f80190f85 Minimal changes required to remove non-async inference. 2 years ago
  Martin Evans daf09eae64 Skipping tokenization of empty strings (saves allocating an empty array every time) 2 years ago
  Martin Evans bba801f4b7 Added a property to get the KV cache size from a context 2 years ago
  Martin Evans d3b8ee988c
Beam Search (#155) 2 years ago
  Martin Evans d0e57a8c92 sealed test class 2 years ago
  Martin Evans 3f082c6f2c Fixed naming in tests 2 years ago
  Martin Evans 614ba40948 - Added a `TokensEndsWithAnyString` extension to `IReadOnlyList<int>` which efficiently checks if a set of tokens ends with one of a set of strings. 2 years ago
  Martin Evans 821d7f615e Swapped to llama-7b-chat 2 years ago
  Martin Evans 21cbecb82d Disable test parallelism to prevent fix CI 2 years ago
  Rinne 4e83e48ad1
Merge pull request #122 from martindevans/gguf 2 years ago