71 Commits (18b15184ea6dceba07b9e6a6a73594e823714d40)

Author SHA1 Message Date
  Martin Evans e89ca5cc17 Fixed a few minor warnings 2 years ago
  Martin Evans d8434ea9d6
Merge pull request #185 from martindevans/wip_major_api_change 2 years ago
  Martin Evans 1f8c94e386 Added in the `special` parameter to the tokenizer (introduced in https://github.com/ggerganov/llama.cpp/pull/3538) 2 years ago
  Martin Evans efb0664df0 - Added new binaries 2 years ago
  Martin Evans b8f0eff080 - Added `GetCharCountImpl` tests, fixed handling of empty strings 2 years ago
  Martin Evans 45118520fa - Improved coverage of `GBNFGrammarParser` up to 96% 2 years ago
  Martin Evans 9f694c584c Further improved grammar parser test coverage (up to 92%) 2 years ago
  Martin Evans bff41eef37 Added some more coverage of `GrammarRule`, checking that invalid rules are rejected 2 years ago
  Martin Evans 2a38808bca - Added threads to context params, replaced all thread args with `uint?` 2 years ago
  Martin Evans 669ae47ef7 - Split parameters into two interfaces 2 years ago
  Martin Evans 9a0a0ae9fe Removed cloning support 2 years ago
  Martin Evans 0d40338692 Fixed out-of-context handling in stateless executor 2 years ago
  Martin Evans ce1fc51163 Added some more native methods 2 years ago
  Martin Evans bca55eace0 Initial changes to match the llama.cpp changes 2 years ago
  Martin Evans fe54f6764f - Added unit tests for extension methods 2 years ago
  Martin Evans 3f80190f85 Minimal changes required to remove non-async inference. 2 years ago
  Martin Evans daf09eae64 Skipping tokenization of empty strings (saves allocating an empty array every time) 2 years ago
  Martin Evans bba801f4b7 Added a property to get the KV cache size from a context 2 years ago
  Martin Evans d3b8ee988c
Beam Search (#155) 2 years ago
  Martin Evans d0e57a8c92 sealed test class 2 years ago
  Martin Evans 3f082c6f2c Fixed naming in tests 2 years ago
  Martin Evans 614ba40948 - Added a `TokensEndsWithAnyString` extension to `IReadOnlyList<int>` which efficiently checks if a set of tokens ends with one of a set of strings. 2 years ago
  Martin Evans 821d7f615e Swapped to llama-7b-chat 2 years ago
  Martin Evans 21cbecb82d Disable test parallelism to prevent fix CI 2 years ago
  Rinne 4e83e48ad1
Merge pull request #122 from martindevans/gguf 2 years ago
  Martin Evans a70c7170dd - Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system. 2 years ago
  SignalRT fb007e5921 Changes to compile in VS Mac + change model to llama2 2 years ago
  Mihai 920efaca44 Add original test 2 years ago
  Mihai 2ae1891c13 Bug fixes after running tests. 2 years ago
  Mihai 0bd495276b Add initial tests + fix bugs. Still WIP since the test is failing. 2 years ago
  Martin Evans ba49ea2991 Removed hardcoded paths from projects, modified Runtime.targets to exclude missing binaries 2 years ago
  Martin Evans 2022b82947 Added binaries generated by this action: https://github.com/SciSharp/LLamaSharp/actions/runs/6002797872/job/16279896150 2 years ago
  Martin Evans 95dc12dd76 Switched to codellama-7b.gguf in tests (probably temporarily) 2 years ago
  Martin Evans 0c98ae1955 Passing ctx to `llama_token_nl(_ctx)` 2 years ago
  Martin Evans 2056078aef Initial changes required for GGUF support 2 years ago
  Martin Evans 5a6c6de0dc
Merge pull request #115 from martindevans/model_params_record 2 years ago
  Martin Evans ebacdb666d - Moved the lower level state get/set methods onto SafeLLamaContextHandle 2 years ago
  Martin Evans 77aa5fa0d0 Added `JsonConverter` attribute, so System.Text.Json serialization is seamless 2 years ago
  Martin Evans 634bd3feed Loosened requirements even more! 2 years ago
  Martin Evans 9587699a60 loosened requirements even further for CI 2 years ago
  Martin Evans bc70358b3e expanded epsilon enough to allow CI to pass 2 years ago
  Martin Evans 08501db155 cleaned up basic test a bit 2 years ago
  Martin Evans 498ed109c1 Fixed dot product based test 2 years ago
  Martin Evans 35e48691ea Added a known correct value to the unit tests 2 years ago
  Martin Evans dff308e31b Added a test for the LLamaEmbedder 2 years ago
  Martin Evans 93f24f8a51 Switched to properly typed `Encoding` property 2 years ago
  Martin Evans 29df14cd9c Converted ModelParams into a `record` class. This has several advantages: 2 years ago
  Martin Evans 2830e5755c - Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed. 2 years ago
  Martin Evans 9fc17f3136 Fixed unit tests 2 years ago
  Martin Evans 759ae26f36
Merge branch 'master' into grammar_basics 2 years ago