Mihai
71f02e08c2
Add grammar example
2 years ago
Mihai
920efaca44
Add original test
2 years ago
Mihai
2ae1891c13
Bug fixes after running tests.
SymbolIds is now SortedDictionary (although I'm not sure it really needs to be) because the test was failing due to expected value being in another order. The C++ data structure if SymbolIds is std::map<std::string, uint32_t> so the items are ordered by key.
2 years ago
Mihai
0bd495276b
Add initial tests + fix bugs. Still WIP since the test is failing.
2 years ago
Mihai
0f373fcc6d
Finish grammar_parser translation from C++ to C#
2 years ago
Mihai
3c919b56fe
Use ReadOnlySpan everywhere instead of ReadOnlyMemeory and instead of returning tuple, reference the ReadOnlySpan.
2 years ago
Mihai
8b4ec6d973
Address PR change requests
2 years ago
Mihai
7f31276bdf
[WIP] Translating the GrammarParser
2 years ago
Martin Evans
e34491855e
Merge pull request #135 from martindevans/really-fixed-cublas-paths
Fixed those cublas paths again
2 years ago
Martin Evans
229151ca37
Fixed those cublas paths again
2 years ago
Martin Evans
d0ca63fea5
Merge pull request #134 from martindevans/final-linux-cublas-fix
Fixed the cublas linux paths again
2 years ago
Martin Evans
dc4ef4f1a0
Fixed the cublas linux paths again
2 years ago
Martin Evans
82b7c1a475
Merge pull request #133 from martindevans/linux_cublas_final_path
fixed linux cublas paths in final step
2 years ago
Martin Evans
d695923711
fixed linux cublas paths in final step
2 years ago
Martin Evans
bdc1ea6560
Merge pull request #132 from martindevans/linux-cublas
Fixed linux cublas filenames
2 years ago
Martin Evans
c88717ace6
Fixed linux cublas file names
2 years ago
Martin Evans
c7096948c0
Fixed linux cublas filenames
2 years ago
Martin Evans
086fd5345c
Merge pull request #131 from martindevans/linux-cublas
Linux cublas
2 years ago
Martin Evans
e4dc543d24
Removed x86_64 macos build
2 years ago
Martin Evans
318ccd433f
Fixed linux cublas filepaths
2 years ago
Martin Evans
86398d400d
Added cublas target for Linux
2 years ago
Martin Evans
f86aa98300
Merge pull request #130 from martindevans/cublas_fix_paths
Fixed cuda paths again
2 years ago
Martin Evans
91ed8e8ccf
Fixed cuda paths again
2 years ago
Martin Evans
ea5d8a4695
Merge pull request #127 from martindevans/cublas_fix_paths
Fixed paths
2 years ago
Martin Evans
d076b723f5
Fixed paths
2 years ago
Martin Evans
5328f443b9
Dependency Building In Github Action ( #126 )
* new github action to build deps (manually triggered)
2 years ago
Martin Evans
964f497c50
Merge pull request #125 from martindevans/native_sampling_api_improvements
Removed unnecessary parameters from some low level sampler methods
2 years ago
Martin Evans
826c6aaec3
cleaned up higher level code using the sampling API:
- Fixed multiple enumeration
- Fixed newline penalisation
2 years ago
Martin Evans
cf4754db44
Removed unnecessary parameters from some low level sampler methods
2 years ago
Martin Evans
0ce5cf97fc
Merge pull request #124 from martindevans/native_sampling_api_improvements
Two small improvements to the native sampling API
2 years ago
Martin Evans
f70525fec2
Two small improvements to the native sampling API:
- Modified `llama_sample_token_mirostat` and `llama_sample_token_mirostat_v2` to take `ref float` instead of as a `float*`. Less pointers is always good.
- Modified `llama_sample_repetition_penalty` and `llama_sample_frequency_and_presence_penalties` to take pointers instead of arrays. This allows the use non non allocating types (e.g. Span) instead of arrays
- Modified higher level API to accept `Memory<int>` instead of `int[]`, which can be used to reduce allocations at call sites
2 years ago
Martin Evans
da3dffe812
Merge pull request #120 from martindevans/code_warnings_cleanup
ReSharper code warnings cleanup
2 years ago
Martin Evans
a911b77dec
Various minor changes, resolving about 100 ReSharper code quality warnings
2 years ago
Martin Evans
5a6c6de0dc
Merge pull request #115 from martindevans/model_params_record
ModelsParams record class
2 years ago
Martin Evans
d367317c2c
Merge pull request #119 from martindevans/improved_cloning
Improved Cloning
2 years ago
Martin Evans
70be6c7368
Removed `virtual` method in newly sealed class
2 years ago
Martin Evans
ebacdb666d
- Moved the lower level state get/set methods onto SafeLLamaContextHandle
- Used those methods to add a `Clone` method to SafeLLamaContextHandle
- Simplified `LLamaContext` by using the new methods
- Sealed `LLamaContext` and `LLamaEmbedder`
2 years ago
Martin Evans
77aa5fa0d0
Added `JsonConverter` attribute, so System.Text.Json serialization is seamless
2 years ago
Martin Evans
df80ec9161
Merge pull request #97 from martindevans/embedder_tests
Embedder Test
2 years ago
Martin Evans
634bd3feed
Loosened requirements even more!
2 years ago
Martin Evans
9587699a60
loosened requirements even further for CI
2 years ago
Martin Evans
bc70358b3e
expanded epsilon enough to allow CI to pass
2 years ago
Martin Evans
469b5e6fcd
Merge pull request #117 from martindevans/more_obsoletion
OldVersion obsoletion notices
2 years ago
Martin Evans
804686818c
Merge branch 'embedder_tests' of github.com:martindevans/LLamaSharp into embedder_tests
2 years ago
Martin Evans
058c4e84b1
Rewritten LLamaEmbedder to use `LLamaContext` instead of the lower level handles
2 years ago
Martin Evans
08501db155
cleaned up basic test a bit
2 years ago
Martin Evans
498ed109c1
Fixed dot product based test
2 years ago
Martin Evans
35e48691ea
Added a known correct value to the unit tests
2 years ago
Martin Evans
dff308e31b
Added a test for the LLamaEmbedder
2 years ago
Martin Evans
829f32b27d
- Added `Obsolete` attributes to the entire `OldVersion` namespace, so they can be removed in the future
- Minor changes to cleanup some of the compiler warnings
2 years ago