Martin Evans
2b2d3af26b
Moved `Eval` out of `Utils` and into `SafeLLamaContextHandle`
2 years ago
Martin Evans
7fabcc1849
One last `TokenToString` case
2 years ago
Martin Evans
0e5e00e300
Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`)
2 years ago
Martin Evans
2d811b2603
- Moved `GetLogits` into `SafeLLamaContextHandle`
- Added disposal check into `SafeLLamaContextHandle`
2 years ago
Martin Evans
cd3cf2b77d
- Moved tokenization from `Utils.Tokenize` into `SafeLLamaContextHandle.Tokenize`, one less thing in `Utils`.
- Also refactored it to return an `int[]` instead of an `IEnumerable<int>`, solving the "multiple enumeration" problems at the source!
2 years ago
Martin Evans
73882de591
Merge pull request #81 from martindevans/tensor_splits_array
Improved Tensor Splits
2 years ago
Martin Evans
a9880d5665
Merge pull request #83 from martindevans/FixedSizeQueue_size_check
Cleaned up multiple enumeration in FixedSizeQueue
2 years ago
Martin Evans
bd3d8d3dc4
Cleaned up multiple enumeration in FixedSizeQueue
2 years ago
Martin Evans
f2499371ea
Pulled conversion of a `IModelParams` into a `LLamaContextParams` out into an extension method which can be used in other places.
2 years ago
Martin Evans
f1111a9f8b
Using a pin instead of a `fixed` block
2 years ago
Martin Evans
2c933c57a1
Fixed ModelOptions in Web project
2 years ago
Martin Evans
685eb3b9c2
Replaced `nint` with `float[]?` in Model params, which is much more user friendly!
2 years ago
Martin Evans
18b1df6762
Merge pull request #79 from saddam213/upstream_master
ModelParams & InferenceParams abstractions
2 years ago
sa_ddam213
e02d0c3617
Merge branch 'master' of https://github.com/SciSharp/LLamaSharp into upstream_master
2 years ago
Rinne
486c317887
docs: update README.md
2 years ago
Rinne
4d3cdbcd66
docs: add info about prerelease v0.4.2.
2 years ago
Rinne
bfe9cc8961
Merge pull request #78 from SciSharp/rinne-dev
feat: update the llama backends.
2 years ago
Yaohui Liu
1b15d28fc9
ci: remove MACOS ci pipelines.
2 years ago
sa_ddam213
e46646b8db
Merge branch 'master' of https://github.com/SciSharp/LLamaSharp into upstream_master
2 years ago
Martin Evans
5e15077766
Merge pull request #80 from saddam213/ExposeNative
Expose some native classes
2 years ago
Yaohui Liu
bb46a990d0
fix: add bug info for native api.
2 years ago
Yaohui Liu
e64c05126b
ci: update ci content.
2 years ago
Yaohui Liu
f16db72841
ci: add debug info.
2 years ago
Yaohui Liu
a59160a5cb
ci: update ci content.
2 years ago
Yaohui Liu
5fe13bd9f7
fix: update the dlls.
2 years ago
sa_ddam213
372894e1d4
Expose some native classes
2 years ago
sa_ddam213
bac9cba01a
InferenceParams abstractions
2 years ago
sa_ddam213
2a04e31b7d
ModelParams abstraction
2 years ago
Martin Evans
d2e9f9d96d
Added `ldd -r libllama.so` to try and discover is dependencies are missing
2 years ago
Yaohui Liu
d3775c527e
ci: add info to debug the ci error.
2 years ago
Yaohui Liu
6b2a06902e
fix: the ci error.
2 years ago
Yaohui Liu
546ba28a68
fix: ci error caused by branch merge.
2 years ago
Yaohui Liu
fc17e91d1a
feat: add backend for MACOS.
2 years ago
Yaohui Liu
9fcbd16b74
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev
2 years ago
Yaohui Liu
2968125daf
feat: update the llama backends.
2 years ago
Martin Evans
fa75e9d964
Merge pull request #77 from SignalRT/master
Update llama.cpp binaries to 5f631c2 and align the LlamaContext
2 years ago
Martin Evans
fe3bd11dfa
Merge branch 'master' into master
2 years ago
Martin Evans
b2ef8e6a26
Merge pull request #74 from martindevans/github_actions
GitHub actions
2 years ago
Martin Evans
d6fc83e981
- Added a folder with a 7B Llama2 model, automatically downloaded from huggingface. This can be used for unit tests.
- Caching that folder, so CI only has to download it once.
2 years ago
Martin Evans
c46751ae66
Fixed yaml syntax
2 years ago
Martin Evans
1545b821d7
Cleaned up installing multiple dotnets
2 years ago
Martin Evans
71b1ccd2f7
Always installing both 6 and 7
2 years ago
Martin Evans
618e02fb9c
- moved dotnet version into matrix
- using 6.0.x instead of 7.0.x
2 years ago
Martin Evans
7ef07104e7
Added queue fix, so that CI can pass
2 years ago
Martin Evans
e7e3df6c6b
fixed capitalisation
2 years ago
Martin Evans
ccf635e4db
Added GH action for some simple CI
2 years ago
SignalRT
528a7aafcb
Merge test changes from @martindevans
The poc of the test is working know. Finally the problem error seems to be related with the process stopping.
Once I changed the context with today llama.cpp binaries is working OK
2 years ago
SignalRT
348f2c7d72
Update llama.cpp binaries to 5f631c2 and align the context to that version
It solves the problem with netstandard2 (is it really netstandard2 a thing right now?)
Change context to solve problems.
5f631c2679
2 years ago
Rinne
94fde3abd6
Merge pull request #72 from martindevans/fixed_mirostate_mu
Fixed Mirostate Sampling
2 years ago
Rinne
075b785a4d
Merge branch 'master' into fixed_mirostate_mu
2 years ago