Yaohui Liu
5fe13bd9f7
fix: update the dlls.
2 years ago
Martin Evans
d2e9f9d96d
Added `ldd -r libllama.so` to try and discover is dependencies are missing
2 years ago
Yaohui Liu
d3775c527e
ci: add info to debug the ci error.
2 years ago
Yaohui Liu
6b2a06902e
fix: the ci error.
2 years ago
Yaohui Liu
546ba28a68
fix: ci error caused by branch merge.
2 years ago
Yaohui Liu
fc17e91d1a
feat: add backend for MACOS.
2 years ago
Yaohui Liu
9fcbd16b74
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev
2 years ago
Yaohui Liu
2968125daf
feat: update the llama backends.
2 years ago
Martin Evans
fa75e9d964
Merge pull request #77 from SignalRT/master
Update llama.cpp binaries to 5f631c2 and align the LlamaContext
2 years ago
Martin Evans
fe3bd11dfa
Merge branch 'master' into master
2 years ago
Martin Evans
b2ef8e6a26
Merge pull request #74 from martindevans/github_actions
GitHub actions
2 years ago
Martin Evans
d6fc83e981
- Added a folder with a 7B Llama2 model, automatically downloaded from huggingface. This can be used for unit tests.
- Caching that folder, so CI only has to download it once.
2 years ago
Martin Evans
c46751ae66
Fixed yaml syntax
2 years ago
Martin Evans
1545b821d7
Cleaned up installing multiple dotnets
2 years ago
Martin Evans
71b1ccd2f7
Always installing both 6 and 7
2 years ago
Martin Evans
618e02fb9c
- moved dotnet version into matrix
- using 6.0.x instead of 7.0.x
2 years ago
Martin Evans
7ef07104e7
Added queue fix, so that CI can pass
2 years ago
Martin Evans
e7e3df6c6b
fixed capitalisation
2 years ago
Martin Evans
ccf635e4db
Added GH action for some simple CI
2 years ago
SignalRT
528a7aafcb
Merge test changes from @martindevans
The poc of the test is working know. Finally the problem error seems to be related with the process stopping.
Once I changed the context with today llama.cpp binaries is working OK
2 years ago
SignalRT
348f2c7d72
Update llama.cpp binaries to 5f631c2 and align the context to that version
It solves the problem with netstandard2 (is it really netstandard2 a thing right now?)
Change context to solve problems.
5f631c2679
2 years ago
Rinne
94fde3abd6
Merge pull request #72 from martindevans/fixed_mirostate_mu
Fixed Mirostate Sampling
2 years ago
Rinne
075b785a4d
Merge branch 'master' into fixed_mirostate_mu
2 years ago
Rinne
c641dbdb83
Merge pull request #69 from martindevans/fixed_mirostat_spelling
Fixed Spelling Mirostate -> Mirostat
2 years ago
Rinne
8d37abd787
Merge pull request #68 from martindevans/sampling_improvements
Fixed Memory pinning in Sampling API
2 years ago
Rinne
1d29b240b2
Merge pull request #64 from martindevans/new_llama_state_loading_mechanism
Low level new loading system
2 years ago
Martin Evans
add3d5528b
Removed `MarshalAs` on array
2 years ago
Martin Evans
2245b84906
Update LLamaContextParams.cs
2 years ago
Martin Evans
c64507cb41
Correctly passing through mu value to mirostate instead of resetting it every time.
2 years ago
Rinne
0e438e6303
Merge pull request #63 from martindevans/more_multi_enumeration_fixes
Fixed More Multiple Enumeration
2 years ago
Rinne
cd015055a8
Merge branch 'master' into more_multi_enumeration_fixes
2 years ago
Rinne
e5ca18fd86
Merge pull request #54 from martindevans/fix_multiple_enumeration
Fixed Multiple Enumeration
2 years ago
Martin Evans
23629a15f8
Merge pull request #1 from saddam213/new_llama_state_loading_mechanism
LLamaContextParams epsilon and tensor split changes
2 years ago
sa_ddam213
3e252c81f6
LLamaContextParams epsilon and tensor split changes
2 years ago
Martin Evans
36735f7908
Fixed spelling of "mirostat" instead of "mirostate"
2 years ago
Martin Evans
ec49bdd6eb
- Most importantly: Fixed issue in `SamplingApi`, `Memory` was pinned, but never unpinned!
- Moved repeated code to convert `LLamaTokenDataArray` into a `LLamaTokenDataArrayNative` into a helper method.
- Modified all call sites to dispose the `MemoryHandle`
- Saved one copy of the `List<LLamaTokenData>` into a `LLamaTokenData[]` in `LlamaModel`
2 years ago
Martin Evans
6985d3ab60
Added comments on two properties
2 years ago
Martin Evans
c974c8429e
Removed leftover `using`
2 years ago
Martin Evans
afb9d24f3a
Added model `Tokenize` method
2 years ago
Martin Evans
369c915afe
Added TokenToString conversion on model handle
2 years ago
Martin Evans
b721072aa5
Exposed some extra model properties on safe handle
2 years ago
Martin Evans
44b1e93609
Moved LoRA loading into `SafeLlamaModelHandle`
2 years ago
Martin Evans
c95b14d8b3
- Fixed null check
- Additional comments
2 years ago
Martin Evans
f16aa58e12
Updated to use the new loading system in llama (llama_state). This new system has split model weights and contexts into two separate things, allowing one set of weights to be shared between many contexts.
This change _only_ implements the low level API and makes no effort to update the LlamaSharp higher level abstraction.
It is built upon llama `b3f138d`, necessary DLLs are **not** included in this commit.
2 years ago
Martin Evans
8848fc6e3d
Fixed 2 more "multi enumeration" issues
2 years ago
Martin Evans
ad28a5acdb
Merge branch 'master' into fix_multiple_enumeration
2 years ago
Rinne
4d7d4f2bfe
Merge pull request #59 from saddam213/master
Instruct & Stateless web example implemented
2 years ago
Rinne
66d6b00b49
Merge pull request #57 from martindevans/larger_states
Larger states
2 years ago
Martin Evans
3d07721a00
Fixed eager count check
2 years ago
Rinne
c5e8b3eba2
Merge pull request #56 from martindevans/memory_mapped_save_loading_and_saving
Memory Mapped LoadState/SaveState
2 years ago