Martin Evans
a8ba9f05b3
March Binary Update ( #565 )
* Updated binaries to llama.cpp `3ab8b3a92ede46df88bc5a2dfca3777de4a2b2b6` (build run: https://github.com/SciSharp/LLamaSharp/actions/runs/8118890586 )
* Added abort callback
* Added properties to get/set thread count on `LLamaContext`
* Fixed LLamaLogLevel numbering
1 year ago
Martin Evans
defac000ad
Added a `%(RecursiveDir)` element to the props file, this causes files to be copied along with the folder structure rather than dumped into the root. ( #561 )
1 year ago
Martin Evans
17385e12b6
Merge pull request #479 from martindevans/update_binaries_feb_2024
Update binaries feb 2024
1 year ago
Martin Evans
bac40a3b7a
Added new binaries, from this run: https://github.com/SciSharp/LLamaSharp/actions/runs/7792319886
1 year ago
Jason Couture
c963b051e2
Add nuspec for OpenCL (CLBLAST)
1 year ago
Martin Evans
b2e815d51e
Updated all binaries (from this run: https://github.com/SciSharp/LLamaSharp/actions/runs/7746303349 )
1 year ago
Jason Couture
db7e1e88f8
Use llama instead of libllama in `[DllImport]`
This results in windows users not needing to rename the DLL. This allows native llama builds to be dropped in, even on windows.
I also took the time to update the documentation, removing references to renaming the files, since the names now match.
Fixes #463
1 year ago
Martin Evans
439d14a061
Updated binaries:
- build run: https://github.com/SciSharp/LLamaSharp/actions/runs/7196891440
- commit: 9fb13f9584
1 year ago
Martin Evans
7486e6388a
Updated nuspec files
2 years ago
Martin Evans
37466956c7
Added new binaries.
- Built by this run: https://github.com/SciSharp/LLamaSharp/actions/runs/6921572568
- commit: `e937066420b79a757bf80e9836eb12b88420a218`
- Rearranged paths
2 years ago
Yaohui Liu
d7675f7936
Merge branch 'master' of github.com:AsakusaRinne/LLamaSharp into cuda_detection
2 years ago
Yaohui Liu
4d2c5f1003
build: change nuget configuration for cuda detection.
2 years ago
SignalRT
7691f83516
Test build and nuget packages
2 years ago
Yaohui Liu
d03e1dbe30
feat: support cuda feature detection.
2 years ago
SignalRT
200011e186
Revert "Merge feat: add detection template for cuda and avx. #268"
This reverts commit b4b3ea9d99 .
2 years ago
SignalRT
b4b3ea9d99
Merge feat: add detection template for cuda and avx. #268
Just merge cuda and avx detection and change layout.
2 years ago
SignalRT
0edbd92530
Change nuget backend packages
Delete Backend.Metal because is not needed anymore.
Do not include .metal in x86_64 binaries
2 years ago
SignalRT
b67198c6ef
MacOS Intel Disable METAL
2 years ago
SignalRT
e64b9057d7
Merge branch 'RuntimeDetection' of https://github.com/SignalRT/LLamaSharp into RuntimeDetection
2 years ago
SignalRT
d1244332ed
MacOS Runtime detection and clasification
Create different paths to different MacOS platforms.
Dynamically load the right library
2 years ago
SignalRT
e1a89a8b0a
Added all binaries from this run: https://github.com/SciSharp/LLamaSharp/actions/runs/6762323560
Add the MacOS binary from the same run
2 years ago
Martin Evans
11d8c55db7
Added all binaries from this run: https://github.com/SciSharp/LLamaSharp/actions/runs/6762323560 ( 132d25b8a6)
2 years ago
SignalRT
46fb472d42
Align with llama.cpp b1488
2 years ago
Yaohui Liu
0e139d4ee2
fix: add arm binaries to cpu nuspec.
2 years ago
Yaohui Liu
7ee27d2f99
fix: binary not copied on MAC platform.
2 years ago
Martin Evans
db8f3980ea
New binaries from this commit: 207b51900e
Should fix the extreme speed loss.
2 years ago
Martin Evans
c7fdb9712c
Added binaries, built from ` 6961c4bd0b`
2 years ago
Martin Evans
b38e3f6fe2
binaries (avx512)
2 years ago
Rinne
231efe06f2
Update LLama/runtimes/build/LLamaSharp.Backend.Cpu.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Rinne
ecf852c4e2
Update LLama/runtimes/build/LLamaSharp.Backend.MacMetal.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Rinne
95669c2ea3
Update LLama/runtimes/build/LLamaSharp.Backend.Cuda12.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Rinne
5eaebd68ba
Update LLama/runtimes/build/LLamaSharp.Backend.Cuda11.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Rinne
6724b39713
Update LLama/runtimes/build/LLamaSharp.Backend.Cpu.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Yaohui Liu
b7a7dc00b6
ci: fix typos.
2 years ago
Yaohui Liu
252992ec6e
ci: fix icon and typos.
2 years ago
Yaohui Liu
53eedf1428
ci: fix error.
2 years ago
Yaohui Liu
f9a98c6e23
ci: add auto release workflow.
2 years ago
Martin Evans
efb0664df0
- Added new binaries
- Fixed stateless executor out-of-context handling
- Fixed token tests
2 years ago
Martin Evans
2a38808bca
- Added threads to context params, replaced all thread args with `uint?`
- Replaced all binaries
2 years ago
Martin Evans
bca55eace0
Initial changes to match the llama.cpp changes
2 years ago
SignalRT
096293a026
MacOS Remove Metal as is the current default
See on Mac OS enable Metal by default #2901
2 years ago
SignalRT
fb007e5921
Changes to compile in VS Mac + change model to llama2
This commit includes changes to compile en VS Mac + changest to use llama2 not codellama.
It includes MacOS binaries in memory and metal
2 years ago
Martin Evans
c9d08b943e
Added binaries for CUDA+Linux
2 years ago
Martin Evans
2022b82947
Added binaries generated by this action: https://github.com/SciSharp/LLamaSharp/actions/runs/6002797872/job/16279896150
Based on this version: 6b73ef1201
2 years ago
Martin Evans
2056078aef
Initial changes required for GGUF support
2 years ago
Yaohui Liu
5fe13bd9f7
fix: update the dlls.
2 years ago
Yaohui Liu
fc17e91d1a
feat: add backend for MACOS.
2 years ago
Yaohui Liu
9fcbd16b74
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev
2 years ago
Yaohui Liu
2968125daf
feat: update the llama backends.
2 years ago
SignalRT
348f2c7d72
Update llama.cpp binaries to 5f631c2 and align the context to that version
It solves the problem with netstandard2 (is it really netstandard2 a thing right now?)
Change context to solve problems.
5f631c2679
2 years ago