Martin Evans
6be3f62321
Fixed loading of very large metadata values (over 1kb)
1 year ago
Martin Evans
f0d7468b22
Merge pull request #356 from xbotter/deps/sk-rc3
bump sk to 1.0.1 & km to 0.18
1 year ago
Martin Evans
bf6fc38b58
Merge pull request #377 from scotmcc/master
Updated & Fixed WebAPI
1 year ago
Martin Evans
9b1ff0ba4e
Merge pull request #380 from martindevans/LLamaWeights.Metadata_Property
Added `LLamaWeights.Metadata` property
1 year ago
xbotter
211ce12bf5
LLamaEmbedder exposes the Context
1 year ago
Martin Evans
fb606c2488
Fixed incorrect values
1 year ago
Martin Evans
47e4fcef2a
Fixed GetString on netstandard2
1 year ago
Martin Evans
2a1e1b6183
Removed unused imports
1 year ago
Martin Evans
a2bae178fa
Added a `Metadata` property to `LLamaWeights`
1 year ago
xbotter
40ac944fb5
Bump sk to 1.0.1
1 year ago
Scot McConnaughay
2abc2ecfca
Fixed WebAPI
Upgraded to .NET8.0
Fixed logging (removed Console replaced with Ilogger)
Fixed warnings (Null Strings, etc).
The application now returns data from the back-end chat services.
1 year ago
Rinne
4635185767
Merge pull request #378 from asmirnov82/fix_docs
Fix broken references in docs
1 year ago
Aleksei Smirnov
1c88bd5a74
fix broken references in docs (after commit "docs: update the docs to follow new version")
1 year ago
Martin Evans
7139281e4d
Merge pull request #373 from martindevans/enhanced_avx512
Improved support for AVX512
1 year ago
Martin Evans
a0232a8534
Merge pull request #372 from martindevans/custom_pipeline_stateless_reset
Reset Custom Sampling Pipeline
1 year ago
Martin Evans
1b13f7c717
Improved support for AVX512:
- Enabled more features in build process (VBMI and VNNI)
- Added runtime checking for this features
- Improved runtime checking to no longer require dotnet8.0
1 year ago
Martin Evans
82d84afaea
Resetting the custom sampling pipeline in the stateless executor
1 year ago
Martin Evans
c298ab828a
Merge pull request #368 from martindevans/context_set_seed
Context Set Seed
1 year ago
Martin Evans
dc8e5d88f7
Update LLama/LLamaContext.cs
1 year ago
Martin Evans
a3177ab140
Merge pull request #369 from martindevans/rename_llama_sample_temperature
Renamed `llama_sample_temperature` to `llama_sample_temp`
1 year ago
Martin Evans
cbc4c8d9af
Merge pull request #370 from martindevans/copy_grammar
Clone Grammar
1 year ago
Martin Evans
db7ecf5a43
Added a method to create a clone of a grammar instance
1 year ago
Martin Evans
ea523d2e2a
Renamed `llama_sample_temperature` to `llama_sample_temp`, Mirroring the same change made in llama.cpp
1 year ago
Martin Evans
2df3e7617e
Added a method to set the RNG seed on the context
1 year ago
Martin Evans
8494fd5769
Merge pull request #367 from martindevans/fix_quantisation_pure_field
Added missing field to LLamaModelQuantizeParams
1 year ago
Martin Evans
cedef5e45a
Added the `pure` field to `LLamaModelQuantizeParams` (it's been added to llama.cpp)
1 year ago
Martin Evans
6650e683f4
Merge pull request #361 from martindevans/update_binaries_dec_2023
Updated Binaries December 2023
1 year ago
Martin Evans
199b4418c3
Fixed JSON serialization for ModelParams
1 year ago
Martin Evans
6128c18824
Merge pull request #366 from asmirnov82/fix_code_in_readme
Fix documentation to reflect changes in ChatSession API
1 year ago
Aleksei Smirnov
8558d109b4
Fix documentation according to the changes in newer versions
1 year ago
Martin Evans
2f0deeadcd
Implemented serialization for `MetadataOverride`. Deserialization is broken (converter is never called)
1 year ago
Martin Evans
b868b056f7
Added metadata overrides to `IModelParams`
1 year ago
xbotter
8766fb1b03
Merge branch 'deps/sk-rc3' of https://github.com/xbotter/LLamaSharp into deps/sk-rc3
1 year ago
xbotter
213b4be723
bump sk-1.0.0-rc4
1 year ago
xbotter
ce20b30e06
Merge branch 'SciSharp:master' into deps/sk-rc3
1 year ago
Martin Evans
b22d8b7495
- Added `GroupDisposable` to dispose a collection of items all together
- Renamed `LLamaModelKvOverride` to `LLamaModelMetadataOverride`
1 year ago
Martin Evans
5ad2cd1d3c
Added a comment on the type itself
1 year ago
Martin Evans
b0270b5788
Added comments on GGMLType
1 year ago
Martin Evans
b3e576608b
fixed safe handle
1 year ago
Martin Evans
bab6b65b61
Added a safe handle for LLamaKvCacheView
1 year ago
Martin Evans
439d14a061
Updated binaries:
- build run: https://github.com/SciSharp/LLamaSharp/actions/runs/7196891440
- commit: 9fb13f9584
1 year ago
Martin Evans
9813a30193
Merge pull request #358 from xbotter/unittest-net8
Upgrade unittest target framework to .NET 8.0
1 year ago
xbotter
340bbbcf48
Move JSON converter for TensorSplitsCollection
1 year ago
Martin Evans
728f7077d8
Merge pull request #360 from martindevans/macos_avx
Added AVX and AVX2 to MacOS x86_64 builds
1 year ago
Martin Evans
0b8422ea7f
Added AVX and AVX2 to MacOS x86_64 builds
1 year ago
Martin Evans
01c7f1b4da
Update LLama/Common/ModelParams.cs
1 year ago
Martin Evans
e6148c952e
Fixed encoding of `Encoding`
1 year ago
xbotter
df66d7e0c6
Upgrade unittest target framework to .net8
1 year ago
Martin Evans
d87d654a34
Merge pull request #348 from martindevans/new_object_based_sampling_pipeline
Custom Sampling Pipelines
1 year ago
Martin Evans
50c1b2d52d
Merge pull request #344 from philippjbauer/master
Rebuilt ChatSession class
1 year ago