Yaohui Liu
0fbca6a38f
ci: try to fix error of pushing package.
2 years ago
Yaohui Liu
74e16966fe
ci: try to fix error of pushing package.
2 years ago
Rinne
0906b4bf56
Merge pull request #210 from AsakusaRinne/auto_release_ci
ci: try to fix error of pushing package.
2 years ago
Yaohui Liu
7551b4a3be
ci: try to fix error of pushing package.
2 years ago
Rinne
32662a9be8
Merge pull request #209 from AsakusaRinne/auto_release_ci
ci: try to fix error of pushing package.
2 years ago
Yaohui Liu
792215fd99
ci: try to fix error of pushing package.
2 years ago
Martin Evans
a03fe003de
Fixed decoding of text "accumulating" over time (never properly clearing buffer)
2 years ago
Rinne
376e445760
Merge pull request #207 from AsakusaRinne/auto_release_ci
ci: try to fix error of pushing package.
2 years ago
Yaohui Liu
b0af0cf4ea
ci: try to fix error of pushing package.
2 years ago
Rinne
335544ae49
Merge pull request #206 from AsakusaRinne/auto_release_ci
ci: fix error of pushing package.
2 years ago
Yaohui Liu
114b3aa722
Merge branch 'auto_release_ci' of github.com:AsakusaRinne/LLamaSharp into auto_release_ci
2 years ago
Yaohui Liu
d0cb185b1d
ci: fix error of pushing package.
2 years ago
Rinne
37a306d0bc
Merge pull request #204 from AsakusaRinne/auto_release_ci
2 years ago
Martin Evans
51d4411a58
Added two new classes for detokenization tasks:
- `AntipromptProcessor` accepts chunks of text and returns a value indicating if any antiprompt has been detected.
- `StreamingTokenDecoder` decodes tokens into text, maintaining some internal state to handle single characters which are encoded as multiple tokens.
Added tests for these classes and updated StatelessExecutor to use them.
Removed most DeTokenize methods, marked the rest as obsolete (should always use a `StreamingTokenDecoder`).
2 years ago
Martin Evans
efdf3d630c
- Removed all `TokenToString` methods (it's never correct to use them, because sometimes one single character may be represented by multiple tokens).
- Built a new (hacky) `Detokenize` method which handles this
2 years ago
Rinne
231efe06f2
Update LLama/runtimes/build/LLamaSharp.Backend.Cpu.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Rinne
ecf852c4e2
Update LLama/runtimes/build/LLamaSharp.Backend.MacMetal.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Rinne
95669c2ea3
Update LLama/runtimes/build/LLamaSharp.Backend.Cuda12.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Rinne
5eaebd68ba
Update LLama/runtimes/build/LLamaSharp.Backend.Cuda11.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Rinne
6724b39713
Update LLama/runtimes/build/LLamaSharp.Backend.Cpu.nuspec
Co-authored-by: Martin Evans <martindevans@gmail.com>
2 years ago
Martin Evans
1d0620e634
Created a test that "roundtrips" strings through tokenization. This reveals some flaws with certain characters
2 years ago
Yaohui Liu
7855e07509
fix: typo in prepare_release.sh.
2 years ago
Rinne
0215ecfd20
Merge pull request #201 from xbotter/sk-examples
chore: Update LLama.Examples and LLama.SemanticKernel
2 years ago
Yaohui Liu
b7a7dc00b6
ci: fix typos.
2 years ago
Yaohui Liu
252992ec6e
ci: fix icon and typos.
2 years ago
Yaohui Liu
ae1fe1f995
ci: fix error.
2 years ago
Yaohui Liu
b48867839a
ci: fix error.
2 years ago
Yaohui Liu
1b86f9ed70
ci: fix error.
2 years ago
Yaohui Liu
96d6edd794
ci: fix error.
2 years ago
Yaohui Liu
5161c92cec
ci: fix error.
2 years ago
Yaohui Liu
6e10d45774
ci: fix error.
2 years ago
Yaohui Liu
94253f6051
ci: fix error.
2 years ago
Yaohui Liu
5c36138b1a
ci: fix error.
2 years ago
Yaohui Liu
f62e1dde96
ci: fix error.
2 years ago
Yaohui Liu
811a796306
ci: fix error.
2 years ago
Yaohui Liu
53eedf1428
ci: fix error.
2 years ago
Yaohui Liu
cc0f57779d
ci: fix error.
2 years ago
Yaohui Liu
8f1a1aeb3a
ci: fix error.
2 years ago
Yaohui Liu
394c249193
ci: fix error.
2 years ago
Yaohui Liu
f2ec02737e
ci: add semantic-kernel packing.
2 years ago
Yaohui Liu
f9a98c6e23
ci: add auto release workflow.
2 years ago
Martin Evans
f621ec67e8
Fixed serialization
2 years ago
Martin Evans
768747c652
spelling
2 years ago
Martin Evans
b4e7f64e76
Added System.Text.Json serialization for `TensorSplitsCollectionConverter`
2 years ago
Martin Evans
281e58f059
Fixed default value
2 years ago
Martin Evans
04acbf8c42
Improved doc comment on `tensor_split`
2 years ago
Martin Evans
6a4cd506bd
Added a safe `TensorSplitsCollection` to the params which prevents incorrectly setting the `tensor_splits` collection
2 years ago
Martin Evans
15db194c17
Added multi GPU support
2 years ago
xbotter
ab83016fb4
chore: update semantic kernel examples
2 years ago
Martin Evans
3770a25bdc
Merge pull request #198 from martindevans/more_logging
More Logging
2 years ago