LLamaSharp

Commit Graph

Author	SHA1	Message	Date
Martin Evans	e81b3023d5	Rewritten sampling API to be accessed through the `LLamaTokenDataArray` object	2 years ago
Martin Evans	3c5547b2b7	Reduced some uses of `NativeApi` in `BatchedDecoding` by adding some helper methods	2 years ago
Martin Evans	b38e3f6fe2	binaries (avx512)	2 years ago
Martin Evans	a024d2242e	It works! had to update binary to `b1426`	2 years ago
Martin Evans	8cd81251b4	initial setup	2 years ago
Martin Evans	321d0b58c4	Merge pull request #202 from martindevans/multi_gpu Multi GPU	2 years ago
Martin Evans	c1ce547ebe	Merge pull request #222 from martindevans/ci_dotnet7.0_only CI dotnet 7.0	2 years ago
Martin Evans	4436ea4715	Modified CI to use dotnet 7.0 only, hopefully more stable!	2 years ago
Martin Evans	f6a472ae86	Setting the default seed to `0xFFFFFFFF` (no seed, randomised)	2 years ago
Rinne	bb5dedf5eb	docs: create CONTRIBUTING.md	2 years ago
Martin Evans	b72b253549	removed OOM killer step (not allowed on GitHub actions)	2 years ago
Martin Evans	a769ab3a40	Logging out events from the OOM killer	2 years ago
Martin Evans	d5874a279c	Updated test runner to latest version	2 years ago
Martin Evans	8b582a4cc8	Added `if: always()` to force logs to be written even if earlier steps fail	2 years ago
Martin Evans	b4e57f7966	Added extra diagnostics to test runner	2 years ago
Martin Evans	666455d144	Merge pull request #219 from martindevans/fix/broken_text_decoding Fixed Broken Text Decoding	2 years ago
Martin Evans	36c71abcfb	Fixed `LLama.StreamingTokenDecoderLLamaLLama.StreamingTokenDecoderLLamaLLama.StreamingTokenDecoderLLama` spam in all executors except Stateless.	2 years ago
Martin Evans	5b6408b072	Merge pull request #205 from martindevans/roundtrip_tokenization_investigation RoundTrip Tokenization Errors	2 years ago
Martin Evans	4a6319742d	Update README.md	2 years ago
Martin Evans	4e315423a1	Update README.md	2 years ago
Rinne	f0552dc813	Merge pull request #217 from AsakusaRinne/master docs: update the readme.	2 years ago
Yaohui Liu	4c80b40870	docs: update the readme.	2 years ago
Rinne	1299de3e5b	Merge pull request #216 from AsakusaRinne/auto_release_ci ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	4b86bc8d9d	ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	27b21cf136	ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	0f6408f60a	ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	c6c478f52b	ci: try to fix error of pushing package.	2 years ago
Rinne	f62afad1e8	Merge pull request #215 from AsakusaRinne/auto_release_ci ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	a5e66b31dc	ci: fix typo.	2 years ago
Yaohui Liu	20d8cb1e84	ci: try to fix error of pushing package.	2 years ago
Rinne	3fd1063a87	Merge pull request #214 from AsakusaRinne/auto_release_ci ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	e04c2c51ab	ci: try to fix error of pushing package.	2 years ago
Rinne	31f933ab7f	Merge pull request #213 from AsakusaRinne/auto_release_ci ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	99ecfd3e5b	ci: try to fix error of pushing package.	2 years ago
Rinne	d0e798b623	Merge pull request #212 from AsakusaRinne/auto_release_ci ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	0fbca6a38f	ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	74e16966fe	ci: try to fix error of pushing package.	2 years ago
Rinne	0906b4bf56	Merge pull request #210 from AsakusaRinne/auto_release_ci ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	7551b4a3be	ci: try to fix error of pushing package.	2 years ago
Rinne	32662a9be8	Merge pull request #209 from AsakusaRinne/auto_release_ci ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	792215fd99	ci: try to fix error of pushing package.	2 years ago
Martin Evans	a03fe003de	Fixed decoding of text "accumulating" over time (never properly clearing buffer)	2 years ago
Rinne	376e445760	Merge pull request #207 from AsakusaRinne/auto_release_ci ci: try to fix error of pushing package.	2 years ago
Yaohui Liu	b0af0cf4ea	ci: try to fix error of pushing package.	2 years ago
Rinne	335544ae49	Merge pull request #206 from AsakusaRinne/auto_release_ci ci: fix error of pushing package.	2 years ago
Yaohui Liu	114b3aa722	Merge branch 'auto_release_ci' of github.com:AsakusaRinne/LLamaSharp into auto_release_ci	2 years ago
Yaohui Liu	d0cb185b1d	ci: fix error of pushing package.	2 years ago
Rinne	37a306d0bc	Merge pull request #204 from AsakusaRinne/auto_release_ci	2 years ago
Martin Evans	51d4411a58	Added two new classes for detokenization tasks: - `AntipromptProcessor` accepts chunks of text and returns a value indicating if any antiprompt has been detected. - `StreamingTokenDecoder` decodes tokens into text, maintaining some internal state to handle single characters which are encoded as multiple tokens. Added tests for these classes and updated StatelessExecutor to use them. Removed most DeTokenize methods, marked the rest as obsolete (should always use a `StreamingTokenDecoder`).	2 years ago
Martin Evans	efdf3d630c	- Removed all `TokenToString` methods (it's never correct to use them, because sometimes one single character may be represented by multiple tokens). - Built a new (hacky) `Detokenize` method which handles this	2 years ago

1 2 3 4 5 ...

603 Commits (e81b3023d5e184983d20bd1ae72b26b3915bd0dc) All Branches Search

603 Commits (e81b3023d5e184983d20bd1ae72b26b3915bd0dc)

All Branches