Martin Evans
3ce0f7d003
Using `StreamingTextDecoder` in `LLama/LLamaExecutorBase.cs`. This should fix weird text decoding issues with multi token characters.
2 years ago
Martin Evans
e9f5dbba89
Processing AVX512 branch on all dotnet versions
2 years ago
Martin Evans
e850115b5f
Added dotnet8.0 as a build target
2 years ago
Martin Evans
8a966171e1
Merge pull request #288 from saddam213/access
AntipromptProcessor access
2 years ago
sa_ddam213
153e61a81f
Make AntipromptProcessor public
2 years ago
Martin Evans
b44e780b0f
Merge pull request #281 from martindevans/NativeLibraryConfig_improvements
CPU Feature Detection 2
2 years ago
Rinne
972b0aaaab
Merge pull request #286 from SignalRT/FixWebExamples
Add targets in Web project
2 years ago
SignalRT
46ace3ddd7
Add targets in Web project
This allow to copy binaries and make the project work.
Update example model in appsettings
2 years ago
Martin Evans
e8f024a03a
Merge pull request #283 from SciSharp/dependabot/nuget/Microsoft.NET.Test.Sdk-17.8.0
build(deps): bump Microsoft.NET.Test.Sdk from 17.7.2 to 17.8.0
2 years ago
dependabot[bot]
f68aa777f1
build(deps): bump Microsoft.NET.Test.Sdk from 17.7.2 to 17.8.0
Bumps [Microsoft.NET.Test.Sdk](https://github.com/microsoft/vstest ) from 17.7.2 to 17.8.0.
- [Release notes](https://github.com/microsoft/vstest/releases )
- [Changelog](https://github.com/microsoft/vstest/blob/main/docs/releases.md )
- [Commits](https://github.com/microsoft/vstest/compare/v17.7.2...v17.8.0 )
---
updated-dependencies:
- dependency-name: Microsoft.NET.Test.Sdk
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2 years ago
Martin Evans
e3468d04f0
Merge pull request #277 from martindevans/feature/min_p
MinP Sampler
2 years ago
Martin Evans
a9d1f6cb47
- Renamed `NativeLibraryConfig.Default` to `NativeLibraryConfig.Instance`. It's not default any more as soon as you call `WithX`!
- using `Lazy<T>` to initialize it automatically.
- Added in `AVX512` support for all dotnet versions (but not autodetected).
- Added in AVX version auto detection.
2 years ago
Rinne
597d32963a
docs: update README.md
2 years ago
Rinne
17ec8905c6
Merge pull request #275 from AsakusaRinne/cuda_detection
feat: cuda feature detection.
2 years ago
Rinne
da6718c387
docs: adjust some descriptions.
2 years ago
Yaohui Liu
460f507898
ci: update ci workflows.
2 years ago
Yaohui Liu
502bb73b1e
fix typo.
2 years ago
Yaohui Liu
d7675f7936
Merge branch 'master' of github.com:AsakusaRinne/LLamaSharp into cuda_detection
2 years ago
Rinne
ed479d1739
Merge pull request #258 from SignalRT/RuntimeDetection
Runtime detection MacOS
2 years ago
Martin Evans
d743516070
- Added support for the MinP sampler
- Cleaned up comments in implementations of `IInferenceParams`
- Removed default values for all parameters in `LLamaContext.Sample` - they're never used and probably _shouldn't_ ever be used
2 years ago
SignalRT
0a2b0abb61
Correct improper rename
2 years ago
Yaohui Liu
4d2c5f1003
build: change nuget configuration for cuda detection.
2 years ago
Rinne
c2be0126de
Merge pull request #274 from kidkych/master
Update ToLLamaSharpChatHistory extension method to be public and support semantic-kernel author roles
2 years ago
Yaohui Liu
cb5fb210b1
feat: optimize apis for cuda feature detection.
2 years ago
SignalRT
97006a214f
Merge remote-tracking branch 'upstream/master' into RuntimeDetection
2 years ago
Yaohui Liu
bbbfbd20b5
fix: cannot load library under some conditions.
2 years ago
Martin Evans
c62e27e07c
Merge pull request #257 from martindevans/YaRN_scaling_parameters
Exposed YaRN scaling parameters in IContextParams
2 years ago
Martin Evans
31244ae691
Merge branch 'master' into YaRN_scaling_parameters
2 years ago
SignalRT
7691f83516
Test build and nuget packages
2 years ago
Yaohui Liu
d03e1dbe30
feat: support cuda feature detection.
2 years ago
SignalRT
fb95bbb4e0
Merge remote-tracking branch 'upstream/master' into RuntimeDetection
2 years ago
SignalRT
6de8d6219a
Change SemanticKernel version to beta1 on Examples
2 years ago
Chirag Karia
aa5e1ad541
Add ignoreCase parameter to ToLLamaSharpChatHistory extension method
2 years ago
Chirag Karia
1b4659dff9
Update ToLLamaSharpChatHistory extension method to be public and support semantic-kernel author roles
2 years ago
Rinne
bb03376594
Merge pull request #244 from AsakusaRinne/add_kernel_memory_pkg
build: add package for kernel-memory integration.
2 years ago
Rinne
14b5994c93
Merge branch 'master' into add_kernel_memory_pkg
2 years ago
SignalRT
5fe721bdbe
Revert "Merge branch 'pr/268' into RuntimeDetection"
This reverts commit 091b8d58b3502a99b3bfbec9db457c92cc736beb, reversing
changes made to 9b2ca9cf8e .
2 years ago
SignalRT
200011e186
Revert "Merge feat: add detection template for cuda and avx. #268"
This reverts commit b4b3ea9d99 .
2 years ago
Rinne
47e016743e
Merge pull request #266 from philippjbauer/master
Prevent duplication of user prompts / chat history in ChatSession.
2 years ago
SignalRT
b4b3ea9d99
Merge feat: add detection template for cuda and avx. #268
Just merge cuda and avx detection and change layout.
2 years ago
SignalRT
091b8d58b3
Merge branch 'pr/268' into RuntimeDetection
2 years ago
Yaohui Liu
b893c6f609
feat: add detection template for cuda and avx.
2 years ago
Philipp Bauer
d2b544afb8
Improved method return description
2 years ago
Philipp Bauer
6ea40d1546
Use full history only when the ChatSession runs the first time
2 years ago
Rinne
13233147f4
docs: fix typo in README.
2 years ago
Martin Evans
74a8ca5f83
Merge pull request #263 from martindevans/context_autodetect
Context Size Autodetect
2 years ago
SignalRT
9b2ca9cf8e
Merge branch 'RuntimeDetection' of https://github.com/SignalRT/LLamaSharp into RuntimeDetection
2 years ago
SignalRT
0edbd92530
Change nuget backend packages
Delete Backend.Metal because is not needed anymore.
Do not include .metal in x86_64 binaries
2 years ago
jlsantiago
0336f6fbfb
Backend.Metal is not needed any more
2 years ago
Martin Evans
db1bc741b0
Modified `ContextSize` in parameters to be nullable. A null value means autodetect from the model.
2 years ago