xbotter
007f501cd5
🔧 Update LlamaSharpConfig and LlamaSharpTextGeneration
- Add DefaultInferenceParams property to LlamaSharpConfig
- Update GenerateTextAsync method in LlamaSharpTextGeneration to use DefaultInferenceParams if available
- Update OptionsToParams method in LlamaSharpTextGeneration to handle defaultParams
2 years ago
xbotter
1056e13414
fix examples
2 years ago
xbotter
15db931a66
bump semantic kernel 1.0.0-beta8
2 years ago
Rinne
8b6105faa0
docs: update README.md
2 years ago
Martin Evans
c517cc18a2
Merge pull request #304 from martindevans/obsolete_attribute_eval
Added Obsolete markings to all `Eval` overloads
2 years ago
Martin Evans
16ab33ba3c
Added Obsolete markings to all `Eval` overloads
2 years ago
Martin Evans
18b3a5595a
Merge pull request #303 from martindevans/expose_progress_callback
progress_callback in `LLamaModelParams`
2 years ago
Martin Evans
0e51badb38
Exposed `progress_callback` in `LLamaModelParams` (although not in higher level)
2 years ago
Martin Evans
9905baa7c4
Merge pull request #300 from martindevans/minor_demos_cleanup
Minor cleanup on example code
2 years ago
Martin Evans
4359752d94
Merge pull request #297 from martindevans/ubuntu-20.04
Ubuntu 20.04 Compile
2 years ago
Martin Evans
1970023ef4
Merge pull request #292 from martindevans/dotnet8.0
dotnet8.0
2 years ago
Martin Evans
1dd4c6ab7a
Merge pull request #296 from xbotter/deps/sk_1.0.0-beta6
bump semantic kernel to 1.0.0-beta-6
2 years ago
Martin Evans
479779e908
Some minor cleanup on example code:
- Removed special case for exit
- Added a wait at the end of batched decoding
2 years ago
Philipp Bauer
75932afc62
Remove debug output
2 years ago
Philipp Bauer
629430a087
Correctly format followup messages in turn-based (chat) inference
2 years ago
Martin Evans
9121670b83
Removed codeQL (broken under dotnet8.0 at the moment)
2 years ago
Martin Evans
dc8c2309b6
Fixed conditionals
2 years ago
Martin Evans
b52422a028
Moved compile job to run on `ubuntu-20.04`, hopefully picking up an older version of glibc with broader support.
2 years ago
Martin Evans
0bfc1cbecb
Merge pull request #295 from xbotter/patch/examples
Update examples
2 years ago
Rinne
36c2e64b36
Merge pull request #293 from martindevans/fixed_base_executor
StreamingTextDecoder in LLamaExecutorBase
2 years ago
xbotter
6c31f69720
bump semantic kernel to 1.0.0-beta-6
2 years ago
xbotter
521e36903c
🔀 Remove unused code and update examples
- Renamed files and updated namespaces in Examples folder.
- Moved files from NewVersion folder to Examples folder.
- Removed TestRunner.cs file.
- Updated Runner.cs to include new examples.
- Update Program.cs to use the new Runner class instead of NewVersionTestRunner
- Update LLama.Examples namespace in Program.cs
- Update await NewVersionTestRunner.Run() in Program.cs to await Runner.Run()
2 years ago
Martin Evans
ecc614de7e
Merge pull request #294 from martindevans/fixed_revert_error
Fixed Revert Error
2 years ago
Martin Evans
fe03e6ad35
Added 8.0 to version installation
2 years ago
Martin Evans
89fef05362
This commit ( 5fe721bdbe) accidentally removed a load of stuff that it shouldn't. Fixed that.
Originally from these PRs:
- https://github.com/SciSharp/LLamaSharp/pull/263
- https://github.com/SciSharp/LLamaSharp/pull/259
2 years ago
Martin Evans
3ce0f7d003
Using `StreamingTextDecoder` in `LLama/LLamaExecutorBase.cs`. This should fix weird text decoding issues with multi token characters.
2 years ago
Martin Evans
e9f5dbba89
Processing AVX512 branch on all dotnet versions
2 years ago
Martin Evans
e850115b5f
Added dotnet8.0 as a build target
2 years ago
Martin Evans
8a966171e1
Merge pull request #288 from saddam213/access
AntipromptProcessor access
2 years ago
sa_ddam213
153e61a81f
Make AntipromptProcessor public
2 years ago
Martin Evans
b44e780b0f
Merge pull request #281 from martindevans/NativeLibraryConfig_improvements
CPU Feature Detection 2
2 years ago
Rinne
972b0aaaab
Merge pull request #286 from SignalRT/FixWebExamples
Add targets in Web project
2 years ago
SignalRT
46ace3ddd7
Add targets in Web project
This allow to copy binaries and make the project work.
Update example model in appsettings
2 years ago
Martin Evans
e8f024a03a
Merge pull request #283 from SciSharp/dependabot/nuget/Microsoft.NET.Test.Sdk-17.8.0
build(deps): bump Microsoft.NET.Test.Sdk from 17.7.2 to 17.8.0
2 years ago
dependabot[bot]
f68aa777f1
build(deps): bump Microsoft.NET.Test.Sdk from 17.7.2 to 17.8.0
Bumps [Microsoft.NET.Test.Sdk](https://github.com/microsoft/vstest ) from 17.7.2 to 17.8.0.
- [Release notes](https://github.com/microsoft/vstest/releases )
- [Changelog](https://github.com/microsoft/vstest/blob/main/docs/releases.md )
- [Commits](https://github.com/microsoft/vstest/compare/v17.7.2...v17.8.0 )
---
updated-dependencies:
- dependency-name: Microsoft.NET.Test.Sdk
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2 years ago
Martin Evans
e3468d04f0
Merge pull request #277 from martindevans/feature/min_p
MinP Sampler
2 years ago
Martin Evans
a9d1f6cb47
- Renamed `NativeLibraryConfig.Default` to `NativeLibraryConfig.Instance`. It's not default any more as soon as you call `WithX`!
- using `Lazy<T>` to initialize it automatically.
- Added in `AVX512` support for all dotnet versions (but not autodetected).
- Added in AVX version auto detection.
2 years ago
Rinne
597d32963a
docs: update README.md
2 years ago
Rinne
17ec8905c6
Merge pull request #275 from AsakusaRinne/cuda_detection
feat: cuda feature detection.
2 years ago
Rinne
da6718c387
docs: adjust some descriptions.
2 years ago
Yaohui Liu
460f507898
ci: update ci workflows.
2 years ago
Yaohui Liu
502bb73b1e
fix typo.
2 years ago
Yaohui Liu
d7675f7936
Merge branch 'master' of github.com:AsakusaRinne/LLamaSharp into cuda_detection
2 years ago
Rinne
ed479d1739
Merge pull request #258 from SignalRT/RuntimeDetection
Runtime detection MacOS
2 years ago
Martin Evans
d743516070
- Added support for the MinP sampler
- Cleaned up comments in implementations of `IInferenceParams`
- Removed default values for all parameters in `LLamaContext.Sample` - they're never used and probably _shouldn't_ ever be used
2 years ago
SignalRT
0a2b0abb61
Correct improper rename
2 years ago
Yaohui Liu
4d2c5f1003
build: change nuget configuration for cuda detection.
2 years ago
Rinne
c2be0126de
Merge pull request #274 from kidkych/master
Update ToLLamaSharpChatHistory extension method to be public and support semantic-kernel author roles
2 years ago
Yaohui Liu
cb5fb210b1
feat: optimize apis for cuda feature detection.
2 years ago
SignalRT
97006a214f
Merge remote-tracking branch 'upstream/master' into RuntimeDetection
2 years ago