Martin Evans
66986f1e49
Merge pull request #246 from martindevans/codeql_pointer_arithmetic
CodeQL Pointer Arithmetic
2 years ago
Martin Evans
a03fdc4818
Using a reference to an array instead of pointer arithmetic. This means it will benefit from bounds checking on the array.
2 years ago
Martin Evans
08c29d52c5
Slightly refactored `SafeLLamaGrammarHandle.Create` to solve CodeQL warning about pointer arithmetic.
2 years ago
Martin Evans
32deb56027
Moved common defines into one single env var
2 years ago
Martin Evans
f850380718
- Explicitly added `-DLLAMA_NATIVE=OFF` (i.e. disabling `march=native`)
- Added `COMMON_DEFINE` env var which will contain all common defines for all platforms (experimental)
2 years ago
Yaohui Liu
6a7e74e71b
build: add package for kernel-memory integration.
2 years ago
Rinne
c933a71b82
Merge pull request #226 from xbotter/kernel-memory
feat: adapts to SK Kernel Memory.
2 years ago
Rinne
98147d0906
Merge pull request #243 from AsakusaRinne/fix_binary_pkg
docs: add example models for v0.7.0.
2 years ago
Yaohui Liu
0d77b5d269
docs: add some example models for v0.7.0.
2 years ago
Rinne
21507c0aad
Merge pull request #240 from AsakusaRinne/fix_binary_pkg
docs: add related repos.
2 years ago
Yaohui Liu
d04bdd5c1a
docs: add related repos.
2 years ago
Rinne
1cca6329e6
Merge pull request #238 from AsakusaRinne/fix_binary_pkg
fix: binary not copied on MAC platform.
2 years ago
Rinne
1712664424
build: add codeql workflow
2 years ago
Yaohui Liu
f180811f87
docs: update readme.
2 years ago
Yaohui Liu
73e68f3abd
docs: update readme.
2 years ago
Yaohui Liu
0e139d4ee2
fix: add arm binaries to cpu nuspec.
2 years ago
Yaohui Liu
7ee27d2f99
fix: binary not copied on MAC platform.
2 years ago
dependabot[bot]
c9858e8739
build(deps): bump Swashbuckle.AspNetCore from 6.2.3 to 6.5.0
Bumps [Swashbuckle.AspNetCore](https://github.com/domaindrivendev/Swashbuckle.AspNetCore ) from 6.2.3 to 6.5.0.
- [Release notes](https://github.com/domaindrivendev/Swashbuckle.AspNetCore/releases )
- [Commits](https://github.com/domaindrivendev/Swashbuckle.AspNetCore/compare/v6.2.3...v6.5.0 )
---
updated-dependencies:
- dependency-name: Swashbuckle.AspNetCore
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2 years ago
dependabot[bot]
b20c3ecda5
build(deps): bump xunit from 2.5.0 to 2.6.1
Bumps [xunit](https://github.com/xunit/xunit ) from 2.5.0 to 2.6.1.
- [Commits](https://github.com/xunit/xunit/compare/2.5.0...2.6.1 )
---
updated-dependencies:
- dependency-name: xunit
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2 years ago
dependabot[bot]
25d6b3ce50
build(deps): bump Microsoft.SemanticKernel
Bumps [Microsoft.SemanticKernel](https://github.com/microsoft/semantic-kernel ) from 1.0.0-beta1 to 1.0.0-beta4.
- [Release notes](https://github.com/microsoft/semantic-kernel/releases )
- [Commits](https://github.com/microsoft/semantic-kernel/compare/dotnet-1.0.0-beta1...dotnet-1.0.0-beta4 )
---
updated-dependencies:
- dependency-name: Microsoft.SemanticKernel
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2 years ago
Rinne
112e33eee8
build: add the dependabot.
2 years ago
xbotter
c52e99ac77
update example
2 years ago
xbotter
f60c1f1134
Merge branch 'kernel-memory' of https://github.com/xbotter/LLamaSharp into kernel-memory
2 years ago
xbotter
61f47f16c8
use StatelessExecutor
2 years ago
xbotter
d0a407efbe
Merge branch 'SciSharp:master' into kernel-memory
2 years ago
Rinne
16d5d5514f
docs: update README.md.
2 years ago
xbotter
8c425b9e57
Merge branch 'master' into kernel-memory
2 years ago
Martin Evans
5a9e13c689
Merge pull request #223 from martindevans/batch_decoding
New Binaries, Improved Sampling API, Batch Decoding Prototype
2 years ago
xbotter
2af686f39c
Merge branch 'SciSharp:master' into kernel-memory
2 years ago
Martin Evans
db8f3980ea
New binaries from this commit: 207b51900e
Should fix the extreme speed loss.
2 years ago
Martin Evans
f8b2c5de3d
Merge pull request #227 from martindevans/fixed_build_process
Fixed GitHub Build Process
2 years ago
Martin Evans
0255aa2c6e
Disabled march=native in github builds!
2 years ago
Martin Evans
b6d242193e
Debugging slowdown by removing some things:
- Removed all `record struct` uses in native code
- Removed usage of `readonly` in native structs
Minor fix:
- Added sequential layout to `LLamaModelQuantizeParams`
2 years ago
xbotter
a3a6dc3a1b
fix comments
2 years ago
xbotter
e36a118360
fix name
2 years ago
xbotter
3de9d34093
update package to KernelMemory
2 years ago
xbotter
a49438e6e6
🔧 Add Semantic Memory SDK to LLama.Examples
Added a project reference to LLama.KernelMemory in the LLama.Examples.csproj file.
🔧 Add KernelMemory class and update TestRunner
Added a new class KernelMemory to the LLama.Examples.NewVersion namespace, which includes a Run method that demonstrates the usage of Semantic Kernel Memory. The class imports a sample PDF document and asks a question to the memory, displaying the answer and relevant sources.
Updated the TestRunner class in the same namespace to include an option (choice 15) to run the KernelMemory example.
🔧 Fix typo in LLamaSharpTextEmbeddingGeneration class
Fixed a typo in the LLamaSharpTextEmbeddingGeneration class where the LlamaSharpConfig variable was incorrectly named as LlamaSharpConfig.
Added XML documentation for the LLamaSharpTextEmbeddingGeneration constructor, Dispose method, and GenerateEmbeddingsAsync method.
Summary:
- Added project reference to LLama.KernelMemory and LLama.SemanticKernel in LLama.Examples.csproj
- Added KernelMemory class to demonstrate Semantic Kernel Memory usage
- Updated TestRunner class to include option for running KernelMemory example
- Fixed typo in LLamaSharpTextEmbeddingGeneration class
- Added XML documentation for constructor, Dispose method, and GenerateEmbeddingsAsync method in LLamaSharpTextEmbeddingGeneration class
2 years ago
xbotter
26cded73c6
📝 Add LLamaSharp.KernelMemory project
Add the LLamaSharp.KernelMemory project to the solution. This project includes classes for text embedding generation and text generation using the LLamaSharp library.
2 years ago
Martin Evans
529b06b35b
- Fixed rope frequency/base to use the values in the model by default, instead of always overriding them by default!
2 years ago
Martin Evans
dcc82e582e
Fixed `Eval` on platforms < dotnet 5
2 years ago
Martin Evans
09bc688b3c
Skipped slow test again
2 years ago
Martin Evans
51c292ebd8
Added a safe method for `llama_get_logits_ith`
2 years ago
Martin Evans
cdf20d3c7a
Added timing to stateless test
2 years ago
Martin Evans
7e3cde4c13
Moved helper methods into `LLamaBatchSafeHandle`
2 years ago
Martin Evans
ccb8afae46
Cleaned up stateless executor as preparation for changing it to use the new batched decoding system.
2 years ago
Martin Evans
c786fb0ec8
Using `IReadOnlyList` instead of `IEnumerable` in `IInferenceParams`
2 years ago
Martin Evans
aae63a5b92
Minor cleanup on the BatchedDecoding example
2 years ago
Martin Evans
c7fdb9712c
Added binaries, built from ` 6961c4bd0b`
2 years ago
Martin Evans
f41d26fe32
Removed hardcoded model path
2 years ago
Martin Evans
e81b3023d5
Rewritten sampling API to be accessed through the `LLamaTokenDataArray` object
2 years ago