Martin Evans
8416cb866a
Improved exceptions in IModelParams for unknown KV override types.
1 year ago
Martin Evans
b68bc3548d
Fixed example code in readme
1 year ago
Martin Evans
d74e6c75d5
Merge pull request #413 from SciSharp/martindevans-patch-1
Update README.md
1 year ago
Martin Evans
368410ed41
Update README.md
1 year ago
Martin Evans
91157fe4da
Merge pull request #412 from martindevans/Release_0.9.1
Release 0.9.1 (hotfix)
1 year ago
Martin Evans
02f6c064fb
Added the final nuget push back into the workflows
1 year ago
Martin Evans
d457cc3c1e
Merge pull request #411 from martindevans/test_pr2
Test Release PR 2
1 year ago
Martin Evans
5a4e6d8e07
Fixed copy path for binaries
1 year ago
Martin Evans
cdb98f2874
Merge pull request #410 from martindevans/test_pr
Test PR
1 year ago
Martin Evans
4d1e73b6d1
Test PR with unimportant change to test the fixed auto-release pipeline
1 year ago
Martin Evans
308aec363a
Merge pull request #409 from martindevans/fixed_prepare_release
Fixed prepare_release script
1 year ago
Martin Evans
fef9c9f3f2
Temporarily disabled nuget push, for testing
1 year ago
Martin Evans
2166c2dbcf
Formatting of error return
1 year ago
Martin Evans
072873a8a1
Added -e flag, to terminate prepare_release script if there are any errors
1 year ago
Martin Evans
c38bc0a342
Fixed prepare_release.sh script so it can properly copy all of the binary deps
1 year ago
Martin Evans
4952d55216
Merge pull request #398 from martindevans/0.9.0_readme_update
Updated readme for 0.9.0 release
1 year ago
Martin Evans
b3b54e662a
Merge pull request #408 from asmirnov82/fix_semantic_kernel_readme
Fix typos in SemanticKernel README file
1 year ago
Aleksei Smirnov
cc892a5eed
Fix typos in SemanticKernel README file
1 year ago
Martin Evans
1e81b0b91c
Update README.md
Fixed readme: Max -> Mac
1 year ago
Martin Evans
82727c4414
Removed collection expressions from test
1 year ago
Martin Evans
2eb52b1630
made casts to/from int explicit, fixed places affected
1 year ago
Martin Evans
42be9b136d
Switched form using raw integers, to a `LLamaToken` struct
1 year ago
Martin Evans
3abcaa51b5
Merge pull request #403 from martindevans/extra_models_params_checking
Extra ModelParams Checking
1 year ago
Martin Evans
48ef3bb080
Added runtime checks that UseMemoryLock and UseMemorymap are actually supported.
1 year ago
Martin Evans
9b9bcc0dbc
Merge pull request #402 from martindevans/safer_model_handle_creation
Safer Model Handle Creation
1 year ago
Martin Evans
4e5e994dda
- directly returning a SafeLlamaModelHandle, instead of an IntPtr which is wrapped in a handle.
- made `llama_backend_init` private. This is automatically called, there is no way it can correctly be used externally.
- made `llama_token_to_piece` safe (Span instead of pointer)
1 year ago
Martin Evans
a1a8461802
Merge pull request #401 from martindevans/remove_some_unsafe
Removed some unnecessary uses of `unsafe`
1 year ago
Martin Evans
bac3e43498
Fixed handling of empty spans
1 year ago
Martin Evans
3925545147
Fixed LLamaExecutorBase.cs
1 year ago
Martin Evans
c002642268
- Removed some `unsafe` where it wasn't necessary
- Wrapped some native functions which take (pointer, length) in function which take a `span` instead.
1 year ago
Martin Evans
5c876cbbfe
Merge pull request #400 from martindevans/resharper_code_suggestions_cleanup_nativeapi
Code cleanup driven by R# suggestions
1 year ago
Martin Evans
f860f88c36
Code cleanup driven by R# suggestions:
- Made `NativeApi` into a `static class` (it's not intended to be instantiated)
- Moved `LLamaTokenType` enum out into a separate file
- Made `LLamaSeqId` and `LLamaPos` into `record struct`, convenient to have equality etc
1 year ago
Martin Evans
a408335c44
Fixed broken build on master (just removing a namespace that no longer exists)
1 year ago
Haiping
feebd627f4
Merge pull request #396 from SciSharp/dependabot/nuget/Microsoft.KernelMemory.Core-and-Microsoft.KernelMemory.Abstractions-0.24.231228.5
build(deps): bump Microsoft.KernelMemory.Core and Microsoft.KernelMemory.Abstractions
1 year ago
Haiping
a6e80c317c
Merge pull request #397 from SciSharp/dependabot/nuget/Microsoft.KernelMemory.Abstractions-0.24.231228.5
build(deps): bump Microsoft.KernelMemory.Abstractions from 0.18.231209.1-preview to 0.24.231228.5
1 year ago
Martin Evans
3b766089da
Updated readme for 0.9.0 release
1 year ago
dependabot[bot]
89a43d8a12
build(deps): bump Microsoft.KernelMemory.Abstractions
Bumps [Microsoft.KernelMemory.Abstractions](https://github.com/microsoft/kernel-memory ) from 0.18.231209.1-preview to 0.24.231228.5.
- [Release notes](https://github.com/microsoft/kernel-memory/releases )
- [Commits](https://github.com/microsoft/kernel-memory/compare/dotnet-0.18.231209.1-preview...0.24.231228.5 )
---
updated-dependencies:
- dependency-name: Microsoft.KernelMemory.Abstractions
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
dependabot[bot]
f02b0500b5
build(deps): bump Microsoft.KernelMemory.Core and Microsoft.KernelMemory.Abstractions
Bumps [Microsoft.KernelMemory.Core](https://github.com/microsoft/kernel-memory ) and [Microsoft.KernelMemory.Abstractions](https://github.com/microsoft/kernel-memory ). These dependencies needed to be updated together.
Updates `Microsoft.KernelMemory.Core` from 0.18.231209.1-preview to 0.24.231228.5
- [Release notes](https://github.com/microsoft/kernel-memory/releases )
- [Commits](https://github.com/microsoft/kernel-memory/compare/dotnet-0.18.231209.1-preview...0.24.231228.5 )
Updates `Microsoft.KernelMemory.Abstractions` from 0.18.231209.1-preview to 0.24.231228.5
- [Release notes](https://github.com/microsoft/kernel-memory/releases )
- [Commits](https://github.com/microsoft/kernel-memory/compare/dotnet-0.18.231209.1-preview...0.24.231228.5 )
---
updated-dependencies:
- dependency-name: Microsoft.KernelMemory.Core
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: Microsoft.KernelMemory.Abstractions
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Martin Evans
39bc26882f
Merge pull request #388 from SciSharp/dependabot/nuget/Swashbuckle.AspNetCore-6.5.0
build(deps): bump Swashbuckle.AspNetCore from 6.4.0 to 6.5.0
1 year ago
Martin Evans
d64c70e58e
Merge pull request #391 from SciSharp/dependabot/nuget/xunit.runner.visualstudio-2.5.6
build(deps): bump xunit.runner.visualstudio from 2.5.5 to 2.5.6
1 year ago
dependabot[bot]
57fdac493a
build(deps): bump xunit.runner.visualstudio from 2.5.5 to 2.5.6
Bumps [xunit.runner.visualstudio](https://github.com/xunit/visualstudio.xunit ) from 2.5.5 to 2.5.6.
- [Release notes](https://github.com/xunit/visualstudio.xunit/releases )
- [Commits](https://github.com/xunit/visualstudio.xunit/compare/2.5.5...2.5.6 )
---
updated-dependencies:
- dependency-name: xunit.runner.visualstudio
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Martin Evans
a96f8da77b
Merge pull request #389 from SciSharp/dependabot/nuget/xunit-2.6.4
build(deps): bump xunit from 2.6.3 to 2.6.4
1 year ago
dependabot[bot]
58e5a84d54
build(deps): bump xunit from 2.6.3 to 2.6.4
Bumps [xunit](https://github.com/xunit/xunit ) from 2.6.3 to 2.6.4.
- [Commits](https://github.com/xunit/xunit/compare/2.6.3...2.6.4 )
---
updated-dependencies:
- dependency-name: xunit
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
dependabot[bot]
492981718d
build(deps): bump Swashbuckle.AspNetCore from 6.4.0 to 6.5.0
Bumps [Swashbuckle.AspNetCore](https://github.com/domaindrivendev/Swashbuckle.AspNetCore ) from 6.4.0 to 6.5.0.
- [Release notes](https://github.com/domaindrivendev/Swashbuckle.AspNetCore/releases )
- [Commits](https://github.com/domaindrivendev/Swashbuckle.AspNetCore/compare/v6.4.0...v6.5.0 )
---
updated-dependencies:
- dependency-name: Swashbuckle.AspNetCore
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Martin Evans
95b9e4d2c7
Merge pull request #385 from martindevans/partial_fix_metadata_override
Metadata Fixes
1 year ago
Martin Evans
889d99bfe2
Merge pull request #386 from edgett/patch-1
Update compile.yml to fix not building for windows
1 year ago
edgett
b6dec83ca9
Update compile.yml to fix not building for windows
This fixes the build step: Compile (Windows) (avx512, -DLLAMA_AVX512=ON -LLAMA_AVX512_VBMI=ON -DLLAMA_AVX512_VNNI=ON)
There is a typo in the cmake command: `cmake .. -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_TESTS=OFF -DLLAMA_BUILD_EXAMPLES=OFF -DLLAMA_BUILD_SERVER=OFF -DBUILD_SHARED_LIBS=ON -DLLAMA_AVX512=ON -LLAMA_AVX512_VBMI=ON -DLLAMA_AVX512_VNNI=ON
cmake --build . --config Release -j ${env:NUMBER_OF_PROCESSORS}`
-LLAMA_AVX512_VBMI
Should be
-DLLAMA_AVX512_VBMI
1 year ago
Martin Evans
2cded1b296
Fixed alignment of value fields in `LLamaModelMetadataOverride`
1 year ago
Martin Evans
3fc0f34cbe
Fixed some issues which were causing metadata overrides not to work (mostly importantly, converting the key was failing so all keys were null bytes and thus ignored).
1 year ago
Martin Evans
82baee7133
Merge pull request #384 from martindevans/fixed_metadata_large_values
Fixed loading of very large metadata values
1 year ago