Martin Evans
eebe4cb120
Added a new test (commented out for now) which reproduces the issue reported in #394
1 year ago
Martin Evans
b620e749a1
Merge pull request #415 from martindevans/readme_example_code_fix
Fixed example code in readme
1 year ago
Martin Evans
9573e2c9ba
Merge pull request #417 from martindevans/safe_handle_initialisation
Safer Handle Initialisation
1 year ago
Martin Evans
1e69e265b6
Moved some native methods to do with creating/destroying resources into their respective handles. There is **no** safe way to call most of these methods, everything must be done through through handles.
1 year ago
Martin Evans
c696cda44b
Merge pull request #416 from martindevans/IModelParams_better_exception
Improved exceptions in IModelParams for unknown KV override types.
1 year ago
Martin Evans
8416cb866a
Improved exceptions in IModelParams for unknown KV override types.
1 year ago
Martin Evans
b68bc3548d
Fixed example code in readme
1 year ago
Martin Evans
d74e6c75d5
Merge pull request #413 from SciSharp/martindevans-patch-1
Update README.md
1 year ago
Martin Evans
368410ed41
Update README.md
1 year ago
Martin Evans
91157fe4da
Merge pull request #412 from martindevans/Release_0.9.1
Release 0.9.1 (hotfix)
1 year ago
Martin Evans
02f6c064fb
Added the final nuget push back into the workflows
1 year ago
Martin Evans
d457cc3c1e
Merge pull request #411 from martindevans/test_pr2
Test Release PR 2
1 year ago
Martin Evans
5a4e6d8e07
Fixed copy path for binaries
1 year ago
Martin Evans
cdb98f2874
Merge pull request #410 from martindevans/test_pr
Test PR
1 year ago
Martin Evans
4d1e73b6d1
Test PR with unimportant change to test the fixed auto-release pipeline
1 year ago
Martin Evans
308aec363a
Merge pull request #409 from martindevans/fixed_prepare_release
Fixed prepare_release script
1 year ago
Martin Evans
fef9c9f3f2
Temporarily disabled nuget push, for testing
1 year ago
Martin Evans
2166c2dbcf
Formatting of error return
1 year ago
Martin Evans
072873a8a1
Added -e flag, to terminate prepare_release script if there are any errors
1 year ago
Martin Evans
c38bc0a342
Fixed prepare_release.sh script so it can properly copy all of the binary deps
1 year ago
Martin Evans
4952d55216
Merge pull request #398 from martindevans/0.9.0_readme_update
Updated readme for 0.9.0 release
1 year ago
Martin Evans
b3b54e662a
Merge pull request #408 from asmirnov82/fix_semantic_kernel_readme
Fix typos in SemanticKernel README file
1 year ago
Aleksei Smirnov
cc892a5eed
Fix typos in SemanticKernel README file
1 year ago
Martin Evans
1e81b0b91c
Update README.md
Fixed readme: Max -> Mac
1 year ago
Martin Evans
3abcaa51b5
Merge pull request #403 from martindevans/extra_models_params_checking
Extra ModelParams Checking
1 year ago
Martin Evans
48ef3bb080
Added runtime checks that UseMemoryLock and UseMemorymap are actually supported.
1 year ago
Martin Evans
9b9bcc0dbc
Merge pull request #402 from martindevans/safer_model_handle_creation
Safer Model Handle Creation
1 year ago
Martin Evans
4e5e994dda
- directly returning a SafeLlamaModelHandle, instead of an IntPtr which is wrapped in a handle.
- made `llama_backend_init` private. This is automatically called, there is no way it can correctly be used externally.
- made `llama_token_to_piece` safe (Span instead of pointer)
1 year ago
Martin Evans
a1a8461802
Merge pull request #401 from martindevans/remove_some_unsafe
Removed some unnecessary uses of `unsafe`
1 year ago
Martin Evans
bac3e43498
Fixed handling of empty spans
1 year ago
Martin Evans
3925545147
Fixed LLamaExecutorBase.cs
1 year ago
Martin Evans
c002642268
- Removed some `unsafe` where it wasn't necessary
- Wrapped some native functions which take (pointer, length) in function which take a `span` instead.
1 year ago
Martin Evans
5c876cbbfe
Merge pull request #400 from martindevans/resharper_code_suggestions_cleanup_nativeapi
Code cleanup driven by R# suggestions
1 year ago
Martin Evans
f860f88c36
Code cleanup driven by R# suggestions:
- Made `NativeApi` into a `static class` (it's not intended to be instantiated)
- Moved `LLamaTokenType` enum out into a separate file
- Made `LLamaSeqId` and `LLamaPos` into `record struct`, convenient to have equality etc
1 year ago
Martin Evans
a408335c44
Fixed broken build on master (just removing a namespace that no longer exists)
1 year ago
Haiping
feebd627f4
Merge pull request #396 from SciSharp/dependabot/nuget/Microsoft.KernelMemory.Core-and-Microsoft.KernelMemory.Abstractions-0.24.231228.5
build(deps): bump Microsoft.KernelMemory.Core and Microsoft.KernelMemory.Abstractions
1 year ago
Haiping
a6e80c317c
Merge pull request #397 from SciSharp/dependabot/nuget/Microsoft.KernelMemory.Abstractions-0.24.231228.5
build(deps): bump Microsoft.KernelMemory.Abstractions from 0.18.231209.1-preview to 0.24.231228.5
1 year ago
Martin Evans
3b766089da
Updated readme for 0.9.0 release
1 year ago
dependabot[bot]
89a43d8a12
build(deps): bump Microsoft.KernelMemory.Abstractions
Bumps [Microsoft.KernelMemory.Abstractions](https://github.com/microsoft/kernel-memory ) from 0.18.231209.1-preview to 0.24.231228.5.
- [Release notes](https://github.com/microsoft/kernel-memory/releases )
- [Commits](https://github.com/microsoft/kernel-memory/compare/dotnet-0.18.231209.1-preview...0.24.231228.5 )
---
updated-dependencies:
- dependency-name: Microsoft.KernelMemory.Abstractions
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
dependabot[bot]
f02b0500b5
build(deps): bump Microsoft.KernelMemory.Core and Microsoft.KernelMemory.Abstractions
Bumps [Microsoft.KernelMemory.Core](https://github.com/microsoft/kernel-memory ) and [Microsoft.KernelMemory.Abstractions](https://github.com/microsoft/kernel-memory ). These dependencies needed to be updated together.
Updates `Microsoft.KernelMemory.Core` from 0.18.231209.1-preview to 0.24.231228.5
- [Release notes](https://github.com/microsoft/kernel-memory/releases )
- [Commits](https://github.com/microsoft/kernel-memory/compare/dotnet-0.18.231209.1-preview...0.24.231228.5 )
Updates `Microsoft.KernelMemory.Abstractions` from 0.18.231209.1-preview to 0.24.231228.5
- [Release notes](https://github.com/microsoft/kernel-memory/releases )
- [Commits](https://github.com/microsoft/kernel-memory/compare/dotnet-0.18.231209.1-preview...0.24.231228.5 )
---
updated-dependencies:
- dependency-name: Microsoft.KernelMemory.Core
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: Microsoft.KernelMemory.Abstractions
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Martin Evans
39bc26882f
Merge pull request #388 from SciSharp/dependabot/nuget/Swashbuckle.AspNetCore-6.5.0
build(deps): bump Swashbuckle.AspNetCore from 6.4.0 to 6.5.0
1 year ago
Martin Evans
d64c70e58e
Merge pull request #391 from SciSharp/dependabot/nuget/xunit.runner.visualstudio-2.5.6
build(deps): bump xunit.runner.visualstudio from 2.5.5 to 2.5.6
1 year ago
dependabot[bot]
57fdac493a
build(deps): bump xunit.runner.visualstudio from 2.5.5 to 2.5.6
Bumps [xunit.runner.visualstudio](https://github.com/xunit/visualstudio.xunit ) from 2.5.5 to 2.5.6.
- [Release notes](https://github.com/xunit/visualstudio.xunit/releases )
- [Commits](https://github.com/xunit/visualstudio.xunit/compare/2.5.5...2.5.6 )
---
updated-dependencies:
- dependency-name: xunit.runner.visualstudio
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Martin Evans
a96f8da77b
Merge pull request #389 from SciSharp/dependabot/nuget/xunit-2.6.4
build(deps): bump xunit from 2.6.3 to 2.6.4
1 year ago
dependabot[bot]
58e5a84d54
build(deps): bump xunit from 2.6.3 to 2.6.4
Bumps [xunit](https://github.com/xunit/xunit ) from 2.6.3 to 2.6.4.
- [Commits](https://github.com/xunit/xunit/compare/2.6.3...2.6.4 )
---
updated-dependencies:
- dependency-name: xunit
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
dependabot[bot]
492981718d
build(deps): bump Swashbuckle.AspNetCore from 6.4.0 to 6.5.0
Bumps [Swashbuckle.AspNetCore](https://github.com/domaindrivendev/Swashbuckle.AspNetCore ) from 6.4.0 to 6.5.0.
- [Release notes](https://github.com/domaindrivendev/Swashbuckle.AspNetCore/releases )
- [Commits](https://github.com/domaindrivendev/Swashbuckle.AspNetCore/compare/v6.4.0...v6.5.0 )
---
updated-dependencies:
- dependency-name: Swashbuckle.AspNetCore
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Martin Evans
95b9e4d2c7
Merge pull request #385 from martindevans/partial_fix_metadata_override
Metadata Fixes
1 year ago
Martin Evans
889d99bfe2
Merge pull request #386 from edgett/patch-1
Update compile.yml to fix not building for windows
1 year ago
edgett
b6dec83ca9
Update compile.yml to fix not building for windows
This fixes the build step: Compile (Windows) (avx512, -DLLAMA_AVX512=ON -LLAMA_AVX512_VBMI=ON -DLLAMA_AVX512_VNNI=ON)
There is a typo in the cmake command: `cmake .. -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_TESTS=OFF -DLLAMA_BUILD_EXAMPLES=OFF -DLLAMA_BUILD_SERVER=OFF -DBUILD_SHARED_LIBS=ON -DLLAMA_AVX512=ON -LLAMA_AVX512_VBMI=ON -DLLAMA_AVX512_VNNI=ON
cmake --build . --config Release -j ${env:NUMBER_OF_PROCESSORS}`
-LLAMA_AVX512_VBMI
Should be
-DLLAMA_AVX512_VBMI
1 year ago
Martin Evans
2cded1b296
Fixed alignment of value fields in `LLamaModelMetadataOverride`
1 year ago