* Updated binaries, using [this build](https://github.com/SciSharp/LLamaSharp/actions/runs/8654672719/job/23733195669) for llama.cpp commit `f7001ccc5aa359fcf41bba19d1c99c3d25c9bcc7`.

 - Added all new functions.
 - Moved some functions (e.g. `SafeLlamaModelHandle` specific functions) into `SafeLlamaModelHandle.cs`
 - Exposed tokens on `SafeLlamaModelHandle` and `LLamaWeights` through a `Tokens` property. As new special tokens are added in the future they can be added here.
 - Changed all token properties to return nullable tokens, to handle some models not having some tokens.
 - Fixed `DefaultSamplingPipeline` to handle no newline token in some models.

* Moved native methods to more specific locations.

 - Context specific things have been moved into `SafeLLamaContextHandle.cs` and made private - they're exposed through C# properties and methods already.
 - Checking that GPU layer count is zero if GPU offload is not supported.
 - Moved methods for creating default structs (`llama_model_quantize_default_params` and `llama_context_default_params`) into relevant structs.

* Removed exception if `GpuLayerCount > 0` when GPU is not supported.

* - Added low level wrapper methods for new per-sequence state load/save in `SafeLLamaContextHandle`
 - Added high level wrapper methods (save/load with `State` object or memory mapped file) in `LLamaContext`
 - Moved native methods for per-sequence state load/save into `SafeLLamaContextHandle`

* Added update and defrag methods for KV cache in `SafeLLamaContextHandle`

* Updated submodule to `f7001ccc5aa359fcf41bba19d1c99c3d25c9bcc7`

* Passing the sequence ID when saving a single sequence state

* Updated binaries to llama.cpp `3ab8b3a92ede46df88bc5a2dfca3777de4a2b2b6` (build run: https://github.com/SciSharp/LLamaSharp/actions/runs/8118890586)

* Added abort callback

* Added properties to get/set thread count on `LLamaContext`

* Fixed LLamaLogLevel numbering

Update binaries feb 2024

This results in windows users not needing to rename the DLL. This allows native llama builds to be dropped in, even on windows.

I also took the time to update the documentation, removing references to renaming the files, since the names now match.

Fixes #463

- build run: https://github.com/SciSharp/LLamaSharp/actions/runs/7196891440
 - commit: 9fb13f9584

- Built by this run: https://github.com/SciSharp/LLamaSharp/actions/runs/6921572568
 - commit: `e937066420b79a757bf80e9836eb12b88420a218`
 - Rearranged paths

This reverts commit b4b3ea9d99.

Just merge cuda and avx detection and change layout.

Delete Backend.Metal because is not needed anymore.
Do not include .metal in x86_64 binaries

Create different paths to different MacOS platforms.
Dynamically load the right library

Add the MacOS binary from the same run

Should fix the extreme speed loss.

Co-authored-by: Martin Evans <martindevans@gmail.com>

Co-authored-by: Martin Evans <martindevans@gmail.com>

Co-authored-by: Martin Evans <martindevans@gmail.com>

Co-authored-by: Martin Evans <martindevans@gmail.com>

Co-authored-by: Martin Evans <martindevans@gmail.com>

- Fixed stateless executor out-of-context handling
 - Fixed token tests

- Replaced all binaries

See on Mac OS enable Metal by default #2901

This commit includes changes to compile en VS Mac + changest to use llama2 not codellama.

It includes MacOS binaries in memory and metal

Based on this version: 6b73ef1201