Martin Evans
f70525fec2
Two small improvements to the native sampling API:
- Modified `llama_sample_token_mirostat` and `llama_sample_token_mirostat_v2` to take `ref float` instead of as a `float*`. Less pointers is always good.
- Modified `llama_sample_repetition_penalty` and `llama_sample_frequency_and_presence_penalties` to take pointers instead of arrays. This allows the use non non allocating types (e.g. Span) instead of arrays
- Modified higher level API to accept `Memory<int>` instead of `int[]`, which can be used to reduce allocations at call sites
2 years ago
Martin Evans
da3dffe812
Merge pull request #120 from martindevans/code_warnings_cleanup
ReSharper code warnings cleanup
2 years ago
Martin Evans
a911b77dec
Various minor changes, resolving about 100 ReSharper code quality warnings
2 years ago
Martin Evans
5a6c6de0dc
Merge pull request #115 from martindevans/model_params_record
ModelsParams record class
2 years ago
Martin Evans
d367317c2c
Merge pull request #119 from martindevans/improved_cloning
Improved Cloning
2 years ago
Martin Evans
70be6c7368
Removed `virtual` method in newly sealed class
2 years ago
Martin Evans
ebacdb666d
- Moved the lower level state get/set methods onto SafeLLamaContextHandle
- Used those methods to add a `Clone` method to SafeLLamaContextHandle
- Simplified `LLamaContext` by using the new methods
- Sealed `LLamaContext` and `LLamaEmbedder`
2 years ago
Martin Evans
77aa5fa0d0
Added `JsonConverter` attribute, so System.Text.Json serialization is seamless
2 years ago
Martin Evans
df80ec9161
Merge pull request #97 from martindevans/embedder_tests
Embedder Test
2 years ago
Martin Evans
634bd3feed
Loosened requirements even more!
2 years ago
Martin Evans
9587699a60
loosened requirements even further for CI
2 years ago
Martin Evans
bc70358b3e
expanded epsilon enough to allow CI to pass
2 years ago
Martin Evans
469b5e6fcd
Merge pull request #117 from martindevans/more_obsoletion
OldVersion obsoletion notices
2 years ago
Martin Evans
804686818c
Merge branch 'embedder_tests' of github.com:martindevans/LLamaSharp into embedder_tests
2 years ago
Martin Evans
058c4e84b1
Rewritten LLamaEmbedder to use `LLamaContext` instead of the lower level handles
2 years ago
Martin Evans
08501db155
cleaned up basic test a bit
2 years ago
Martin Evans
498ed109c1
Fixed dot product based test
2 years ago
Martin Evans
35e48691ea
Added a known correct value to the unit tests
2 years ago
Martin Evans
dff308e31b
Added a test for the LLamaEmbedder
2 years ago
Martin Evans
829f32b27d
- Added `Obsolete` attributes to the entire `OldVersion` namespace, so they can be removed in the future
- Minor changes to cleanup some of the compiler warnings
2 years ago
Martin Evans
ee772a2921
added `using` statement instead of full qualification
2 years ago
Martin Evans
93f24f8a51
Switched to properly typed `Encoding` property
2 years ago
Martin Evans
d92e2664ac
Merge pull request #116 from zombieguy98/master
Changed type conversion
2 years ago
zombieguy
45b01d5a78
Improved type conversion
Type conversion is now done in the property rather than the utils class and uses the System.Convert class to ensure consistency.
2 years ago
Martin Evans
29df14cd9c
Converted ModelParams into a `record` class. This has several advantages:
- Equality, hashing etc all implemented automatically
- Default values are defined in just one place (the properties) instead of the constructor as well
- Added test to ensure that serialization works properly
2 years ago
Martin Evans
42fc5e4983
Merge pull request #114 from martindevans/minor_code_cleanup
Minor Code Cleanup
2 years ago
Martin Evans
2830e5755c
- Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed.
- Deleted `NativeInfo` (internal class, not used anywhere)
2 years ago
Martin Evans
854532c08e
Merge pull request #112 from martindevans/classifier_free_guidance
Added native symbol for CFG
2 years ago
Martin Evans
a6cd0cf848
Merge pull request #111 from erinloy/master
Re-renaming some arguments to allow for easy deserialization from appsettings.json.
2 years ago
Martin Evans
4b7d718551
Added native symbol for CFG
2 years ago
Erin Loy
8f0b52eb09
Re-renaming some arguments to allow for easy deserialization from appsettings.json.
2 years ago
Martin Evans
976ca6a740
Merge pull request #102 from martindevans/grammar_basics
Grammar basics
2 years ago
Martin Evans
9fc17f3136
Fixed unit tests
2 years ago
Martin Evans
759ae26f36
Merge branch 'master' into grammar_basics
2 years ago
Martin Evans
70835a0010
Merge pull request #107 from martindevans/stateless_improvements
Stateless Executor Fix
2 years ago
Martin Evans
a45d9089e1
Fixed demos
2 years ago
Martin Evans
a9e6f21ab8
- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring!
- Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around
2 years ago
Martin Evans
48bc0a6f8a
Doe the same for the second test, hopefully fixing CI
2 years ago
Martin Evans
6f2ab8e039
Not asserting the answer, just that it didn't change
2 years ago
Martin Evans
e7b217f462
Fixed out of context logic
2 years ago
Martin Evans
4738c26299
- Reduced context size of test, to speed it up
- Removed some unnecessary `ToArray` calls
- Initial pass on LLamaStatelessExecutor, the context overflow management is broken but I think I found where it's ported from
2 years ago
Martin Evans
ae8ef17a4a
- Added various convenience overloads to `LLamaContext.Eval`
- Converted `SafeLLamaContextHandle` to take a `ReadOnlySpan` for Eval, narrower type better represents what's really needed
2 years ago
Martin Evans
4d0c044b9f
Added tests for the StatelessExecutor, one is currently failing
2 years ago
Martin Evans
629e544341
cleaned up basic test a bit
2 years ago
Martin Evans
8f41a8395f
Fixed dot product based test
2 years ago
Martin Evans
8d5eccd28b
Merge pull request #108 from erinloy/master
renamed some arguments in ModelParams constructor so that class can be serialized easily
2 years ago
Erin Loy
592a80840b
renamed some arguments in ModelParams constructor so that classcan be serialized easily
2 years ago
Martin Evans
5e31c6db82
Merge pull request #105 from martindevans/update_demos
Updated Demos
2 years ago
Martin Evans
02a46fc363
Updated demos to use the new loading/multi context system
2 years ago
Martin Evans
1db7292b05
Fixed conflicts caused by merging of multi context PR
2 years ago