Martin Evans
|
8562e1b924
|
Merge pull request #193 from DVaughan/dv-update-SemanticKernel-1.0.0-beta1
Support SemanticKernel 1.0.0-beta1
|
2 years ago |
Martin Evans
|
2ad6aef185
|
Merge pull request #194 from martindevans/yet_more_tests
More Tests
|
2 years ago |
Martin Evans
|
b8f0eff080
|
- Added `GetCharCountImpl` tests, fixed handling of empty strings
- Added ifdef to remove `Deconstruct` extension on everything except `NETSTANDARD2_0`
|
2 years ago |
Martin Evans
|
45118520fa
|
- Improved coverage of `GBNFGrammarParser` up to 96%
- Covered text transforms
- Removed unnecessary non-async transforms
|
2 years ago |
Daniel Vaughan
|
10a7d68330
|
Change to nullable cast in LLamaSharpTextCompletion.
|
2 years ago |
Daniel Vaughan
|
f64a54c9c8
|
Support SemanticKernel 1.0.0-beta1
|
2 years ago |
Martin Evans
|
58ec110a7d
|
Merge pull request #192 from martindevans/GrammarRule_tests
GrammarRule Tests
|
2 years ago |
Martin Evans
|
9f694c584c
|
Further improved grammar parser test coverage (up to 92%)
|
2 years ago |
Martin Evans
|
bff41eef37
|
Added some more coverage of `GrammarRule`, checking that invalid rules are rejected
|
2 years ago |
Martin Evans
|
6a7634309e
|
Merge pull request #190 from martindevans/fix/github_build
Fixed GitHub Action
|
2 years ago |
Martin Evans
|
1a94c48fb6
|
Added some parallelism to CUDA build (just set to 4 for now, no cross platform way to get it)
|
2 years ago |
Martin Evans
|
2b5bc915de
|
Removed samples from linux install
|
2 years ago |
Martin Evans
|
ed38be1040
|
added the VS integration back in for windows
|
2 years ago |
Martin Evans
|
8fba1f56a7
|
Using the old install method on Linux
|
2 years ago |
Martin Evans
|
8c63422ea9
|
Removed "visual_studio_integration", hopefully that will fix linux and not break windows
|
2 years ago |
Martin Evans
|
d48dd3a4fc
|
added sub packages to reduce how much CUDA stuff needs installing
|
2 years ago |
Martin Evans
|
6571e982e1
|
disabled `-march=native` for macos build which was causing a build failure
|
2 years ago |
Martin Evans
|
2c9519bb56
|
sped up macos build
|
2 years ago |
Martin Evans
|
56073e7d11
|
Merge pull request #182 from martindevans/async_stateless_eval
Async Stateless Executor
|
2 years ago |
Martin Evans
|
b7379b7124
|
Moved spinner out to an extension, so it can easily be used in other examples
|
2 years ago |
Martin Evans
|
d58fcbbd13
|
Fixed antiprompt checking
|
2 years ago |
Martin Evans
|
08f1615e60
|
- Converted LLamaStatelessExecutor to run `Exec` calls inside an awaited task. This unblocks async callers while the model is being evaluated.
- Added a "spinner" to the `StatelessModeExecute` demo, which spins while waiting for the next token (demonstrating that it's not blocked).
|
2 years ago |
Martin Evans
|
54b3eb0223
|
Merge pull request #179 from martindevans/extensions_tests
Extensions Method Unit Tests
|
2 years ago |
Martin Evans
|
fe54f6764f
|
- Added unit tests for extension methods
- Removed unused `AddRangeSpan` extension
|
2 years ago |
Rinne
|
4e68ee6117
|
docs: update document links in readme.
|
2 years ago |
Haiping
|
79fa74d59c
|
Merge pull request #177 from redthing1/fix/context-getstate
fix opaque GetState (fixes #176)
|
2 years ago |
redthing1
|
b78044347c
|
fix opaque GetState (fixes #176)
|
2 years ago |
Haiping
|
e1af7a96da
|
Merge pull request #175 from redthing1/feat/inferenceparams_record
make InferenceParams a record so we can use `with`
|
2 years ago |
redthing1
|
296ba607de
|
make InferenceParams a record so we can use with
|
2 years ago |
Haiping Chen
|
45426aefa9
|
Fix CodingAssistant InferAsync.
|
2 years ago |
Haiping
|
10678a83d6
|
Merge pull request #65 from martindevans/alternative_dependency_loading
CPU Feature Detection
|
2 years ago |
Haiping
|
f134c5af59
|
Merge pull request #163 from SignalRT/DefaultMetal
MacOS default build now is metal llama.cpp #2901
|
2 years ago |
Haiping
|
9f9903c711
|
Merge pull request #173 from martindevans/async_only
Remove non-async
|
2 years ago |
Haiping
|
c8bb680d66
|
Merge pull request #172 from Regenhardt/feature/coding-assistant
Coding assistent example
|
2 years ago |
Martin Evans
|
3f80190f85
|
Minimal changes required to remove non-async inference.
|
2 years ago |
Regenhardt Marlon
|
0049dcfb66
|
Coding Assistent: Improve user information and link to source paper
|
2 years ago |
Regenhardt Marlon
|
71f4e2ae4a
|
Coding Assistent: Use GGUF model
|
2 years ago |
Marlon Regenhardt
|
2386be58c4
|
Example: Add code assistant using Code Llama-7b-Instruct as default
|
2 years ago |
Martin Evans
|
b1e9d8240d
|
Merge pull request #149 from martindevans/removed_unused_inference_params
Removed unused properties of `InferenceParams` & `ModelParams`
|
2 years ago |
Martin Evans
|
6a04f05e06
|
Merge pull request #169 from drasticactions/sk-api-update
SemanticKernel API Update
|
2 years ago |
Tim Miller
|
458679e36f
|
Merge branch 'sk-api-update' of github.com:drasticactions/LLamaSharp into sk-api-update
|
2 years ago |
Tim Miller
|
1b35da7e20
|
Merge branch 'master' into sk-api-update
|
2 years ago |
Tim Miller
|
abeab9f0a1
|
Bump dependencies
|
2 years ago |
Martin Evans
|
84c077067e
|
Merge pull request #167 from martindevans/skip_empty_tokenisation
skip_empty_tokenization
|
2 years ago |
Martin Evans
|
daf09eae64
|
Skipping tokenization of empty strings (saves allocating an empty array every time)
|
2 years ago |
Tim Miller
|
dced651f8b
|
Allow setting ChatRequestSettings Defaults and ChatSession
|
2 years ago |
Martin Evans
|
466722dcff
|
Merge pull request #165 from martindevans/better_instruct_antiprompt_checking
better_instruct_antiprompt_checking
|
2 years ago |
Martin Evans
|
d08a125020
|
Using the `TokensEndsWithAnyString` extensions for antiprompt checking in instruct executor. Simpler and more efficient.
|
2 years ago |
Martin Evans
|
149d076c98
|
Merge pull request #164 from martindevans/llama_get_kv_cache_token_count
llama_get_kv_cache_token_count
|
2 years ago |
Martin Evans
|
bba801f4b7
|
Added a property to get the KV cache size from a context
|
2 years ago |