Rinne
1533ee7dbf
Merge pull request #138 from drasticactions/semantic-kernel
Enable Semantic kernel support
2 years ago
Tim Miller
d4a57fffef
README, Cleanup
2 years ago
Tim Miller
2bde188c64
Change Namespace
2 years ago
Tim Miller
a81edacbfb
Remove embedding for now
2 years ago
Tim Miller
98bfbe1d50
Update
2 years ago
Tim Miller
9a1d6f99f2
Add Semantic Kernel support
2 years ago
Martin Evans
a70c7170dd
- Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system.
- Made all the mechanics of grammar parsing (GBNFGrammarParser, ParseState) internal. Just call `Grammar.Parse("whatever")`.
- Added a `GrammarRule` class which validates elements on construction (this allows constructing grammar without parsing GBNF).
- It should be impossible for a `GrammarRule` to represent an invalid rule.
2 years ago
Mihai
71f02e08c2
Add grammar example
2 years ago
Martin Evans
5a6c6de0dc
Merge pull request #115 from martindevans/model_params_record
ModelsParams record class
2 years ago
Martin Evans
829f32b27d
- Added `Obsolete` attributes to the entire `OldVersion` namespace, so they can be removed in the future
- Minor changes to cleanup some of the compiler warnings
2 years ago
Martin Evans
29df14cd9c
Converted ModelParams into a `record` class. This has several advantages:
- Equality, hashing etc all implemented automatically
- Default values are defined in just one place (the properties) instead of the constructor as well
- Added test to ensure that serialization works properly
2 years ago
Martin Evans
2830e5755c
- Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed.
- Deleted `NativeInfo` (internal class, not used anywhere)
2 years ago
Martin Evans
a45d9089e1
Fixed demos
2 years ago
Martin Evans
a9e6f21ab8
- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring!
- Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around
2 years ago
Martin Evans
ae8ef17a4a
- Added various convenience overloads to `LLamaContext.Eval`
- Converted `SafeLLamaContextHandle` to take a `ReadOnlySpan` for Eval, narrower type better represents what's really needed
2 years ago
Martin Evans
02a46fc363
Updated demos to use the new loading/multi context system
2 years ago
Martin Evans
e2fe08a9a2
Added a higher level `LLamaWeights` wrapper around `SafeLlamaModelHandle`
2 years ago
Martin Evans
f31bdf6b93
Using the right context for Bob
2 years ago
Martin Evans
f3511e390f
WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving.
The biggest single change is renaming `LLamaModel` to `LLamaContext`
2 years ago
Rinne
0269af8c17
Merge branch 'master' into runtime-targets
2 years ago
Yaohui Liu
1062fe1a7e
feat: upgrade the native libraries.
2 years ago
Yaohui Liu
eed96248b5
docs: add the documentations with mkdocs.
2 years ago
Yaohui Liu
2eb2d6df83
test: add 9 examples of the new version.
2 years ago
Tim Miller
bbd2650cf0
Include runtime targets file
2 years ago
Yaohui Liu
f3565d6b2d
refactor: rename Quantizer to LLamaQuantizer.
2 years ago
Yaohui Liu
a3b8186f20
feat: support save and load chat session.
2 years ago
Yaohui Liu
bdbd6aa824
feat: add transforms for chat session.
2 years ago
Yaohui Liu
3bf74ec9b9
feat: add chat session for refactored code.
2 years ago
Yaohui Liu
908b79e855
feat: add stateless executor.
2 years ago
Yaohui Liu
e603a09137
fix: state loading and saving not working.
2 years ago
Yaohui Liu
5679e08718
feat: add ILLamaExecutor.InferAsync.
2 years ago
Yaohui Liu
aaa0cba9f8
test: update the examples after refactoring.
2 years ago
Yaohui Liu
a545ab7eda
test: remove dumplicated space of example output.
2 years ago
Yaohui Liu
56c56b9c51
refactor: drop LLamaModelV1.
2 years ago
Yaohui Liu
18c2ff2395
refactor: instruct mode and examples.
2 years ago
Yaohui Liu
6ffcb5306b
refactor: use official api of quantization instead.
2 years ago
Yaohui Liu
0958bbac2c
feat: add get-embedding api to LLamaModel.
2 years ago
Haiping Chen
21c36cbf80
Added WebAPI.
2 years ago
Yaohui Liu
33067f990f
feat: run quantization in csharp.
2 years ago
Yaohui Liu
648b14fd0f
docs: revise examples.
2 years ago
Yaohui Liu
856d6549de
build: add linux support.
2 years ago
Yaohui Liu
8978410eab
docs: add examples for running LLamaSharp.
2 years ago