Martin Evans
|
64416ca23c
|
- Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`)
- Integrated grammar into sampling
- Added a test for the grammar sampling
|
2 years ago |
Martin Evans
|
f3511e390f
|
WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving.
The biggest single change is renaming `LLamaModel` to `LLamaContext`
|
2 years ago |
Martin Evans
|
270c6d55ef
|
Merge pull request #88 from martindevans/fix_serialization_nan
Fix serialization error due to NaN
|
2 years ago |
Martin Evans
|
b5de3ee5aa
|
Fixed some final mentions of "mirostate" instead of "mirostat"
|
2 years ago |
Martin Evans
|
0e5e00e300
|
Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`)
|
2 years ago |
Martin Evans
|
cd3cf2b77d
|
- Moved tokenization from `Utils.Tokenize` into `SafeLLamaContextHandle.Tokenize`, one less thing in `Utils`.
- Also refactored it to return an `int[]` instead of an `IEnumerable<int>`, solving the "multiple enumeration" problems at the source!
|
2 years ago |
sa_ddam213
|
bac9cba01a
|
InferenceParams abstractions
|
2 years ago |
Martin Evans
|
c64507cb41
|
Correctly passing through mu value to mirostate instead of resetting it every time.
|
2 years ago |
Yaohui Liu
|
1062fe1a7e
|
feat: upgrade the native libraries.
|
2 years ago |
Yaohui Liu
|
6c400e64c2
|
docs: publiash documentation 0.4.
|
2 years ago |
Yaohui Liu
|
2eb2d6df83
|
test: add 9 examples of the new version.
|
2 years ago |
Marcel
|
762fd7c1ae
|
Fixed a typo in FixedSizeQueue
|
2 years ago |
Yaohui Liu
|
a3b8186f20
|
feat: support save and load chat session.
|
2 years ago |
Yaohui Liu
|
3bf74ec9b9
|
feat: add chat session for refactored code.
|
2 years ago |
Yaohui Liu
|
908b79e855
|
feat: add stateless executor.
|
2 years ago |
Yaohui Liu
|
e603a09137
|
fix: state loading and saving not working.
|
2 years ago |
Yaohui Liu
|
5679e08718
|
feat: add ILLamaExecutor.InferAsync.
|
2 years ago |
Yaohui Liu
|
264fb9a706
|
refactor: LLamaModel and LLamaExecutor.
|
2 years ago |