Martin Evans
|
2056078aef
|
Initial changes required for GGUF support
|
2 years ago |
Martin Evans
|
93f24f8a51
|
Switched to properly typed `Encoding` property
|
2 years ago |
Martin Evans
|
759ae26f36
|
Merge branch 'master' into grammar_basics
|
2 years ago |
Martin Evans
|
a9e6f21ab8
|
- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring!
- Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around
|
2 years ago |
Martin Evans
|
64416ca23c
|
- Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`)
- Integrated grammar into sampling
- Added a test for the grammar sampling
|
2 years ago |
Martin Evans
|
f3511e390f
|
WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving.
The biggest single change is renaming `LLamaModel` to `LLamaContext`
|
2 years ago |
Martin Evans
|
2c933c57a1
|
Fixed ModelOptions in Web project
|
2 years ago |
sa_ddam213
|
bac9cba01a
|
InferenceParams abstractions
|
2 years ago |
sa_ddam213
|
2a04e31b7d
|
ModelParams abstraction
|
2 years ago |
sa_ddam213
|
3fec7a63c7
|
Add Instruct and Stateless support
|
2 years ago |
sa_ddam213
|
a32a5e4ffe
|
Decouple connectionId from ModelSession
|
2 years ago |
sa_ddam213
|
d9fbd56f10
|
Strongly type connection status
|
2 years ago |
sa_ddam213
|
ef8cf0b283
|
Add RequestVerificationToken logic fo ajax prefilter, Tidy up js cancel logic
|
2 years ago |
sa_ddam213
|
e574d89a40
|
Send prompt on Enter key
|
2 years ago |
sa_ddam213
|
a139423581
|
Move session management to service, Use ILLamaExecutor in session to make more versatile, scroll bug
|
2 years ago |
sa_ddam213
|
1ec59e120a
|
Move session management to service, Infer cancel support
|
2 years ago |
sa_ddam213
|
fd215dce84
|
Update Readme
|
2 years ago |
sa_ddam213
|
21b685649f
|
Add Readme
|
2 years ago |
sa_ddam213
|
0c6b213b0d
|
Basic ASP.NET Core website example, Interactive started
|
2 years ago |