Yaohui Liu
|
e603a09137
|
fix: state loading and saving not working.
|
2 years ago |
Yaohui Liu
|
5679e08718
|
feat: add ILLamaExecutor.InferAsync.
|
2 years ago |
Yaohui Liu
|
aaa0cba9f8
|
test: update the examples after refactoring.
|
2 years ago |
Yaohui Liu
|
264fb9a706
|
refactor: LLamaModel and LLamaExecutor.
|
2 years ago |
Yaohui Liu
|
3a62f087fe
|
fix: encoding error when using other languages.
|
2 years ago |
Rinne
|
4d34f0b116
|
docs: update discord link.
|
2 years ago |
Yaohui Liu
|
9a4bf8e844
|
docs: add verified models info.
|
2 years ago |
Yaohui Liu
|
25cf2a6ca9
|
docs: add qq group info to readme.
|
2 years ago |
Yaohui Liu
|
e77afa76d0
|
feat: change default param of n_gpu_layers to 20.
|
2 years ago |
Yaohui Liu
|
a545ab7eda
|
test: remove dumplicated space of example output.
|
2 years ago |
Yaohui Liu
|
e21589afa6
|
fix: n_gpu_layers not work in latest commit.
|
2 years ago |
Yaohui Liu
|
513d566361
|
refactor: remove dependency for third-party logger.
|
2 years ago |
Yaohui Liu
|
3e53ed4753
|
fix: build error after dropping LLamaModelV1.
|
2 years ago |
Yaohui Liu
|
56c56b9c51
|
refactor: drop LLamaModelV1.
|
2 years ago |
Yaohui Liu
|
18c2ff2395
|
refactor: instruct mode and examples.
|
2 years ago |
Yaohui Liu
|
421e3f32c7
|
feat: add tokenize and detokenize apis to LLamaModel.
|
2 years ago |
Yaohui Liu
|
e926b0690f
|
docs: add comments to LLamaModel methods.
|
2 years ago |
Yaohui Liu
|
4e1b6cf4e9
|
fix: optimize loading and saving state.
|
2 years ago |
Yaohui Liu
|
55d5a8ae51
|
fix: quantization error with fp16.
|
2 years ago |
Yaohui Liu
|
19979f664a
|
feat: support loading and saving state.
|
2 years ago |
Yaohui Liu
|
1573ae049f
|
docs: update the readme.
|
2 years ago |
Yaohui Liu
|
d6bd1b7107
|
fix: add check for model file path.
|
2 years ago |
Yaohui Liu
|
889975979d
|
docs: add badge to readme.
|
2 years ago |
Yaohui Liu
|
a65ad44291
|
build: add readme to package.
|
2 years ago |
Yaohui Liu
|
8e4fbe7bac
|
docs: update the readme.
|
2 years ago |
Yaohui Liu
|
2490cf17f4
|
build: update to v0.2.3.
|
2 years ago |
Yaohui Liu
|
00d91cf99e
|
refactor: some parts of code of LLamaModel.
|
2 years ago |
Yaohui Liu
|
afedd3c949
|
fix: errors when input is not English or too long.
|
2 years ago |
Yaohui Liu
|
ea5f9d38ac
|
fix: always add bos when inference.
|
2 years ago |
Yaohui Liu
|
1fca06dc7f
|
fix: n_gpu_layers miss in llama context.
|
2 years ago |
Yaohui Liu
|
4314f64b9c
|
feat: add check for backend package.
|
2 years ago |
Yaohui Liu
|
1fd35eca3e
|
docs: update the prompt resource info.
|
2 years ago |
Yaohui Liu
|
a7b9d29083
|
docs: update the readme file.
|
2 years ago |
Yaohui Liu
|
bcd4c5605b
|
feat: add n_gpu_layers and prompt_cache_all params.
|
2 years ago |
Yaohui Liu
|
f17fd889be
|
build: optimize the building of LLama.
|
2 years ago |
Yaohui Liu
|
998c0cb98d
|
Merge branch 'master' of github.com:SciSharp/LLamaSharp
|
2 years ago |
Yaohui Liu
|
9c0f3aedba
|
refactor: change some file names.
|
2 years ago |
Yaohui Liu
|
f5a01c346d
|
feat: enable history for chat session.
|
2 years ago |
Yaohui Liu
|
aa2b064d1d
|
fix: add IDisposable to model classes.
|
2 years ago |
Haiping
|
e87dcd56fc
|
Merge pull request #4 from weiajr/patch-1
Add a missing }
|
2 years ago |
weiajr
|
b5eda7a2df
|
Add a missing }
Add a missing } in the readme session example
|
2 years ago |
Yaohui Liu
|
510c10b03a
|
Merge branch 'master' of github.com:SciSharp/LLamaSharp
|
2 years ago |
Yaohui Liu
|
83882f2e94
|
docs: add discord info in readme.
|
2 years ago |
Rinne
|
3a3c2d569c
|
docs: update readme file.
|
2 years ago |
Yaohui Liu
|
6ffcb5306b
|
refactor: use official api of quantization instead.
|
2 years ago |
Yaohui Liu
|
5e378f9a52
|
docs: add anouncement about cpu only version.
|
2 years ago |
Rinne
|
982573d79b
|
Merge pull request #1 from AsakusaRinne/master
feat: add get-embedding api to LLamaModel.
|
2 years ago |
Yaohui Liu
|
0958bbac2c
|
feat: add get-embedding api to LLamaModel.
|
2 years ago |
Yaohui Liu
|
d76619c01b
|
docs: add more comments to obselete class LLamaModelV1.
|
2 years ago |
Yaohui Liu
|
a4950e3c57
|
docs: update the readme.
|
2 years ago |