19 Commits (e77afa76d0d3d6e38632047b47f2f3a16fe707c7)

Author SHA1 Message Date
  Yaohui Liu e77afa76d0
feat: change default param of n_gpu_layers to 20. 2 years ago
  Yaohui Liu 513d566361
refactor: remove dependency for third-party logger. 2 years ago
  Yaohui Liu 18c2ff2395
refactor: instruct mode and examples. 2 years ago
  Yaohui Liu 421e3f32c7
feat: add tokenize and detokenize apis to LLamaModel. 2 years ago
  Yaohui Liu e926b0690f
docs: add comments to LLamaModel methods. 2 years ago
  Yaohui Liu 4e1b6cf4e9
fix: optimize loading and saving state. 2 years ago
  Yaohui Liu 19979f664a
feat: support loading and saving state. 2 years ago
  Yaohui Liu 2490cf17f4
build: update to v0.2.3. 2 years ago
  Yaohui Liu 00d91cf99e
refactor: some parts of code of LLamaModel. 2 years ago
  Yaohui Liu afedd3c949
fix: errors when input is not English or too long. 2 years ago
  Yaohui Liu ea5f9d38ac
fix: always add bos when inference. 2 years ago
  Yaohui Liu 4314f64b9c
feat: add check for backend package. 2 years ago
  Yaohui Liu bcd4c5605b
feat: add n_gpu_layers and prompt_cache_all params. 2 years ago
  Yaohui Liu 9c0f3aedba
refactor: change some file names. 2 years ago
  Yaohui Liu aa2b064d1d
fix: add IDisposable to model classes. 2 years ago
  Yaohui Liu d76619c01b
docs: add more comments to obselete class LLamaModelV1. 2 years ago
  Yaohui Liu fce10f3c4f
feat: add ChatSession. 2 years ago
  Yaohui Liu d6a7997e46
feat: add gpt model. 2 years ago
  Yaohui Liu 5a79edeb51
feat: add the framework and basic usages. 2 years ago