You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

Program.cs 586 B

123456789101112131415161718192021
  1. using LLama;
  2. using LLama.Examples;
  3. using LLama.Types;
  4. int choice = 0;
  5. if(choice == 0)
  6. {
  7. ChatSession chat = new(@"D:\development\llama\weights\LLaMA\7B\ggml-model-q4_0.bin", "Assets/chat-with-bob.txt", new string[] { "User:" });
  8. chat.Run();
  9. }
  10. else if(choice == 1)
  11. {
  12. ChatWithLLamaModel chat = new(@"D:\development\llama\weights\LLaMA\7B\ggml-model-q4_0.bin", "Assets/chat-with-bob.txt", new string[] { "User:" });
  13. chat.Run();
  14. }
  15. else if(choice == 2)
  16. {
  17. ChatWithLLamaModelV1 chat = new(@"D:\development\llama\weights\LLaMA\7B\ggml-model-q4_0.bin");
  18. chat.Run();
  19. }

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。

Contributors (1)