You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

IChatModel.cs 567 B

123456789101112131415161718
  1. using System;
  2. using System.Collections.Generic;
  3. using System.Text;
  4. namespace LLama
  5. {
  6. public interface IChatModel
  7. {
  8. string Name { get; }
  9. IEnumerable<string> Chat(string text, string? prompt = null, string encoding = "UTF-8");
  10. /// <summary>
  11. /// Init a prompt for chat and automatically produce the next prompt during the chat.
  12. /// </summary>
  13. /// <param name="prompt"></param>
  14. void InitChatPrompt(string prompt, string encoding = "UTF-8");
  15. void InitChatAntiprompt(string[] antiprompt);
  16. }
  17. }

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。