You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

LLamaState.cs 242 B

12345678910
  1. using System;
  2. using System.Collections.Generic;
  3. using System.Text;
  4. namespace LLama
  5. {
  6. using llama_token = Int32;
  7. public record LLamaState(Queue<llama_token> EvalTokens, Queue<float[]> EvalLogits,
  8. byte[] State, int Size);
  9. }

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。