scisharp
/
LLamaSharp
Not watched
1
0
Fork 0
Code
Releases 17 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
938 Commits
8 Branches
333 MB
43 Download
Tree: d74e6c75d5
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'd74e6c75d5'
${ noResults }
LLamaSharp/LLama.Web/Models/CancelModel.cs

CancelModel.cs 124 B
Raw Normal View History

Move session management to service, Infer cancel support
2 years ago
​
​
​
​
​
​
 1234567 
  1. namespace LLama.Web.Models

  2. {

  3.     public class CancelModel

  4.     {

  5.         public string ConnectionId { get; set; }

  6.     }

  7. }

C#/.NET上易用的LLM高性能推理框架，支持LLaMA和LLaVA系列模型。