scisharp
/
LLamaSharp
Not watched
1
0
Fork 0
Code
Releases 17 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
1321 Commits
8 Branches
333 MB
29 Download
Tree: 6f9097f25b
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '6f9097f25b'
${ noResults }
LLamaSharp/LLama.Unittest/AssemblyAttributes.cs

AssemblyAttributes.cs 310 B
Raw Normal View History

Disable test parallelism to prevent fix CI
2 years ago
​
​
​
​
 12345 
  1. 

  2. // Disable running tests in parallel. Some tests load language models and try to and

  3. // this can cause a lockup due to memory thrashing and terrible performance.

  4. // e.g. 7GB model loaded by 10 different tests and trying to evaluate prompts

  5. [assembly: CollectionBehavior(DisableTestParallelization = true)]

C#/.NET上易用的LLM高性能推理框架，支持LLaMA和LLaVA系列模型。