scisharp
/
LLamaSharp
Not watched
1
0
Fork 0
Code
Releases 17 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
1206 Commits
8 Branches
333 MB
41 Download
Tree: ec8f832365
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'ec8f832365'
${ noResults }
LLamaSharp/LLama/Native/LLavaImageEmbed.cs

LLavaImageEmbed.cs 252 B
Raw Normal View History

Llava api (#563) * Add llava_binaries, update all binaries to make the test * Llava API + LlavaTest Preliminary * First prototype of Load + Unit Test * Temporary run test con branch LlavaAPI * Disable Embed test to review the rest of the test * Restore Embedding test * Use BatchThread to eval image embeddings Test Threads default value to ensure it doesn´t produce problems. * Rename test file * Update action versions * Test only one method, no release embeddings * Revert "Test only one method, no release embeddings" This reverts commit 264e176dccc9cd0be318b800ae5e102a4635d01c. * Correct API call * Only test llava related functionality * Cuda and Cblast binaries * Restore build policy * Changes related with code review * Add SafeHandles * Set overwrite to upload-artifact@v4 * Revert to upload-artifact@v3 * revert to upload-artifact@v3
1 year ago
​
​
​
​
​
​
​
​
​
​
​
​
 12345678910111213 
  1. using System.Runtime.InteropServices;

  2. 

  3. namespace LLama.Native;

  4. 

  5. /// <summary>

  6. /// LLaVa Image embeddings 

  7. /// </summary>

  8. [StructLayout(LayoutKind.Sequential)]

  9. unsafe public struct LLavaImageEmbed

  10. {

  11.     public float* embed;

  12.     public int n_image_pos;

  13. }

C#/.NET上易用的LLM高性能推理框架，支持LLaMA和LLaVA系列模型。