You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

llama.abstractions.illamaexecutor.md 1.8 kB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384
  1. # ILLamaExecutor
  2. Namespace: LLama.Abstractions
  3. A high level interface for LLama models.
  4. ```csharp
  5. public interface ILLamaExecutor
  6. ```
  7. ## Properties
  8. ### **Context**
  9. The loaded context for this executor.
  10. ```csharp
  11. public abstract LLamaContext Context { get; }
  12. ```
  13. #### Property Value
  14. [LLamaContext](./llama.llamacontext.md)<br>
  15. ### **IsMultiModal**
  16. Identify if it's a multi-modal model and there is a image to process.
  17. ```csharp
  18. public abstract bool IsMultiModal { get; }
  19. ```
  20. #### Property Value
  21. [Boolean](https://docs.microsoft.com/en-us/dotnet/api/system.boolean)<br>
  22. ### **ClipModel**
  23. Muti-Modal Projections / Clip Model weights
  24. ```csharp
  25. public abstract LLavaWeights ClipModel { get; }
  26. ```
  27. #### Property Value
  28. [LLavaWeights](./llama.llavaweights.md)<br>
  29. ### **ImagePaths**
  30. List of images: Image filename and path (jpeg images).
  31. ```csharp
  32. public abstract List<string> ImagePaths { get; set; }
  33. ```
  34. #### Property Value
  35. [List&lt;String&gt;](https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.list-1)<br>
  36. ## Methods
  37. ### **InferAsync(String, IInferenceParams, CancellationToken)**
  38. Asynchronously infers a response from the model.
  39. ```csharp
  40. IAsyncEnumerable<string> InferAsync(string text, IInferenceParams inferenceParams, CancellationToken token)
  41. ```
  42. #### Parameters
  43. `text` [String](https://docs.microsoft.com/en-us/dotnet/api/system.string)<br>
  44. Your prompt
  45. `inferenceParams` [IInferenceParams](./llama.abstractions.iinferenceparams.md)<br>
  46. Any additional parameters
  47. `token` [CancellationToken](https://docs.microsoft.com/en-us/dotnet/api/system.threading.cancellationtoken)<br>
  48. A cancellation token.
  49. #### Returns
  50. [IAsyncEnumerable&lt;String&gt;](https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.iasyncenumerable-1)<br>