scisharp
/
LLamaSharp
Not watched
1
0
Fork 0
Code
Releases 17 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
Tree: 98f26a669e
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '98f26a669e'
${ noResults }
LLamaSharp/0.4/xmldocs/llama.native.nativeapi/index.html

4286 lines
117 kB
Raw Blame History 

  1. 

  2. <!doctype html>

  3. <html lang="en" class="no-js">

  4.   <head>

  5.     

  6.       <meta charset="utf-8">

  7.       <meta name="viewport" content="width=device-width,initial-scale=1">

  8.       

  9.       

  10.       

  11.       

  12.         <link rel="prev" href="../llama.native.llamatokendataarraynative/">

  13.       

  14.       

  15.         <link rel="next" href="../llama.native.safellamacontexthandle/">

  16.       

  17.       <link rel="icon" href="../../assets/images/favicon.png">

  18.       <meta name="generator" content="mkdocs-1.4.3, mkdocs-material-9.1.16">

  19.     

  20.     

  21.       

  22.         <title>llama.native.nativeapi - LLamaSharp Documentation</title>

  23.       

  24.     

  25.     

  26.       <link rel="stylesheet" href="../../assets/stylesheets/main.26e3688c.min.css">

  27.       

  28.       

  29. 

  30.     

  31.     

  32.     

  33.       

  34.         

  35.         

  36.         <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>

  37.         <link rel="stylesheet" href="https://fonts.googleapis.com/css?family=Roboto:300,300i,400,400i,700,700i%7CRoboto+Mono:400,400i,700,700i&display=fallback">

  38.         <style>:root{--md-text-font:"Roboto";--md-code-font:"Roboto Mono"}</style>

  39.       

  40.     

  41.     

  42.     <script>__md_scope=new URL("../..",location),__md_hash=e=>[...e].reduce((e,_)=>(e<<5)-e+_.charCodeAt(0),0),__md_get=(e,_=localStorage,t=__md_scope)=>JSON.parse(_.getItem(t.pathname+"."+e)),__md_set=(e,_,t=localStorage,a=__md_scope)=>{try{t.setItem(a.pathname+"."+e,JSON.stringify(_))}catch(e){}}</script>

  43.     

  44.       

  45. 

  46.     

  47.     

  48.     

  49.   </head>

  50.   

  51.   

  52.     <body dir="ltr">

  53.   

  54.     

  55.     

  56.       <script>var palette=__md_get("__palette");if(palette&&"object"==typeof palette.color)for(var key of Object.keys(palette.color))document.body.setAttribute("data-md-color-"+key,palette.color[key])</script>

  57.     

  58.     <input class="md-toggle" data-md-toggle="drawer" type="checkbox" id="__drawer" autocomplete="off">

  59.     <input class="md-toggle" data-md-toggle="search" type="checkbox" id="__search" autocomplete="off">

  60.     <label class="md-overlay" for="__drawer"></label>

  61.     <div data-md-component="skip">

  62.       

  63.         

  64.         <a href="#nativeapi" class="md-skip">

  65.           Skip to content

  66.         </a>

  67.       

  68.     </div>

  69.     <div data-md-component="announce">

  70.       

  71.     </div>

  72.     

  73.       <div data-md-color-scheme="default" data-md-component="outdated" hidden>

  74.         

  75.       </div>

  76.     

  77.     

  78.       

  79. 

  80.   

  81. 

  82. <header class="md-header md-header--shadow" data-md-component="header">

  83.   <nav class="md-header__inner md-grid" aria-label="Header">

  84.     <a href="../.." title="LLamaSharp Documentation" class="md-header__button md-logo" aria-label="LLamaSharp Documentation" data-md-component="logo">

  85.       

  86.   

  87.   <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 8a3 3 0 0 0 3-3 3 3 0 0 0-3-3 3 3 0 0 0-3 3 3 3 0 0 0 3 3m0 3.54C9.64 9.35 6.5 8 3 8v11c3.5 0 6.64 1.35 9 3.54 2.36-2.19 5.5-3.54 9-3.54V8c-3.5 0-6.64 1.35-9 3.54Z"/></svg>

  88. 

  89.     </a>

  90.     <label class="md-header__button md-icon" for="__drawer">

  91.       <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M3 6h18v2H3V6m0 5h18v2H3v-2m0 5h18v2H3v-2Z"/></svg>

  92.     </label>

  93.     <div class="md-header__title" data-md-component="header-title">

  94.       <div class="md-header__ellipsis">

  95.         <div class="md-header__topic">

  96.           <span class="md-ellipsis">

  97.             LLamaSharp Documentation

  98.           </span>

  99.         </div>

  100.         <div class="md-header__topic" data-md-component="header-topic">

  101.           <span class="md-ellipsis">

  102.             

  103.               llama.native.nativeapi

  104.             

  105.           </span>

  106.         </div>

  107.       </div>

  108.     </div>

  109.     

  110.     

  111.     

  112.       <label class="md-header__button md-icon" for="__search">

  113.         <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M9.5 3A6.5 6.5 0 0 1 16 9.5c0 1.61-.59 3.09-1.56 4.23l.27.27h.79l5 5-1.5 1.5-5-5v-.79l-.27-.27A6.516 6.516 0 0 1 9.5 16 6.5 6.5 0 0 1 3 9.5 6.5 6.5 0 0 1 9.5 3m0 2C7 5 5 7 5 9.5S7 14 9.5 14 14 12 14 9.5 12 5 9.5 5Z"/></svg>

  114.       </label>

  115.       <div class="md-search" data-md-component="search" role="dialog">

  116.   <label class="md-search__overlay" for="__search"></label>

  117.   <div class="md-search__inner" role="search">

  118.     <form class="md-search__form" name="search">

  119.       <input type="text" class="md-search__input" name="query" aria-label="Search" placeholder="Search" autocapitalize="off" autocorrect="off" autocomplete="off" spellcheck="false" data-md-component="search-query" required>

  120.       <label class="md-search__icon md-icon" for="__search">

  121.         <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M9.5 3A6.5 6.5 0 0 1 16 9.5c0 1.61-.59 3.09-1.56 4.23l.27.27h.79l5 5-1.5 1.5-5-5v-.79l-.27-.27A6.516 6.516 0 0 1 9.5 16 6.5 6.5 0 0 1 3 9.5 6.5 6.5 0 0 1 9.5 3m0 2C7 5 5 7 5 9.5S7 14 9.5 14 14 12 14 9.5 12 5 9.5 5Z"/></svg>

  122.         <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M20 11v2H8l5.5 5.5-1.42 1.42L4.16 12l7.92-7.92L13.5 5.5 8 11h12Z"/></svg>

  123.       </label>

  124.       <nav class="md-search__options" aria-label="Search">

  125.         

  126.         <button type="reset" class="md-search__icon md-icon" title="Clear" aria-label="Clear" tabindex="-1">

  127.           <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M19 6.41 17.59 5 12 10.59 6.41 5 5 6.41 10.59 12 5 17.59 6.41 19 12 13.41 17.59 19 19 17.59 13.41 12 19 6.41Z"/></svg>

  128.         </button>

  129.       </nav>

  130.       

  131.     </form>

  132.     <div class="md-search__output">

  133.       <div class="md-search__scrollwrap" data-md-scrollfix>

  134.         <div class="md-search-result" data-md-component="search-result">

  135.           <div class="md-search-result__meta">

  136.             Initializing search

  137.           </div>

  138.           <ol class="md-search-result__list" role="presentation"></ol>

  139.         </div>

  140.       </div>

  141.     </div>

  142.   </div>

  143. </div>

  144.     

  145.     

  146.   </nav>

  147.   

  148. </header>

  149.     

  150.     <div class="md-container" data-md-component="container">

  151.       

  152.       

  153.         

  154.           

  155.         

  156.       

  157.       <main class="md-main" data-md-component="main">

  158.         <div class="md-main__inner md-grid">

  159.           

  160.             

  161.               

  162.               <div class="md-sidebar md-sidebar--primary" data-md-component="sidebar" data-md-type="navigation" >

  163.                 <div class="md-sidebar__scrollwrap">

  164.                   <div class="md-sidebar__inner">

  165.                     

  166. 

  167. 

  168. <nav class="md-nav md-nav--primary" aria-label="Navigation" data-md-level="0">

  169.   <label class="md-nav__title" for="__drawer">

  170.     <a href="../.." title="LLamaSharp Documentation" class="md-nav__button md-logo" aria-label="LLamaSharp Documentation" data-md-component="logo">

  171.       

  172.   

  173.   <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 8a3 3 0 0 0 3-3 3 3 0 0 0-3-3 3 3 0 0 0-3 3 3 3 0 0 0 3 3m0 3.54C9.64 9.35 6.5 8 3 8v11c3.5 0 6.64 1.35 9 3.54 2.36-2.19 5.5-3.54 9-3.54V8c-3.5 0-6.64 1.35-9 3.54Z"/></svg>

  174. 

  175.     </a>

  176.     LLamaSharp Documentation

  177.   </label>

  178.   

  179.   <ul class="md-nav__list" data-md-scrollfix>

  180.     

  181.       

  182.       

  183.       

  184. 

  185.   

  186.   

  187.   

  188.     <li class="md-nav__item">

  189.       <a href="../.." class="md-nav__link">

  190.         Overview

  191.       </a>

  192.     </li>

  193.   

  194. 

  195.     

  196.       

  197.       

  198.       

  199. 

  200.   

  201.   

  202.   

  203.     <li class="md-nav__item">

  204.       <a href="../../GetStarted/" class="md-nav__link">

  205.         Get Started

  206.       </a>

  207.     </li>

  208.   

  209. 

  210.     

  211.       

  212.       

  213.       

  214. 

  215.   

  216.   

  217.   

  218.     <li class="md-nav__item">

  219.       <a href="../../Architecture/" class="md-nav__link">

  220.         Architecture

  221.       </a>

  222.     </li>

  223.   

  224. 

  225.     

  226.       

  227.       

  228.       

  229. 

  230.   

  231.   

  232.   

  233.     <li class="md-nav__item">

  234.       <a href="../../Tricks/" class="md-nav__link">

  235.         Tricks for FAQ

  236.       </a>

  237.     </li>

  238.   

  239. 

  240.     

  241.       

  242.       

  243.       

  244. 

  245.   

  246.   

  247.   

  248.     <li class="md-nav__item">

  249.       <a href="../../ContributingGuide/" class="md-nav__link">

  250.         Contributing Guide

  251.       </a>

  252.     </li>

  253.   

  254. 

  255.     

  256.       

  257.       

  258.       

  259. 

  260.   

  261.   

  262.   

  263.     

  264.     <li class="md-nav__item md-nav__item--nested">

  265.       

  266.       

  267.       

  268.       

  269.       <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_6" >

  270.       

  271.       

  272.       

  273.         <label class="md-nav__link" for="__nav_6" id="__nav_6_label" tabindex="0">

  274.           LLamaModel

  275.           <span class="md-nav__icon md-icon"></span>

  276.         </label>

  277.       

  278.       <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_6_label" aria-expanded="false">

  279.         <label class="md-nav__title" for="__nav_6">

  280.           <span class="md-nav__icon md-icon"></span>

  281.           LLamaModel

  282.         </label>

  283.         <ul class="md-nav__list" data-md-scrollfix>

  284.           

  285.             

  286.               

  287.   

  288.   

  289.   

  290.     <li class="md-nav__item">

  291.       <a href="../../LLamaModel/parameters/" class="md-nav__link">

  292.         Model Parameters

  293.       </a>

  294.     </li>

  295.   

  296. 

  297.             

  298.           

  299.             

  300.               

  301.   

  302.   

  303.   

  304.     <li class="md-nav__item">

  305.       <a href="../../LLamaModel/tokenization/" class="md-nav__link">

  306.         Tokenization

  307.       </a>

  308.     </li>

  309.   

  310. 

  311.             

  312.           

  313.             

  314.               

  315.   

  316.   

  317.   

  318.     <li class="md-nav__item">

  319.       <a href="../../LLamaModel/embeddings/" class="md-nav__link">

  320.         Get Embeddings

  321.       </a>

  322.     </li>

  323.   

  324. 

  325.             

  326.           

  327.             

  328.               

  329.   

  330.   

  331.   

  332.     <li class="md-nav__item">

  333.       <a href="../../LLamaModel/quantization/" class="md-nav__link">

  334.         Quantization

  335.       </a>

  336.     </li>

  337.   

  338. 

  339.             

  340.           

  341.             

  342.               

  343.   

  344.   

  345.   

  346.     <li class="md-nav__item">

  347.       <a href="../../LLamaModel/save-load-state/" class="md-nav__link">

  348.         Save/Load State

  349.       </a>

  350.     </li>

  351.   

  352. 

  353.             

  354.           

  355.         </ul>

  356.       </nav>

  357.     </li>

  358.   

  359. 

  360.     

  361.       

  362.       

  363.       

  364. 

  365.   

  366.   

  367.   

  368.     

  369.     <li class="md-nav__item md-nav__item--nested">

  370.       

  371.       

  372.       

  373.       

  374.       <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_7" >

  375.       

  376.       

  377.       

  378.         <label class="md-nav__link" for="__nav_7" id="__nav_7_label" tabindex="0">

  379.           LLamaExecutors

  380.           <span class="md-nav__icon md-icon"></span>

  381.         </label>

  382.       

  383.       <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_7_label" aria-expanded="false">

  384.         <label class="md-nav__title" for="__nav_7">

  385.           <span class="md-nav__icon md-icon"></span>

  386.           LLamaExecutors

  387.         </label>

  388.         <ul class="md-nav__list" data-md-scrollfix>

  389.           

  390.             

  391.               

  392.   

  393.   

  394.   

  395.     <li class="md-nav__item">

  396.       <a href="../../LLamaExecutors/parameters/" class="md-nav__link">

  397.         Inference Parameters

  398.       </a>

  399.     </li>

  400.   

  401. 

  402.             

  403.           

  404.             

  405.               

  406.   

  407.   

  408.   

  409.     <li class="md-nav__item">

  410.       <a href="../../LLamaExecutors/text-to-text-apis/" class="md-nav__link">

  411.         Text-to-Text APIs

  412.       </a>

  413.     </li>

  414.   

  415. 

  416.             

  417.           

  418.             

  419.               

  420.   

  421.   

  422.   

  423.     <li class="md-nav__item">

  424.       <a href="../../LLamaExecutors/save-load-state/" class="md-nav__link">

  425.         Save/Load State

  426.       </a>

  427.     </li>

  428.   

  429. 

  430.             

  431.           

  432.             

  433.               

  434.   

  435.   

  436.   

  437.     <li class="md-nav__item">

  438.       <a href="../../LLamaExecutors/differences/" class="md-nav__link">

  439.         Differences of Executors

  440.       </a>

  441.     </li>

  442.   

  443. 

  444.             

  445.           

  446.         </ul>

  447.       </nav>

  448.     </li>

  449.   

  450. 

  451.     

  452.       

  453.       

  454.       

  455. 

  456.   

  457.   

  458.   

  459.     

  460.     <li class="md-nav__item md-nav__item--nested">

  461.       

  462.       

  463.       

  464.       

  465.       <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_8" >

  466.       

  467.       

  468.       

  469.         <label class="md-nav__link" for="__nav_8" id="__nav_8_label" tabindex="0">

  470.           ChatSession

  471.           <span class="md-nav__icon md-icon"></span>

  472.         </label>

  473.       

  474.       <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_8_label" aria-expanded="false">

  475.         <label class="md-nav__title" for="__nav_8">

  476.           <span class="md-nav__icon md-icon"></span>

  477.           ChatSession

  478.         </label>

  479.         <ul class="md-nav__list" data-md-scrollfix>

  480.           

  481.             

  482.               

  483.   

  484.   

  485.   

  486.     <li class="md-nav__item">

  487.       <a href="../../ChatSession/basic-usages/" class="md-nav__link">

  488.         Basic Usages

  489.       </a>

  490.     </li>

  491.   

  492. 

  493.             

  494.           

  495.             

  496.               

  497.   

  498.   

  499.   

  500.     <li class="md-nav__item">

  501.       <a href="../../ChatSession/transforms/" class="md-nav__link">

  502.         Transoforms

  503.       </a>

  504.     </li>

  505.   

  506. 

  507.             

  508.           

  509.             

  510.               

  511.   

  512.   

  513.   

  514.     <li class="md-nav__item">

  515.       <a href="../../ChatSession/save-load-session/" class="md-nav__link">

  516.         Save/Load Session

  517.       </a>

  518.     </li>

  519.   

  520. 

  521.             

  522.           

  523.         </ul>

  524.       </nav>

  525.     </li>

  526.   

  527. 

  528.     

  529.       

  530.       

  531.       

  532. 

  533.   

  534.   

  535.   

  536.     

  537.     <li class="md-nav__item md-nav__item--nested">

  538.       

  539.       

  540.       

  541.       

  542.       <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_9" >

  543.       

  544.       

  545.       

  546.         <label class="md-nav__link" for="__nav_9" id="__nav_9_label" tabindex="0">

  547.           Non-English Usages

  548.           <span class="md-nav__icon md-icon"></span>

  549.         </label>

  550.       

  551.       <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_9_label" aria-expanded="false">

  552.         <label class="md-nav__title" for="__nav_9">

  553.           <span class="md-nav__icon md-icon"></span>

  554.           Non-English Usages

  555.         </label>

  556.         <ul class="md-nav__list" data-md-scrollfix>

  557.           

  558.             

  559.               

  560.   

  561.   

  562.   

  563.     <li class="md-nav__item">

  564.       <a href="../../NonEnglishUsage/Chinese/" class="md-nav__link">

  565.         Chinese

  566.       </a>

  567.     </li>

  568.   

  569. 

  570.             

  571.           

  572.         </ul>

  573.       </nav>

  574.     </li>

  575.   

  576. 

  577.     

  578.       

  579.       

  580.       

  581. 

  582.   

  583.   

  584.   

  585.     

  586.     <li class="md-nav__item md-nav__item--nested">

  587.       

  588.       

  589.       

  590.       

  591.       <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_10" >

  592.       

  593.       

  594.       

  595.         <label class="md-nav__link" for="__nav_10" id="__nav_10_label" tabindex="0">

  596.           High-level Applications

  597.           <span class="md-nav__icon md-icon"></span>

  598.         </label>

  599.       

  600.       <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_10_label" aria-expanded="false">

  601.         <label class="md-nav__title" for="__nav_10">

  602.           <span class="md-nav__icon md-icon"></span>

  603.           High-level Applications

  604.         </label>

  605.         <ul class="md-nav__list" data-md-scrollfix>

  606.           

  607.             

  608.               

  609.   

  610.   

  611.   

  612.     <li class="md-nav__item">

  613.       <a href="../../HighLevelApps/bot-sharp/" class="md-nav__link">

  614.         BotSharp

  615.       </a>

  616.     </li>

  617.   

  618. 

  619.             

  620.           

  621.         </ul>

  622.       </nav>

  623.     </li>

  624.   

  625. 

  626.     

  627.       

  628.       

  629.       

  630. 

  631.   

  632.   

  633.   

  634.     

  635.     <li class="md-nav__item md-nav__item--nested">

  636.       

  637.       

  638.       

  639.       

  640.       <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_11" >

  641.       

  642.       

  643.       

  644.         <label class="md-nav__link" for="__nav_11" id="__nav_11_label" tabindex="0">

  645.           More

  646.           <span class="md-nav__icon md-icon"></span>

  647.         </label>

  648.       

  649.       <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_11_label" aria-expanded="false">

  650.         <label class="md-nav__title" for="__nav_11">

  651.           <span class="md-nav__icon md-icon"></span>

  652.           More

  653.         </label>

  654.         <ul class="md-nav__list" data-md-scrollfix>

  655.           

  656.             

  657.               

  658.   

  659.   

  660.   

  661.     <li class="md-nav__item">

  662.       <a href="../../More/log/" class="md-nav__link">

  663.         Logger

  664.       </a>

  665.     </li>

  666.   

  667. 

  668.             

  669.           

  670.         </ul>

  671.       </nav>

  672.     </li>

  673.   

  674. 

  675.     

  676.       

  677.       

  678.       

  679. 

  680.   

  681.   

  682.   

  683.     

  684.     <li class="md-nav__item md-nav__item--nested">

  685.       

  686.       

  687.       

  688.       

  689.       <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_12" >

  690.       

  691.       

  692.       

  693.         <label class="md-nav__link" for="__nav_12" id="__nav_12_label" tabindex="0">

  694.           Examples

  695.           <span class="md-nav__icon md-icon"></span>

  696.         </label>

  697.       

  698.       <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_12_label" aria-expanded="false">

  699.         <label class="md-nav__title" for="__nav_12">

  700.           <span class="md-nav__icon md-icon"></span>

  701.           Examples

  702.         </label>

  703.         <ul class="md-nav__list" data-md-scrollfix>

  704.           

  705.             

  706.               

  707.   

  708.   

  709.   

  710.     <li class="md-nav__item">

  711.       <a href="../../Examples/ChatSessionStripRoleName/" class="md-nav__link">

  712.         Chat session 1

  713.       </a>

  714.     </li>

  715.   

  716. 

  717.             

  718.           

  719.             

  720.               

  721.   

  722.   

  723.   

  724.     <li class="md-nav__item">

  725.       <a href="../../Examples/ChatSessionWithRoleName/" class="md-nav__link">

  726.         Chat session 2

  727.       </a>

  728.     </li>

  729.   

  730. 

  731.             

  732.           

  733.             

  734.               

  735.   

  736.   

  737.   

  738.     <li class="md-nav__item">

  739.       <a href="../../Examples/GetEmbeddings/" class="md-nav__link">

  740.         Get embeddings

  741.       </a>

  742.     </li>

  743.   

  744. 

  745.             

  746.           

  747.             

  748.               

  749.   

  750.   

  751.   

  752.     <li class="md-nav__item">

  753.       <a href="../../Examples/InstructModeExecute/" class="md-nav__link">

  754.         Instruct executor

  755.       </a>

  756.     </li>

  757.   

  758. 

  759.             

  760.           

  761.             

  762.               

  763.   

  764.   

  765.   

  766.     <li class="md-nav__item">

  767.       <a href="../../Examples/InteractiveModeExecute/" class="md-nav__link">

  768.         Interactive executor

  769.       </a>

  770.     </li>

  771.   

  772. 

  773.             

  774.           

  775.             

  776.               

  777.   

  778.   

  779.   

  780.     <li class="md-nav__item">

  781.       <a href="../../Examples/StatelessModeExecute/" class="md-nav__link">

  782.         Stateless exeutor

  783.       </a>

  784.     </li>

  785.   

  786. 

  787.             

  788.           

  789.             

  790.               

  791.   

  792.   

  793.   

  794.     <li class="md-nav__item">

  795.       <a href="../../Examples/LoadAndSaveSession/" class="md-nav__link">

  796.         Load/Save session

  797.       </a>

  798.     </li>

  799.   

  800. 

  801.             

  802.           

  803.             

  804.               

  805.   

  806.   

  807.   

  808.     <li class="md-nav__item">

  809.       <a href="../../Examples/LoadAndSaveState/" class="md-nav__link">

  810.         Load/Save state

  811.       </a>

  812.     </li>

  813.   

  814. 

  815.             

  816.           

  817.             

  818.               

  819.   

  820.   

  821.   

  822.     <li class="md-nav__item">

  823.       <a href="../../Examples/QuantizeModel/" class="md-nav__link">

  824.         Quantize model

  825.       </a>

  826.     </li>

  827.   

  828. 

  829.             

  830.           

  831.         </ul>

  832.       </nav>

  833.     </li>

  834.   

  835. 

  836.     

  837.       

  838.       

  839.       

  840. 

  841.   

  842.   

  843.     

  844.   

  845.   

  846.     

  847.     <li class="md-nav__item md-nav__item--active md-nav__item--nested">

  848.       

  849.       

  850.       

  851.       

  852.       <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_13" checked>

  853.       

  854.       

  855.       

  856.         <label class="md-nav__link" for="__nav_13" id="__nav_13_label" tabindex="0">

  857.           API Reference

  858.           <span class="md-nav__icon md-icon"></span>

  859.         </label>

  860.       

  861.       <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_13_label" aria-expanded="true">

  862.         <label class="md-nav__title" for="__nav_13">

  863.           <span class="md-nav__icon md-icon"></span>

  864.           API Reference

  865.         </label>

  866.         <ul class="md-nav__list" data-md-scrollfix>

  867.           

  868.             

  869.               

  870.   

  871.   

  872.   

  873.     <li class="md-nav__item">

  874.       <a href="../" class="md-nav__link">

  875.         index

  876.       </a>

  877.     </li>

  878.   

  879. 

  880.             

  881.           

  882.             

  883.               

  884.   

  885.   

  886.   

  887.     <li class="md-nav__item">

  888.       <a href="../llama.abstractions.ihistorytransform/" class="md-nav__link">

  889.         llama.abstractions.ihistorytransform

  890.       </a>

  891.     </li>

  892.   

  893. 

  894.             

  895.           

  896.             

  897.               

  898.   

  899.   

  900.   

  901.     <li class="md-nav__item">

  902.       <a href="../llama.abstractions.illamaexecutor/" class="md-nav__link">

  903.         llama.abstractions.illamaexecutor

  904.       </a>

  905.     </li>

  906.   

  907. 

  908.             

  909.           

  910.             

  911.               

  912.   

  913.   

  914.   

  915.     <li class="md-nav__item">

  916.       <a href="../llama.abstractions.itextstreamtransform/" class="md-nav__link">

  917.         llama.abstractions.itextstreamtransform

  918.       </a>

  919.     </li>

  920.   

  921. 

  922.             

  923.           

  924.             

  925.               

  926.   

  927.   

  928.   

  929.     <li class="md-nav__item">

  930.       <a href="../llama.abstractions.itexttransform/" class="md-nav__link">

  931.         llama.abstractions.itexttransform

  932.       </a>

  933.     </li>

  934.   

  935. 

  936.             

  937.           

  938.             

  939.               

  940.   

  941.   

  942.   

  943.     <li class="md-nav__item">

  944.       <a href="../llama.chatsession/" class="md-nav__link">

  945.         llama.chatsession

  946.       </a>

  947.     </li>

  948.   

  949. 

  950.             

  951.           

  952.             

  953.               

  954.   

  955.   

  956.   

  957.     <li class="md-nav__item">

  958.       <a href="../llama.common.authorrole/" class="md-nav__link">

  959.         llama.common.authorrole

  960.       </a>

  961.     </li>

  962.   

  963. 

  964.             

  965.           

  966.             

  967.               

  968.   

  969.   

  970.   

  971.     <li class="md-nav__item">

  972.       <a href="../llama.common.chathistory/" class="md-nav__link">

  973.         llama.common.chathistory

  974.       </a>

  975.     </li>

  976.   

  977. 

  978.             

  979.           

  980.             

  981.               

  982.   

  983.   

  984.   

  985.     <li class="md-nav__item">

  986.       <a href="../llama.common.fixedsizequeue-1/" class="md-nav__link">

  987.         llama.common.fixedsizequeue-1

  988.       </a>

  989.     </li>

  990.   

  991. 

  992.             

  993.           

  994.             

  995.               

  996.   

  997.   

  998.   

  999.     <li class="md-nav__item">

  1000.       <a href="../llama.common.illamalogger/" class="md-nav__link">

  1001.         llama.common.illamalogger

  1002.       </a>

  1003.     </li>

  1004.   

  1005. 

  1006.             

  1007.           

  1008.             

  1009.               

  1010.   

  1011.   

  1012.   

  1013.     <li class="md-nav__item">

  1014.       <a href="../llama.common.inferenceparams/" class="md-nav__link">

  1015.         llama.common.inferenceparams

  1016.       </a>

  1017.     </li>

  1018.   

  1019. 

  1020.             

  1021.           

  1022.             

  1023.               

  1024.   

  1025.   

  1026.   

  1027.     <li class="md-nav__item">

  1028.       <a href="../llama.common.llamadefaultlogger/" class="md-nav__link">

  1029.         llama.common.llamadefaultlogger

  1030.       </a>

  1031.     </li>

  1032.   

  1033. 

  1034.             

  1035.           

  1036.             

  1037.               

  1038.   

  1039.   

  1040.   

  1041.     <li class="md-nav__item">

  1042.       <a href="../llama.common.mirostatetype/" class="md-nav__link">

  1043.         llama.common.mirostatetype

  1044.       </a>

  1045.     </li>

  1046.   

  1047. 

  1048.             

  1049.           

  1050.             

  1051.               

  1052.   

  1053.   

  1054.   

  1055.     <li class="md-nav__item">

  1056.       <a href="../llama.common.modelparams/" class="md-nav__link">

  1057.         llama.common.modelparams

  1058.       </a>

  1059.     </li>

  1060.   

  1061. 

  1062.             

  1063.           

  1064.             

  1065.               

  1066.   

  1067.   

  1068.   

  1069.     <li class="md-nav__item">

  1070.       <a href="../llama.exceptions.runtimeerror/" class="md-nav__link">

  1071.         llama.exceptions.runtimeerror

  1072.       </a>

  1073.     </li>

  1074.   

  1075. 

  1076.             

  1077.           

  1078.             

  1079.               

  1080.   

  1081.   

  1082.   

  1083.     <li class="md-nav__item">

  1084.       <a href="../llama.extensions.dictionaryextension/" class="md-nav__link">

  1085.         llama.extensions.dictionaryextension

  1086.       </a>

  1087.     </li>

  1088.   

  1089. 

  1090.             

  1091.           

  1092.             

  1093.               

  1094.   

  1095.   

  1096.   

  1097.     <li class="md-nav__item">

  1098.       <a href="../llama.instructexecutor/" class="md-nav__link">

  1099.         llama.instructexecutor

  1100.       </a>

  1101.     </li>

  1102.   

  1103. 

  1104.             

  1105.           

  1106.             

  1107.               

  1108.   

  1109.   

  1110.   

  1111.     <li class="md-nav__item">

  1112.       <a href="../llama.interactiveexecutor/" class="md-nav__link">

  1113.         llama.interactiveexecutor

  1114.       </a>

  1115.     </li>

  1116.   

  1117. 

  1118.             

  1119.           

  1120.             

  1121.               

  1122.   

  1123.   

  1124.   

  1125.     <li class="md-nav__item">

  1126.       <a href="../llama.llamaembedder/" class="md-nav__link">

  1127.         llama.llamaembedder

  1128.       </a>

  1129.     </li>

  1130.   

  1131. 

  1132.             

  1133.           

  1134.             

  1135.               

  1136.   

  1137.   

  1138.   

  1139.     <li class="md-nav__item">

  1140.       <a href="../llama.llamamodel/" class="md-nav__link">

  1141.         llama.llamamodel

  1142.       </a>

  1143.     </li>

  1144.   

  1145. 

  1146.             

  1147.           

  1148.             

  1149.               

  1150.   

  1151.   

  1152.   

  1153.     <li class="md-nav__item">

  1154.       <a href="../llama.llamaquantizer/" class="md-nav__link">

  1155.         llama.llamaquantizer

  1156.       </a>

  1157.     </li>

  1158.   

  1159. 

  1160.             

  1161.           

  1162.             

  1163.               

  1164.   

  1165.   

  1166.   

  1167.     <li class="md-nav__item">

  1168.       <a href="../llama.llamatransforms/" class="md-nav__link">

  1169.         llama.llamatransforms

  1170.       </a>

  1171.     </li>

  1172.   

  1173. 

  1174.             

  1175.           

  1176.             

  1177.               

  1178.   

  1179.   

  1180.   

  1181.     <li class="md-nav__item">

  1182.       <a href="../llama.native.llamacontextparams/" class="md-nav__link">

  1183.         llama.native.llamacontextparams

  1184.       </a>

  1185.     </li>

  1186.   

  1187. 

  1188.             

  1189.           

  1190.             

  1191.               

  1192.   

  1193.   

  1194.   

  1195.     <li class="md-nav__item">

  1196.       <a href="../llama.native.llamaftype/" class="md-nav__link">

  1197.         llama.native.llamaftype

  1198.       </a>

  1199.     </li>

  1200.   

  1201. 

  1202.             

  1203.           

  1204.             

  1205.               

  1206.   

  1207.   

  1208.   

  1209.     <li class="md-nav__item">

  1210.       <a href="../llama.native.llamatokendata/" class="md-nav__link">

  1211.         llama.native.llamatokendata

  1212.       </a>

  1213.     </li>

  1214.   

  1215. 

  1216.             

  1217.           

  1218.             

  1219.               

  1220.   

  1221.   

  1222.   

  1223.     <li class="md-nav__item">

  1224.       <a href="../llama.native.llamatokendataarray/" class="md-nav__link">

  1225.         llama.native.llamatokendataarray

  1226.       </a>

  1227.     </li>

  1228.   

  1229. 

  1230.             

  1231.           

  1232.             

  1233.               

  1234.   

  1235.   

  1236.   

  1237.     <li class="md-nav__item">

  1238.       <a href="../llama.native.llamatokendataarraynative/" class="md-nav__link">

  1239.         llama.native.llamatokendataarraynative

  1240.       </a>

  1241.     </li>

  1242.   

  1243. 

  1244.             

  1245.           

  1246.             

  1247.               

  1248.   

  1249.   

  1250.     

  1251.   

  1252.   

  1253.     <li class="md-nav__item md-nav__item--active">

  1254.       

  1255.       <input class="md-nav__toggle md-toggle" type="checkbox" id="__toc">

  1256.       

  1257.       

  1258.         

  1259.       

  1260.       

  1261.         <label class="md-nav__link md-nav__link--active" for="__toc">

  1262.           llama.native.nativeapi

  1263.           <span class="md-nav__icon md-icon"></span>

  1264.         </label>

  1265.       

  1266.       <a href="./" class="md-nav__link md-nav__link--active">

  1267.         llama.native.nativeapi

  1268.       </a>

  1269.       

  1270.         

  1271. 

  1272. <nav class="md-nav md-nav--secondary" aria-label="Table of contents">

  1273.   

  1274.   

  1275.   

  1276.     

  1277.   

  1278.   

  1279.     <label class="md-nav__title" for="__toc">

  1280.       <span class="md-nav__icon md-icon"></span>

  1281.       Table of contents

  1282.     </label>

  1283.     <ul class="md-nav__list" data-md-component="toc" data-md-scrollfix>

  1284.       

  1285.         <li class="md-nav__item">

  1286.   <a href="#constructors" class="md-nav__link">

  1287.     Constructors

  1288.   </a>

  1289.   

  1290.     <nav class="md-nav" aria-label="Constructors">

  1291.       <ul class="md-nav__list">

  1292.         

  1293.           <li class="md-nav__item">

  1294.   <a href="#nativeapi_1" class="md-nav__link">

  1295.     NativeApi()

  1296.   </a>

  1297.   

  1298. </li>

  1299.         

  1300.       </ul>

  1301.     </nav>

  1302.   

  1303. </li>

  1304.       

  1305.         <li class="md-nav__item">

  1306.   <a href="#methods" class="md-nav__link">

  1307.     Methods

  1308.   </a>

  1309.   

  1310.     <nav class="md-nav" aria-label="Methods">

  1311.       <ul class="md-nav__list">

  1312.         

  1313.           <li class="md-nav__item">

  1314.   <a href="#llama_print_timingssafellamacontexthandle" class="md-nav__link">

  1315.     llama_print_timings(SafeLLamaContextHandle)

  1316.   </a>

  1317.   

  1318.     <nav class="md-nav" aria-label="llama_print_timings(SafeLLamaContextHandle)">

  1319.       <ul class="md-nav__list">

  1320.         

  1321.           <li class="md-nav__item">

  1322.   <a href="#parameters" class="md-nav__link">

  1323.     Parameters

  1324.   </a>

  1325.   

  1326. </li>

  1327.         

  1328.       </ul>

  1329.     </nav>

  1330.   

  1331. </li>

  1332.         

  1333.           <li class="md-nav__item">

  1334.   <a href="#llama_reset_timingssafellamacontexthandle" class="md-nav__link">

  1335.     llama_reset_timings(SafeLLamaContextHandle)

  1336.   </a>

  1337.   

  1338.     <nav class="md-nav" aria-label="llama_reset_timings(SafeLLamaContextHandle)">

  1339.       <ul class="md-nav__list">

  1340.         

  1341.           <li class="md-nav__item">

  1342.   <a href="#parameters_1" class="md-nav__link">

  1343.     Parameters

  1344.   </a>

  1345.   

  1346. </li>

  1347.         

  1348.       </ul>

  1349.     </nav>

  1350.   

  1351. </li>

  1352.         

  1353.           <li class="md-nav__item">

  1354.   <a href="#llama_print_system_info" class="md-nav__link">

  1355.     llama_print_system_info()

  1356.   </a>

  1357.   

  1358.     <nav class="md-nav" aria-label="llama_print_system_info()">

  1359.       <ul class="md-nav__list">

  1360.         

  1361.           <li class="md-nav__item">

  1362.   <a href="#returns" class="md-nav__link">

  1363.     Returns

  1364.   </a>

  1365.   

  1366. </li>

  1367.         

  1368.       </ul>

  1369.     </nav>

  1370.   

  1371. </li>

  1372.         

  1373.           <li class="md-nav__item">

  1374.   <a href="#llama_model_quantizestring-string-llamaftype-int32" class="md-nav__link">

  1375.     llama_model_quantize(String, String, LLamaFtype, Int32)

  1376.   </a>

  1377.   

  1378.     <nav class="md-nav" aria-label="llama_model_quantize(String, String, LLamaFtype, Int32)">

  1379.       <ul class="md-nav__list">

  1380.         

  1381.           <li class="md-nav__item">

  1382.   <a href="#parameters_2" class="md-nav__link">

  1383.     Parameters

  1384.   </a>

  1385.   

  1386. </li>

  1387.         

  1388.           <li class="md-nav__item">

  1389.   <a href="#returns_1" class="md-nav__link">

  1390.     Returns

  1391.   </a>

  1392.   

  1393. </li>

  1394.         

  1395.       </ul>

  1396.     </nav>

  1397.   

  1398. </li>

  1399.         

  1400.           <li class="md-nav__item">

  1401.   <a href="#llama_sample_repetition_penaltysafellamacontexthandle-intptr-int32-uint64-single" class="md-nav__link">

  1402.     llama_sample_repetition_penalty(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single)

  1403.   </a>

  1404.   

  1405.     <nav class="md-nav" aria-label="llama_sample_repetition_penalty(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single)">

  1406.       <ul class="md-nav__list">

  1407.         

  1408.           <li class="md-nav__item">

  1409.   <a href="#parameters_3" class="md-nav__link">

  1410.     Parameters

  1411.   </a>

  1412.   

  1413. </li>

  1414.         

  1415.       </ul>

  1416.     </nav>

  1417.   

  1418. </li>

  1419.         

  1420.           <li class="md-nav__item">

  1421.   <a href="#llama_sample_frequency_and_presence_penaltiessafellamacontexthandle-intptr-int32-uint64-single-single" class="md-nav__link">

  1422.     llama_sample_frequency_and_presence_penalties(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single, Single)

  1423.   </a>

  1424.   

  1425.     <nav class="md-nav" aria-label="llama_sample_frequency_and_presence_penalties(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single, Single)">

  1426.       <ul class="md-nav__list">

  1427.         

  1428.           <li class="md-nav__item">

  1429.   <a href="#parameters_4" class="md-nav__link">

  1430.     Parameters

  1431.   </a>

  1432.   

  1433. </li>

  1434.         

  1435.       </ul>

  1436.     </nav>

  1437.   

  1438. </li>

  1439.         

  1440.           <li class="md-nav__item">

  1441.   <a href="#llama_sample_softmaxsafellamacontexthandle-intptr" class="md-nav__link">

  1442.     llama_sample_softmax(SafeLLamaContextHandle, IntPtr)

  1443.   </a>

  1444.   

  1445.     <nav class="md-nav" aria-label="llama_sample_softmax(SafeLLamaContextHandle, IntPtr)">

  1446.       <ul class="md-nav__list">

  1447.         

  1448.           <li class="md-nav__item">

  1449.   <a href="#parameters_5" class="md-nav__link">

  1450.     Parameters

  1451.   </a>

  1452.   

  1453. </li>

  1454.         

  1455.       </ul>

  1456.     </nav>

  1457.   

  1458. </li>

  1459.         

  1460.           <li class="md-nav__item">

  1461.   <a href="#llama_sample_top_ksafellamacontexthandle-intptr-int32-uint64" class="md-nav__link">

  1462.     llama_sample_top_k(SafeLLamaContextHandle, IntPtr, Int32, UInt64)

  1463.   </a>

  1464.   

  1465.     <nav class="md-nav" aria-label="llama_sample_top_k(SafeLLamaContextHandle, IntPtr, Int32, UInt64)">

  1466.       <ul class="md-nav__list">

  1467.         

  1468.           <li class="md-nav__item">

  1469.   <a href="#parameters_6" class="md-nav__link">

  1470.     Parameters

  1471.   </a>

  1472.   

  1473. </li>

  1474.         

  1475.       </ul>

  1476.     </nav>

  1477.   

  1478. </li>

  1479.         

  1480.           <li class="md-nav__item">

  1481.   <a href="#llama_sample_top_psafellamacontexthandle-intptr-single-uint64" class="md-nav__link">

  1482.     llama_sample_top_p(SafeLLamaContextHandle, IntPtr, Single, UInt64)

  1483.   </a>

  1484.   

  1485.     <nav class="md-nav" aria-label="llama_sample_top_p(SafeLLamaContextHandle, IntPtr, Single, UInt64)">

  1486.       <ul class="md-nav__list">

  1487.         

  1488.           <li class="md-nav__item">

  1489.   <a href="#parameters_7" class="md-nav__link">

  1490.     Parameters

  1491.   </a>

  1492.   

  1493. </li>

  1494.         

  1495.       </ul>

  1496.     </nav>

  1497.   

  1498. </li>

  1499.         

  1500.           <li class="md-nav__item">

  1501.   <a href="#llama_sample_tail_freesafellamacontexthandle-intptr-single-uint64" class="md-nav__link">

  1502.     llama_sample_tail_free(SafeLLamaContextHandle, IntPtr, Single, UInt64)

  1503.   </a>

  1504.   

  1505.     <nav class="md-nav" aria-label="llama_sample_tail_free(SafeLLamaContextHandle, IntPtr, Single, UInt64)">

  1506.       <ul class="md-nav__list">

  1507.         

  1508.           <li class="md-nav__item">

  1509.   <a href="#parameters_8" class="md-nav__link">

  1510.     Parameters

  1511.   </a>

  1512.   

  1513. </li>

  1514.         

  1515.       </ul>

  1516.     </nav>

  1517.   

  1518. </li>

  1519.         

  1520.           <li class="md-nav__item">

  1521.   <a href="#llama_sample_typicalsafellamacontexthandle-intptr-single-uint64" class="md-nav__link">

  1522.     llama_sample_typical(SafeLLamaContextHandle, IntPtr, Single, UInt64)

  1523.   </a>

  1524.   

  1525.     <nav class="md-nav" aria-label="llama_sample_typical(SafeLLamaContextHandle, IntPtr, Single, UInt64)">

  1526.       <ul class="md-nav__list">

  1527.         

  1528.           <li class="md-nav__item">

  1529.   <a href="#parameters_9" class="md-nav__link">

  1530.     Parameters

  1531.   </a>

  1532.   

  1533. </li>

  1534.         

  1535.       </ul>

  1536.     </nav>

  1537.   

  1538. </li>

  1539.         

  1540.           <li class="md-nav__item">

  1541.   <a href="#llama_sample_temperaturesafellamacontexthandle-intptr-single" class="md-nav__link">

  1542.     llama_sample_temperature(SafeLLamaContextHandle, IntPtr, Single)

  1543.   </a>

  1544.   

  1545.     <nav class="md-nav" aria-label="llama_sample_temperature(SafeLLamaContextHandle, IntPtr, Single)">

  1546.       <ul class="md-nav__list">

  1547.         

  1548.           <li class="md-nav__item">

  1549.   <a href="#parameters_10" class="md-nav__link">

  1550.     Parameters

  1551.   </a>

  1552.   

  1553. </li>

  1554.         

  1555.       </ul>

  1556.     </nav>

  1557.   

  1558. </li>

  1559.         

  1560.           <li class="md-nav__item">

  1561.   <a href="#llama_sample_token_mirostatsafellamacontexthandle-intptr-single-single-int32-single" class="md-nav__link">

  1562.     llama_sample_token_mirostat(SafeLLamaContextHandle, IntPtr, Single, Single, Int32, Single*)

  1563.   </a>

  1564.   

  1565.     <nav class="md-nav" aria-label="llama_sample_token_mirostat(SafeLLamaContextHandle, IntPtr, Single, Single, Int32, Single*)">

  1566.       <ul class="md-nav__list">

  1567.         

  1568.           <li class="md-nav__item">

  1569.   <a href="#parameters_11" class="md-nav__link">

  1570.     Parameters

  1571.   </a>

  1572.   

  1573. </li>

  1574.         

  1575.           <li class="md-nav__item">

  1576.   <a href="#returns_2" class="md-nav__link">

  1577.     Returns

  1578.   </a>

  1579.   

  1580. </li>

  1581.         

  1582.       </ul>

  1583.     </nav>

  1584.   

  1585. </li>

  1586.         

  1587.           <li class="md-nav__item">

  1588.   <a href="#llama_sample_token_mirostat_v2safellamacontexthandle-intptr-single-single-single" class="md-nav__link">

  1589.     llama_sample_token_mirostat_v2(SafeLLamaContextHandle, IntPtr, Single, Single, Single*)

  1590.   </a>

  1591.   

  1592.     <nav class="md-nav" aria-label="llama_sample_token_mirostat_v2(SafeLLamaContextHandle, IntPtr, Single, Single, Single*)">

  1593.       <ul class="md-nav__list">

  1594.         

  1595.           <li class="md-nav__item">

  1596.   <a href="#parameters_12" class="md-nav__link">

  1597.     Parameters

  1598.   </a>

  1599.   

  1600. </li>

  1601.         

  1602.           <li class="md-nav__item">

  1603.   <a href="#returns_3" class="md-nav__link">

  1604.     Returns

  1605.   </a>

  1606.   

  1607. </li>

  1608.         

  1609.       </ul>

  1610.     </nav>

  1611.   

  1612. </li>

  1613.         

  1614.           <li class="md-nav__item">

  1615.   <a href="#llama_sample_token_greedysafellamacontexthandle-intptr" class="md-nav__link">

  1616.     llama_sample_token_greedy(SafeLLamaContextHandle, IntPtr)

  1617.   </a>

  1618.   

  1619.     <nav class="md-nav" aria-label="llama_sample_token_greedy(SafeLLamaContextHandle, IntPtr)">

  1620.       <ul class="md-nav__list">

  1621.         

  1622.           <li class="md-nav__item">

  1623.   <a href="#parameters_13" class="md-nav__link">

  1624.     Parameters

  1625.   </a>

  1626.   

  1627. </li>

  1628.         

  1629.           <li class="md-nav__item">

  1630.   <a href="#returns_4" class="md-nav__link">

  1631.     Returns

  1632.   </a>

  1633.   

  1634. </li>

  1635.         

  1636.       </ul>

  1637.     </nav>

  1638.   

  1639. </li>

  1640.         

  1641.           <li class="md-nav__item">

  1642.   <a href="#llama_sample_tokensafellamacontexthandle-intptr" class="md-nav__link">

  1643.     llama_sample_token(SafeLLamaContextHandle, IntPtr)

  1644.   </a>

  1645.   

  1646.     <nav class="md-nav" aria-label="llama_sample_token(SafeLLamaContextHandle, IntPtr)">

  1647.       <ul class="md-nav__list">

  1648.         

  1649.           <li class="md-nav__item">

  1650.   <a href="#parameters_14" class="md-nav__link">

  1651.     Parameters

  1652.   </a>

  1653.   

  1654. </li>

  1655.         

  1656.           <li class="md-nav__item">

  1657.   <a href="#returns_5" class="md-nav__link">

  1658.     Returns

  1659.   </a>

  1660.   

  1661. </li>

  1662.         

  1663.       </ul>

  1664.     </nav>

  1665.   

  1666. </li>

  1667.         

  1668.           <li class="md-nav__item">

  1669.   <a href="#llama_empty_call" class="md-nav__link">

  1670.     llama_empty_call()

  1671.   </a>

  1672.   

  1673.     <nav class="md-nav" aria-label="llama_empty_call()">

  1674.       <ul class="md-nav__list">

  1675.         

  1676.           <li class="md-nav__item">

  1677.   <a href="#returns_6" class="md-nav__link">

  1678.     Returns

  1679.   </a>

  1680.   

  1681. </li>

  1682.         

  1683.       </ul>

  1684.     </nav>

  1685.   

  1686. </li>

  1687.         

  1688.           <li class="md-nav__item">

  1689.   <a href="#llama_context_default_params" class="md-nav__link">

  1690.     llama_context_default_params()

  1691.   </a>

  1692.   

  1693.     <nav class="md-nav" aria-label="llama_context_default_params()">

  1694.       <ul class="md-nav__list">

  1695.         

  1696.           <li class="md-nav__item">

  1697.   <a href="#returns_7" class="md-nav__link">

  1698.     Returns

  1699.   </a>

  1700.   

  1701. </li>

  1702.         

  1703.       </ul>

  1704.     </nav>

  1705.   

  1706. </li>

  1707.         

  1708.           <li class="md-nav__item">

  1709.   <a href="#llama_mmap_supported" class="md-nav__link">

  1710.     llama_mmap_supported()

  1711.   </a>

  1712.   

  1713.     <nav class="md-nav" aria-label="llama_mmap_supported()">

  1714.       <ul class="md-nav__list">

  1715.         

  1716.           <li class="md-nav__item">

  1717.   <a href="#returns_8" class="md-nav__link">

  1718.     Returns

  1719.   </a>

  1720.   

  1721. </li>

  1722.         

  1723.       </ul>

  1724.     </nav>

  1725.   

  1726. </li>

  1727.         

  1728.           <li class="md-nav__item">

  1729.   <a href="#llama_mlock_supported" class="md-nav__link">

  1730.     llama_mlock_supported()

  1731.   </a>

  1732.   

  1733.     <nav class="md-nav" aria-label="llama_mlock_supported()">

  1734.       <ul class="md-nav__list">

  1735.         

  1736.           <li class="md-nav__item">

  1737.   <a href="#returns_9" class="md-nav__link">

  1738.     Returns

  1739.   </a>

  1740.   

  1741. </li>

  1742.         

  1743.       </ul>

  1744.     </nav>

  1745.   

  1746. </li>

  1747.         

  1748.           <li class="md-nav__item">

  1749.   <a href="#llama_init_from_filestring-llamacontextparams" class="md-nav__link">

  1750.     llama_init_from_file(String, LLamaContextParams)

  1751.   </a>

  1752.   

  1753.     <nav class="md-nav" aria-label="llama_init_from_file(String, LLamaContextParams)">

  1754.       <ul class="md-nav__list">

  1755.         

  1756.           <li class="md-nav__item">

  1757.   <a href="#parameters_15" class="md-nav__link">

  1758.     Parameters

  1759.   </a>

  1760.   

  1761. </li>

  1762.         

  1763.           <li class="md-nav__item">

  1764.   <a href="#returns_10" class="md-nav__link">

  1765.     Returns

  1766.   </a>

  1767.   

  1768. </li>

  1769.         

  1770.       </ul>

  1771.     </nav>

  1772.   

  1773. </li>

  1774.         

  1775.           <li class="md-nav__item">

  1776.   <a href="#llama_init_backend" class="md-nav__link">

  1777.     llama_init_backend()

  1778.   </a>

  1779.   

  1780. </li>

  1781.         

  1782.           <li class="md-nav__item">

  1783.   <a href="#llama_freeintptr" class="md-nav__link">

  1784.     llama_free(IntPtr)

  1785.   </a>

  1786.   

  1787.     <nav class="md-nav" aria-label="llama_free(IntPtr)">

  1788.       <ul class="md-nav__list">

  1789.         

  1790.           <li class="md-nav__item">

  1791.   <a href="#parameters_16" class="md-nav__link">

  1792.     Parameters

  1793.   </a>

  1794.   

  1795. </li>

  1796.         

  1797.       </ul>

  1798.     </nav>

  1799.   

  1800. </li>

  1801.         

  1802.           <li class="md-nav__item">

  1803.   <a href="#llama_apply_lora_from_filesafellamacontexthandle-string-string-int32" class="md-nav__link">

  1804.     llama_apply_lora_from_file(SafeLLamaContextHandle, String, String, Int32)

  1805.   </a>

  1806.   

  1807.     <nav class="md-nav" aria-label="llama_apply_lora_from_file(SafeLLamaContextHandle, String, String, Int32)">

  1808.       <ul class="md-nav__list">

  1809.         

  1810.           <li class="md-nav__item">

  1811.   <a href="#parameters_17" class="md-nav__link">

  1812.     Parameters

  1813.   </a>

  1814.   

  1815. </li>

  1816.         

  1817.           <li class="md-nav__item">

  1818.   <a href="#returns_11" class="md-nav__link">

  1819.     Returns

  1820.   </a>

  1821.   

  1822. </li>

  1823.         

  1824.       </ul>

  1825.     </nav>

  1826.   

  1827. </li>

  1828.         

  1829.           <li class="md-nav__item">

  1830.   <a href="#llama_get_kv_cache_token_countsafellamacontexthandle" class="md-nav__link">

  1831.     llama_get_kv_cache_token_count(SafeLLamaContextHandle)

  1832.   </a>

  1833.   

  1834.     <nav class="md-nav" aria-label="llama_get_kv_cache_token_count(SafeLLamaContextHandle)">

  1835.       <ul class="md-nav__list">

  1836.         

  1837.           <li class="md-nav__item">

  1838.   <a href="#parameters_18" class="md-nav__link">

  1839.     Parameters

  1840.   </a>

  1841.   

  1842. </li>

  1843.         

  1844.           <li class="md-nav__item">

  1845.   <a href="#returns_12" class="md-nav__link">

  1846.     Returns

  1847.   </a>

  1848.   

  1849. </li>

  1850.         

  1851.       </ul>

  1852.     </nav>

  1853.   

  1854. </li>

  1855.         

  1856.           <li class="md-nav__item">

  1857.   <a href="#llama_set_rng_seedsafellamacontexthandle-int32" class="md-nav__link">

  1858.     llama_set_rng_seed(SafeLLamaContextHandle, Int32)

  1859.   </a>

  1860.   

  1861.     <nav class="md-nav" aria-label="llama_set_rng_seed(SafeLLamaContextHandle, Int32)">

  1862.       <ul class="md-nav__list">

  1863.         

  1864.           <li class="md-nav__item">

  1865.   <a href="#parameters_19" class="md-nav__link">

  1866.     Parameters

  1867.   </a>

  1868.   

  1869. </li>

  1870.         

  1871.       </ul>

  1872.     </nav>

  1873.   

  1874. </li>

  1875.         

  1876.           <li class="md-nav__item">

  1877.   <a href="#llama_get_state_sizesafellamacontexthandle" class="md-nav__link">

  1878.     llama_get_state_size(SafeLLamaContextHandle)

  1879.   </a>

  1880.   

  1881.     <nav class="md-nav" aria-label="llama_get_state_size(SafeLLamaContextHandle)">

  1882.       <ul class="md-nav__list">

  1883.         

  1884.           <li class="md-nav__item">

  1885.   <a href="#parameters_20" class="md-nav__link">

  1886.     Parameters

  1887.   </a>

  1888.   

  1889. </li>

  1890.         

  1891.           <li class="md-nav__item">

  1892.   <a href="#returns_13" class="md-nav__link">

  1893.     Returns

  1894.   </a>

  1895.   

  1896. </li>

  1897.         

  1898.       </ul>

  1899.     </nav>

  1900.   

  1901. </li>

  1902.         

  1903.           <li class="md-nav__item">

  1904.   <a href="#llama_copy_state_datasafellamacontexthandle-byte" class="md-nav__link">

  1905.     llama_copy_state_data(SafeLLamaContextHandle, Byte[])

  1906.   </a>

  1907.   

  1908.     <nav class="md-nav" aria-label="llama_copy_state_data(SafeLLamaContextHandle, Byte[])">

  1909.       <ul class="md-nav__list">

  1910.         

  1911.           <li class="md-nav__item">

  1912.   <a href="#parameters_21" class="md-nav__link">

  1913.     Parameters

  1914.   </a>

  1915.   

  1916. </li>

  1917.         

  1918.           <li class="md-nav__item">

  1919.   <a href="#returns_14" class="md-nav__link">

  1920.     Returns

  1921.   </a>

  1922.   

  1923. </li>

  1924.         

  1925.       </ul>

  1926.     </nav>

  1927.   

  1928. </li>

  1929.         

  1930.           <li class="md-nav__item">

  1931.   <a href="#llama_set_state_datasafellamacontexthandle-byte" class="md-nav__link">

  1932.     llama_set_state_data(SafeLLamaContextHandle, Byte[])

  1933.   </a>

  1934.   

  1935.     <nav class="md-nav" aria-label="llama_set_state_data(SafeLLamaContextHandle, Byte[])">

  1936.       <ul class="md-nav__list">

  1937.         

  1938.           <li class="md-nav__item">

  1939.   <a href="#parameters_22" class="md-nav__link">

  1940.     Parameters

  1941.   </a>

  1942.   

  1943. </li>

  1944.         

  1945.           <li class="md-nav__item">

  1946.   <a href="#returns_15" class="md-nav__link">

  1947.     Returns

  1948.   </a>

  1949.   

  1950. </li>

  1951.         

  1952.       </ul>

  1953.     </nav>

  1954.   

  1955. </li>

  1956.         

  1957.           <li class="md-nav__item">

  1958.   <a href="#llama_load_session_filesafellamacontexthandle-string-int32-uint64-uint64" class="md-nav__link">

  1959.     llama_load_session_file(SafeLLamaContextHandle, String, Int32[], UInt64, UInt64*)

  1960.   </a>

  1961.   

  1962.     <nav class="md-nav" aria-label="llama_load_session_file(SafeLLamaContextHandle, String, Int32[], UInt64, UInt64*)">

  1963.       <ul class="md-nav__list">

  1964.         

  1965.           <li class="md-nav__item">

  1966.   <a href="#parameters_23" class="md-nav__link">

  1967.     Parameters

  1968.   </a>

  1969.   

  1970. </li>

  1971.         

  1972.           <li class="md-nav__item">

  1973.   <a href="#returns_16" class="md-nav__link">

  1974.     Returns

  1975.   </a>

  1976.   

  1977. </li>

  1978.         

  1979.       </ul>

  1980.     </nav>

  1981.   

  1982. </li>

  1983.         

  1984.           <li class="md-nav__item">

  1985.   <a href="#llama_save_session_filesafellamacontexthandle-string-int32-uint64" class="md-nav__link">

  1986.     llama_save_session_file(SafeLLamaContextHandle, String, Int32[], UInt64)

  1987.   </a>

  1988.   

  1989.     <nav class="md-nav" aria-label="llama_save_session_file(SafeLLamaContextHandle, String, Int32[], UInt64)">

  1990.       <ul class="md-nav__list">

  1991.         

  1992.           <li class="md-nav__item">

  1993.   <a href="#parameters_24" class="md-nav__link">

  1994.     Parameters

  1995.   </a>

  1996.   

  1997. </li>

  1998.         

  1999.           <li class="md-nav__item">

  2000.   <a href="#returns_17" class="md-nav__link">

  2001.     Returns

  2002.   </a>

  2003.   

  2004. </li>

  2005.         

  2006.       </ul>

  2007.     </nav>

  2008.   

  2009. </li>

  2010.         

  2011.           <li class="md-nav__item">

  2012.   <a href="#llama_evalsafellamacontexthandle-int32-int32-int32-int32" class="md-nav__link">

  2013.     llama_eval(SafeLLamaContextHandle, Int32[], Int32, Int32, Int32)

  2014.   </a>

  2015.   

  2016.     <nav class="md-nav" aria-label="llama_eval(SafeLLamaContextHandle, Int32[], Int32, Int32, Int32)">

  2017.       <ul class="md-nav__list">

  2018.         

  2019.           <li class="md-nav__item">

  2020.   <a href="#parameters_25" class="md-nav__link">

  2021.     Parameters

  2022.   </a>

  2023.   

  2024. </li>

  2025.         

  2026.           <li class="md-nav__item">

  2027.   <a href="#returns_18" class="md-nav__link">

  2028.     Returns

  2029.   </a>

  2030.   

  2031. </li>

  2032.         

  2033.       </ul>

  2034.     </nav>

  2035.   

  2036. </li>

  2037.         

  2038.           <li class="md-nav__item">

  2039.   <a href="#llama_eval_with_pointersafellamacontexthandle-int32-int32-int32-int32" class="md-nav__link">

  2040.     llama_eval_with_pointer(SafeLLamaContextHandle, Int32*, Int32, Int32, Int32)

  2041.   </a>

  2042.   

  2043.     <nav class="md-nav" aria-label="llama_eval_with_pointer(SafeLLamaContextHandle, Int32*, Int32, Int32, Int32)">

  2044.       <ul class="md-nav__list">

  2045.         

  2046.           <li class="md-nav__item">

  2047.   <a href="#parameters_26" class="md-nav__link">

  2048.     Parameters

  2049.   </a>

  2050.   

  2051. </li>

  2052.         

  2053.           <li class="md-nav__item">

  2054.   <a href="#returns_19" class="md-nav__link">

  2055.     Returns

  2056.   </a>

  2057.   

  2058. </li>

  2059.         

  2060.       </ul>

  2061.     </nav>

  2062.   

  2063. </li>

  2064.         

  2065.           <li class="md-nav__item">

  2066.   <a href="#llama_tokenizesafellamacontexthandle-string-encoding-int32-int32-boolean" class="md-nav__link">

  2067.     llama_tokenize(SafeLLamaContextHandle, String, Encoding, Int32[], Int32, Boolean)

  2068.   </a>

  2069.   

  2070.     <nav class="md-nav" aria-label="llama_tokenize(SafeLLamaContextHandle, String, Encoding, Int32[], Int32, Boolean)">

  2071.       <ul class="md-nav__list">

  2072.         

  2073.           <li class="md-nav__item">

  2074.   <a href="#parameters_27" class="md-nav__link">

  2075.     Parameters

  2076.   </a>

  2077.   

  2078. </li>

  2079.         

  2080.           <li class="md-nav__item">

  2081.   <a href="#returns_20" class="md-nav__link">

  2082.     Returns

  2083.   </a>

  2084.   

  2085. </li>

  2086.         

  2087.       </ul>

  2088.     </nav>

  2089.   

  2090. </li>

  2091.         

  2092.           <li class="md-nav__item">

  2093.   <a href="#llama_tokenize_nativesafellamacontexthandle-sbyte-int32-int32-boolean" class="md-nav__link">

  2094.     llama_tokenize_native(SafeLLamaContextHandle, SByte[], Int32[], Int32, Boolean)

  2095.   </a>

  2096.   

  2097.     <nav class="md-nav" aria-label="llama_tokenize_native(SafeLLamaContextHandle, SByte[], Int32[], Int32, Boolean)">

  2098.       <ul class="md-nav__list">

  2099.         

  2100.           <li class="md-nav__item">

  2101.   <a href="#parameters_28" class="md-nav__link">

  2102.     Parameters

  2103.   </a>

  2104.   

  2105. </li>

  2106.         

  2107.           <li class="md-nav__item">

  2108.   <a href="#returns_21" class="md-nav__link">

  2109.     Returns

  2110.   </a>

  2111.   

  2112. </li>

  2113.         

  2114.       </ul>

  2115.     </nav>

  2116.   

  2117. </li>

  2118.         

  2119.           <li class="md-nav__item">

  2120.   <a href="#llama_n_vocabsafellamacontexthandle" class="md-nav__link">

  2121.     llama_n_vocab(SafeLLamaContextHandle)

  2122.   </a>

  2123.   

  2124.     <nav class="md-nav" aria-label="llama_n_vocab(SafeLLamaContextHandle)">

  2125.       <ul class="md-nav__list">

  2126.         

  2127.           <li class="md-nav__item">

  2128.   <a href="#parameters_29" class="md-nav__link">

  2129.     Parameters

  2130.   </a>

  2131.   

  2132. </li>

  2133.         

  2134.           <li class="md-nav__item">

  2135.   <a href="#returns_22" class="md-nav__link">

  2136.     Returns

  2137.   </a>

  2138.   

  2139. </li>

  2140.         

  2141.       </ul>

  2142.     </nav>

  2143.   

  2144. </li>

  2145.         

  2146.           <li class="md-nav__item">

  2147.   <a href="#llama_n_ctxsafellamacontexthandle" class="md-nav__link">

  2148.     llama_n_ctx(SafeLLamaContextHandle)

  2149.   </a>

  2150.   

  2151.     <nav class="md-nav" aria-label="llama_n_ctx(SafeLLamaContextHandle)">

  2152.       <ul class="md-nav__list">

  2153.         

  2154.           <li class="md-nav__item">

  2155.   <a href="#parameters_30" class="md-nav__link">

  2156.     Parameters

  2157.   </a>

  2158.   

  2159. </li>

  2160.         

  2161.           <li class="md-nav__item">

  2162.   <a href="#returns_23" class="md-nav__link">

  2163.     Returns

  2164.   </a>

  2165.   

  2166. </li>

  2167.         

  2168.       </ul>

  2169.     </nav>

  2170.   

  2171. </li>

  2172.         

  2173.           <li class="md-nav__item">

  2174.   <a href="#llama_n_embdsafellamacontexthandle" class="md-nav__link">

  2175.     llama_n_embd(SafeLLamaContextHandle)

  2176.   </a>

  2177.   

  2178.     <nav class="md-nav" aria-label="llama_n_embd(SafeLLamaContextHandle)">

  2179.       <ul class="md-nav__list">

  2180.         

  2181.           <li class="md-nav__item">

  2182.   <a href="#parameters_31" class="md-nav__link">

  2183.     Parameters

  2184.   </a>

  2185.   

  2186. </li>

  2187.         

  2188.           <li class="md-nav__item">

  2189.   <a href="#returns_24" class="md-nav__link">

  2190.     Returns

  2191.   </a>

  2192.   

  2193. </li>

  2194.         

  2195.       </ul>

  2196.     </nav>

  2197.   

  2198. </li>

  2199.         

  2200.           <li class="md-nav__item">

  2201.   <a href="#llama_get_logitssafellamacontexthandle" class="md-nav__link">

  2202.     llama_get_logits(SafeLLamaContextHandle)

  2203.   </a>

  2204.   

  2205.     <nav class="md-nav" aria-label="llama_get_logits(SafeLLamaContextHandle)">

  2206.       <ul class="md-nav__list">

  2207.         

  2208.           <li class="md-nav__item">

  2209.   <a href="#parameters_32" class="md-nav__link">

  2210.     Parameters

  2211.   </a>

  2212.   

  2213. </li>

  2214.         

  2215.           <li class="md-nav__item">

  2216.   <a href="#returns_25" class="md-nav__link">

  2217.     Returns

  2218.   </a>

  2219.   

  2220. </li>

  2221.         

  2222.       </ul>

  2223.     </nav>

  2224.   

  2225. </li>

  2226.         

  2227.           <li class="md-nav__item">

  2228.   <a href="#llama_get_embeddingssafellamacontexthandle" class="md-nav__link">

  2229.     llama_get_embeddings(SafeLLamaContextHandle)

  2230.   </a>

  2231.   

  2232.     <nav class="md-nav" aria-label="llama_get_embeddings(SafeLLamaContextHandle)">

  2233.       <ul class="md-nav__list">

  2234.         

  2235.           <li class="md-nav__item">

  2236.   <a href="#parameters_33" class="md-nav__link">

  2237.     Parameters

  2238.   </a>

  2239.   

  2240. </li>

  2241.         

  2242.           <li class="md-nav__item">

  2243.   <a href="#returns_26" class="md-nav__link">

  2244.     Returns

  2245.   </a>

  2246.   

  2247. </li>

  2248.         

  2249.       </ul>

  2250.     </nav>

  2251.   

  2252. </li>

  2253.         

  2254.           <li class="md-nav__item">

  2255.   <a href="#llama_token_to_strsafellamacontexthandle-int32" class="md-nav__link">

  2256.     llama_token_to_str(SafeLLamaContextHandle, Int32)

  2257.   </a>

  2258.   

  2259.     <nav class="md-nav" aria-label="llama_token_to_str(SafeLLamaContextHandle, Int32)">

  2260.       <ul class="md-nav__list">

  2261.         

  2262.           <li class="md-nav__item">

  2263.   <a href="#parameters_34" class="md-nav__link">

  2264.     Parameters

  2265.   </a>

  2266.   

  2267. </li>

  2268.         

  2269.           <li class="md-nav__item">

  2270.   <a href="#returns_27" class="md-nav__link">

  2271.     Returns

  2272.   </a>

  2273.   

  2274. </li>

  2275.         

  2276.       </ul>

  2277.     </nav>

  2278.   

  2279. </li>

  2280.         

  2281.           <li class="md-nav__item">

  2282.   <a href="#llama_token_bos" class="md-nav__link">

  2283.     llama_token_bos()

  2284.   </a>

  2285.   

  2286.     <nav class="md-nav" aria-label="llama_token_bos()">

  2287.       <ul class="md-nav__list">

  2288.         

  2289.           <li class="md-nav__item">

  2290.   <a href="#returns_28" class="md-nav__link">

  2291.     Returns

  2292.   </a>

  2293.   

  2294. </li>

  2295.         

  2296.       </ul>

  2297.     </nav>

  2298.   

  2299. </li>

  2300.         

  2301.           <li class="md-nav__item">

  2302.   <a href="#llama_token_eos" class="md-nav__link">

  2303.     llama_token_eos()

  2304.   </a>

  2305.   

  2306.     <nav class="md-nav" aria-label="llama_token_eos()">

  2307.       <ul class="md-nav__list">

  2308.         

  2309.           <li class="md-nav__item">

  2310.   <a href="#returns_29" class="md-nav__link">

  2311.     Returns

  2312.   </a>

  2313.   

  2314. </li>

  2315.         

  2316.       </ul>

  2317.     </nav>

  2318.   

  2319. </li>

  2320.         

  2321.           <li class="md-nav__item">

  2322.   <a href="#llama_token_nl" class="md-nav__link">

  2323.     llama_token_nl()

  2324.   </a>

  2325.   

  2326.     <nav class="md-nav" aria-label="llama_token_nl()">

  2327.       <ul class="md-nav__list">

  2328.         

  2329.           <li class="md-nav__item">

  2330.   <a href="#returns_30" class="md-nav__link">

  2331.     Returns

  2332.   </a>

  2333.   

  2334. </li>

  2335.         

  2336.       </ul>

  2337.     </nav>

  2338.   

  2339. </li>

  2340.         

  2341.       </ul>

  2342.     </nav>

  2343.   

  2344. </li>

  2345.       

  2346.     </ul>

  2347.   

  2348. </nav>

  2349.       

  2350.     </li>

  2351.   

  2352. 

  2353.             

  2354.           

  2355.             

  2356.               

  2357.   

  2358.   

  2359.   

  2360.     <li class="md-nav__item">

  2361.       <a href="../llama.native.safellamacontexthandle/" class="md-nav__link">

  2362.         llama.native.safellamacontexthandle

  2363.       </a>

  2364.     </li>

  2365.   

  2366. 

  2367.             

  2368.           

  2369.             

  2370.               

  2371.   

  2372.   

  2373.   

  2374.     <li class="md-nav__item">

  2375.       <a href="../llama.native.safellamahandlebase/" class="md-nav__link">

  2376.         llama.native.safellamahandlebase

  2377.       </a>

  2378.     </li>

  2379.   

  2380. 

  2381.             

  2382.           

  2383.             

  2384.               

  2385.   

  2386.   

  2387.   

  2388.     <li class="md-nav__item">

  2389.       <a href="../llama.oldversion.chatcompletion/" class="md-nav__link">

  2390.         llama.oldversion.chatcompletion

  2391.       </a>

  2392.     </li>

  2393.   

  2394. 

  2395.             

  2396.           

  2397.             

  2398.               

  2399.   

  2400.   

  2401.   

  2402.     <li class="md-nav__item">

  2403.       <a href="../llama.oldversion.chatcompletionchoice/" class="md-nav__link">

  2404.         llama.oldversion.chatcompletionchoice

  2405.       </a>

  2406.     </li>

  2407.   

  2408. 

  2409.             

  2410.           

  2411.             

  2412.               

  2413.   

  2414.   

  2415.   

  2416.     <li class="md-nav__item">

  2417.       <a href="../llama.oldversion.chatcompletionchunk/" class="md-nav__link">

  2418.         llama.oldversion.chatcompletionchunk

  2419.       </a>

  2420.     </li>

  2421.   

  2422. 

  2423.             

  2424.           

  2425.             

  2426.               

  2427.   

  2428.   

  2429.   

  2430.     <li class="md-nav__item">

  2431.       <a href="../llama.oldversion.chatcompletionchunkchoice/" class="md-nav__link">

  2432.         llama.oldversion.chatcompletionchunkchoice

  2433.       </a>

  2434.     </li>

  2435.   

  2436. 

  2437.             

  2438.           

  2439.             

  2440.               

  2441.   

  2442.   

  2443.   

  2444.     <li class="md-nav__item">

  2445.       <a href="../llama.oldversion.chatcompletionchunkdelta/" class="md-nav__link">

  2446.         llama.oldversion.chatcompletionchunkdelta

  2447.       </a>

  2448.     </li>

  2449.   

  2450. 

  2451.             

  2452.           

  2453.             

  2454.               

  2455.   

  2456.   

  2457.   

  2458.     <li class="md-nav__item">

  2459.       <a href="../llama.oldversion.chatcompletionmessage/" class="md-nav__link">

  2460.         llama.oldversion.chatcompletionmessage

  2461.       </a>

  2462.     </li>

  2463.   

  2464. 

  2465.             

  2466.           

  2467.             

  2468.               

  2469.   

  2470.   

  2471.   

  2472.     <li class="md-nav__item">

  2473.       <a href="../llama.oldversion.chatmessagerecord/" class="md-nav__link">

  2474.         llama.oldversion.chatmessagerecord

  2475.       </a>

  2476.     </li>

  2477.   

  2478. 

  2479.             

  2480.           

  2481.             

  2482.               

  2483.   

  2484.   

  2485.   

  2486.     <li class="md-nav__item">

  2487.       <a href="../llama.oldversion.chatrole/" class="md-nav__link">

  2488.         llama.oldversion.chatrole

  2489.       </a>

  2490.     </li>

  2491.   

  2492. 

  2493.             

  2494.           

  2495.             

  2496.               

  2497.   

  2498.   

  2499.   

  2500.     <li class="md-nav__item">

  2501.       <a href="../llama.oldversion.chatsession-1/" class="md-nav__link">

  2502.         llama.oldversion.chatsession-1

  2503.       </a>

  2504.     </li>

  2505.   

  2506. 

  2507.             

  2508.           

  2509.             

  2510.               

  2511.   

  2512.   

  2513.   

  2514.     <li class="md-nav__item">

  2515.       <a href="../llama.oldversion.completion/" class="md-nav__link">

  2516.         llama.oldversion.completion

  2517.       </a>

  2518.     </li>

  2519.   

  2520. 

  2521.             

  2522.           

  2523.             

  2524.               

  2525.   

  2526.   

  2527.   

  2528.     <li class="md-nav__item">

  2529.       <a href="../llama.oldversion.completionchoice/" class="md-nav__link">

  2530.         llama.oldversion.completionchoice

  2531.       </a>

  2532.     </li>

  2533.   

  2534. 

  2535.             

  2536.           

  2537.             

  2538.               

  2539.   

  2540.   

  2541.   

  2542.     <li class="md-nav__item">

  2543.       <a href="../llama.oldversion.completionchunk/" class="md-nav__link">

  2544.         llama.oldversion.completionchunk

  2545.       </a>

  2546.     </li>

  2547.   

  2548. 

  2549.             

  2550.           

  2551.             

  2552.               

  2553.   

  2554.   

  2555.   

  2556.     <li class="md-nav__item">

  2557.       <a href="../llama.oldversion.completionlogprobs/" class="md-nav__link">

  2558.         llama.oldversion.completionlogprobs

  2559.       </a>

  2560.     </li>

  2561.   

  2562. 

  2563.             

  2564.           

  2565.             

  2566.               

  2567.   

  2568.   

  2569.   

  2570.     <li class="md-nav__item">

  2571.       <a href="../llama.oldversion.completionusage/" class="md-nav__link">

  2572.         llama.oldversion.completionusage

  2573.       </a>

  2574.     </li>

  2575.   

  2576. 

  2577.             

  2578.           

  2579.             

  2580.               

  2581.   

  2582.   

  2583.   

  2584.     <li class="md-nav__item">

  2585.       <a href="../llama.oldversion.embedding/" class="md-nav__link">

  2586.         llama.oldversion.embedding

  2587.       </a>

  2588.     </li>

  2589.   

  2590. 

  2591.             

  2592.           

  2593.             

  2594.               

  2595.   

  2596.   

  2597.   

  2598.     <li class="md-nav__item">

  2599.       <a href="../llama.oldversion.embeddingdata/" class="md-nav__link">

  2600.         llama.oldversion.embeddingdata

  2601.       </a>

  2602.     </li>

  2603.   

  2604. 

  2605.             

  2606.           

  2607.             

  2608.               

  2609.   

  2610.   

  2611.   

  2612.     <li class="md-nav__item">

  2613.       <a href="../llama.oldversion.embeddingusage/" class="md-nav__link">

  2614.         llama.oldversion.embeddingusage

  2615.       </a>

  2616.     </li>

  2617.   

  2618. 

  2619.             

  2620.           

  2621.             

  2622.               

  2623.   

  2624.   

  2625.   

  2626.     <li class="md-nav__item">

  2627.       <a href="../llama.oldversion.ichatmodel/" class="md-nav__link">

  2628.         llama.oldversion.ichatmodel

  2629.       </a>

  2630.     </li>

  2631.   

  2632. 

  2633.             

  2634.           

  2635.             

  2636.               

  2637.   

  2638.   

  2639.   

  2640.     <li class="md-nav__item">

  2641.       <a href="../llama.oldversion.llamaembedder/" class="md-nav__link">

  2642.         llama.oldversion.llamaembedder

  2643.       </a>

  2644.     </li>

  2645.   

  2646. 

  2647.             

  2648.           

  2649.             

  2650.               

  2651.   

  2652.   

  2653.   

  2654.     <li class="md-nav__item">

  2655.       <a href="../llama.oldversion.llamamodel/" class="md-nav__link">

  2656.         llama.oldversion.llamamodel

  2657.       </a>

  2658.     </li>

  2659.   

  2660. 

  2661.             

  2662.           

  2663.             

  2664.               

  2665.   

  2666.   

  2667.   

  2668.     <li class="md-nav__item">

  2669.       <a href="../llama.oldversion.llamaparams/" class="md-nav__link">

  2670.         llama.oldversion.llamaparams

  2671.       </a>

  2672.     </li>

  2673.   

  2674. 

  2675.             

  2676.           

  2677.             

  2678.               

  2679.   

  2680.   

  2681.   

  2682.     <li class="md-nav__item">

  2683.       <a href="../llama.resettablellamamodel/" class="md-nav__link">

  2684.         llama.resettablellamamodel

  2685.       </a>

  2686.     </li>

  2687.   

  2688. 

  2689.             

  2690.           

  2691.             

  2692.               

  2693.   

  2694.   

  2695.   

  2696.     <li class="md-nav__item">

  2697.       <a href="../llama.statefulexecutorbase/" class="md-nav__link">

  2698.         llama.statefulexecutorbase

  2699.       </a>

  2700.     </li>

  2701.   

  2702. 

  2703.             

  2704.           

  2705.             

  2706.               

  2707.   

  2708.   

  2709.   

  2710.     <li class="md-nav__item">

  2711.       <a href="../llama.statelessexecutor/" class="md-nav__link">

  2712.         llama.statelessexecutor

  2713.       </a>

  2714.     </li>

  2715.   

  2716. 

  2717.             

  2718.           

  2719.         </ul>

  2720.       </nav>

  2721.     </li>

  2722.   

  2723. 

  2724.     

  2725.   </ul>

  2726. </nav>

  2727.                   </div>

  2728.                 </div>

  2729.               </div>

  2730.             

  2731.             

  2732.               

  2733.               <div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" >

  2734.                 <div class="md-sidebar__scrollwrap">

  2735.                   <div class="md-sidebar__inner">

  2736.                     

  2737. 

  2738. <nav class="md-nav md-nav--secondary" aria-label="Table of contents">

  2739.   

  2740.   

  2741.   

  2742.     

  2743.   

  2744.   

  2745.     <label class="md-nav__title" for="__toc">

  2746.       <span class="md-nav__icon md-icon"></span>

  2747.       Table of contents

  2748.     </label>

  2749.     <ul class="md-nav__list" data-md-component="toc" data-md-scrollfix>

  2750.       

  2751.         <li class="md-nav__item">

  2752.   <a href="#constructors" class="md-nav__link">

  2753.     Constructors

  2754.   </a>

  2755.   

  2756.     <nav class="md-nav" aria-label="Constructors">

  2757.       <ul class="md-nav__list">

  2758.         

  2759.           <li class="md-nav__item">

  2760.   <a href="#nativeapi_1" class="md-nav__link">

  2761.     NativeApi()

  2762.   </a>

  2763.   

  2764. </li>

  2765.         

  2766.       </ul>

  2767.     </nav>

  2768.   

  2769. </li>

  2770.       

  2771.         <li class="md-nav__item">

  2772.   <a href="#methods" class="md-nav__link">

  2773.     Methods

  2774.   </a>

  2775.   

  2776.     <nav class="md-nav" aria-label="Methods">

  2777.       <ul class="md-nav__list">

  2778.         

  2779.           <li class="md-nav__item">

  2780.   <a href="#llama_print_timingssafellamacontexthandle" class="md-nav__link">

  2781.     llama_print_timings(SafeLLamaContextHandle)

  2782.   </a>

  2783.   

  2784.     <nav class="md-nav" aria-label="llama_print_timings(SafeLLamaContextHandle)">

  2785.       <ul class="md-nav__list">

  2786.         

  2787.           <li class="md-nav__item">

  2788.   <a href="#parameters" class="md-nav__link">

  2789.     Parameters

  2790.   </a>

  2791.   

  2792. </li>

  2793.         

  2794.       </ul>

  2795.     </nav>

  2796.   

  2797. </li>

  2798.         

  2799.           <li class="md-nav__item">

  2800.   <a href="#llama_reset_timingssafellamacontexthandle" class="md-nav__link">

  2801.     llama_reset_timings(SafeLLamaContextHandle)

  2802.   </a>

  2803.   

  2804.     <nav class="md-nav" aria-label="llama_reset_timings(SafeLLamaContextHandle)">

  2805.       <ul class="md-nav__list">

  2806.         

  2807.           <li class="md-nav__item">

  2808.   <a href="#parameters_1" class="md-nav__link">

  2809.     Parameters

  2810.   </a>

  2811.   

  2812. </li>

  2813.         

  2814.       </ul>

  2815.     </nav>

  2816.   

  2817. </li>

  2818.         

  2819.           <li class="md-nav__item">

  2820.   <a href="#llama_print_system_info" class="md-nav__link">

  2821.     llama_print_system_info()

  2822.   </a>

  2823.   

  2824.     <nav class="md-nav" aria-label="llama_print_system_info()">

  2825.       <ul class="md-nav__list">

  2826.         

  2827.           <li class="md-nav__item">

  2828.   <a href="#returns" class="md-nav__link">

  2829.     Returns

  2830.   </a>

  2831.   

  2832. </li>

  2833.         

  2834.       </ul>

  2835.     </nav>

  2836.   

  2837. </li>

  2838.         

  2839.           <li class="md-nav__item">

  2840.   <a href="#llama_model_quantizestring-string-llamaftype-int32" class="md-nav__link">

  2841.     llama_model_quantize(String, String, LLamaFtype, Int32)

  2842.   </a>

  2843.   

  2844.     <nav class="md-nav" aria-label="llama_model_quantize(String, String, LLamaFtype, Int32)">

  2845.       <ul class="md-nav__list">

  2846.         

  2847.           <li class="md-nav__item">

  2848.   <a href="#parameters_2" class="md-nav__link">

  2849.     Parameters

  2850.   </a>

  2851.   

  2852. </li>

  2853.         

  2854.           <li class="md-nav__item">

  2855.   <a href="#returns_1" class="md-nav__link">

  2856.     Returns

  2857.   </a>

  2858.   

  2859. </li>

  2860.         

  2861.       </ul>

  2862.     </nav>

  2863.   

  2864. </li>

  2865.         

  2866.           <li class="md-nav__item">

  2867.   <a href="#llama_sample_repetition_penaltysafellamacontexthandle-intptr-int32-uint64-single" class="md-nav__link">

  2868.     llama_sample_repetition_penalty(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single)

  2869.   </a>

  2870.   

  2871.     <nav class="md-nav" aria-label="llama_sample_repetition_penalty(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single)">

  2872.       <ul class="md-nav__list">

  2873.         

  2874.           <li class="md-nav__item">

  2875.   <a href="#parameters_3" class="md-nav__link">

  2876.     Parameters

  2877.   </a>

  2878.   

  2879. </li>

  2880.         

  2881.       </ul>

  2882.     </nav>

  2883.   

  2884. </li>

  2885.         

  2886.           <li class="md-nav__item">

  2887.   <a href="#llama_sample_frequency_and_presence_penaltiessafellamacontexthandle-intptr-int32-uint64-single-single" class="md-nav__link">

  2888.     llama_sample_frequency_and_presence_penalties(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single, Single)

  2889.   </a>

  2890.   

  2891.     <nav class="md-nav" aria-label="llama_sample_frequency_and_presence_penalties(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single, Single)">

  2892.       <ul class="md-nav__list">

  2893.         

  2894.           <li class="md-nav__item">

  2895.   <a href="#parameters_4" class="md-nav__link">

  2896.     Parameters

  2897.   </a>

  2898.   

  2899. </li>

  2900.         

  2901.       </ul>

  2902.     </nav>

  2903.   

  2904. </li>

  2905.         

  2906.           <li class="md-nav__item">

  2907.   <a href="#llama_sample_softmaxsafellamacontexthandle-intptr" class="md-nav__link">

  2908.     llama_sample_softmax(SafeLLamaContextHandle, IntPtr)

  2909.   </a>

  2910.   

  2911.     <nav class="md-nav" aria-label="llama_sample_softmax(SafeLLamaContextHandle, IntPtr)">

  2912.       <ul class="md-nav__list">

  2913.         

  2914.           <li class="md-nav__item">

  2915.   <a href="#parameters_5" class="md-nav__link">

  2916.     Parameters

  2917.   </a>

  2918.   

  2919. </li>

  2920.         

  2921.       </ul>

  2922.     </nav>

  2923.   

  2924. </li>

  2925.         

  2926.           <li class="md-nav__item">

  2927.   <a href="#llama_sample_top_ksafellamacontexthandle-intptr-int32-uint64" class="md-nav__link">

  2928.     llama_sample_top_k(SafeLLamaContextHandle, IntPtr, Int32, UInt64)

  2929.   </a>

  2930.   

  2931.     <nav class="md-nav" aria-label="llama_sample_top_k(SafeLLamaContextHandle, IntPtr, Int32, UInt64)">

  2932.       <ul class="md-nav__list">

  2933.         

  2934.           <li class="md-nav__item">

  2935.   <a href="#parameters_6" class="md-nav__link">

  2936.     Parameters

  2937.   </a>

  2938.   

  2939. </li>

  2940.         

  2941.       </ul>

  2942.     </nav>

  2943.   

  2944. </li>

  2945.         

  2946.           <li class="md-nav__item">

  2947.   <a href="#llama_sample_top_psafellamacontexthandle-intptr-single-uint64" class="md-nav__link">

  2948.     llama_sample_top_p(SafeLLamaContextHandle, IntPtr, Single, UInt64)

  2949.   </a>

  2950.   

  2951.     <nav class="md-nav" aria-label="llama_sample_top_p(SafeLLamaContextHandle, IntPtr, Single, UInt64)">

  2952.       <ul class="md-nav__list">

  2953.         

  2954.           <li class="md-nav__item">

  2955.   <a href="#parameters_7" class="md-nav__link">

  2956.     Parameters

  2957.   </a>

  2958.   

  2959. </li>

  2960.         

  2961.       </ul>

  2962.     </nav>

  2963.   

  2964. </li>

  2965.         

  2966.           <li class="md-nav__item">

  2967.   <a href="#llama_sample_tail_freesafellamacontexthandle-intptr-single-uint64" class="md-nav__link">

  2968.     llama_sample_tail_free(SafeLLamaContextHandle, IntPtr, Single, UInt64)

  2969.   </a>

  2970.   

  2971.     <nav class="md-nav" aria-label="llama_sample_tail_free(SafeLLamaContextHandle, IntPtr, Single, UInt64)">

  2972.       <ul class="md-nav__list">

  2973.         

  2974.           <li class="md-nav__item">

  2975.   <a href="#parameters_8" class="md-nav__link">

  2976.     Parameters

  2977.   </a>

  2978.   

  2979. </li>

  2980.         

  2981.       </ul>

  2982.     </nav>

  2983.   

  2984. </li>

  2985.         

  2986.           <li class="md-nav__item">

  2987.   <a href="#llama_sample_typicalsafellamacontexthandle-intptr-single-uint64" class="md-nav__link">

  2988.     llama_sample_typical(SafeLLamaContextHandle, IntPtr, Single, UInt64)

  2989.   </a>

  2990.   

  2991.     <nav class="md-nav" aria-label="llama_sample_typical(SafeLLamaContextHandle, IntPtr, Single, UInt64)">

  2992.       <ul class="md-nav__list">

  2993.         

  2994.           <li class="md-nav__item">

  2995.   <a href="#parameters_9" class="md-nav__link">

  2996.     Parameters

  2997.   </a>

  2998.   

  2999. </li>

  3000.         

  3001.       </ul>

  3002.     </nav>

  3003.   

  3004. </li>

  3005.         

  3006.           <li class="md-nav__item">

  3007.   <a href="#llama_sample_temperaturesafellamacontexthandle-intptr-single" class="md-nav__link">

  3008.     llama_sample_temperature(SafeLLamaContextHandle, IntPtr, Single)

  3009.   </a>

  3010.   

  3011.     <nav class="md-nav" aria-label="llama_sample_temperature(SafeLLamaContextHandle, IntPtr, Single)">

  3012.       <ul class="md-nav__list">

  3013.         

  3014.           <li class="md-nav__item">

  3015.   <a href="#parameters_10" class="md-nav__link">

  3016.     Parameters

  3017.   </a>

  3018.   

  3019. </li>

  3020.         

  3021.       </ul>

  3022.     </nav>

  3023.   

  3024. </li>

  3025.         

  3026.           <li class="md-nav__item">

  3027.   <a href="#llama_sample_token_mirostatsafellamacontexthandle-intptr-single-single-int32-single" class="md-nav__link">

  3028.     llama_sample_token_mirostat(SafeLLamaContextHandle, IntPtr, Single, Single, Int32, Single*)

  3029.   </a>

  3030.   

  3031.     <nav class="md-nav" aria-label="llama_sample_token_mirostat(SafeLLamaContextHandle, IntPtr, Single, Single, Int32, Single*)">

  3032.       <ul class="md-nav__list">

  3033.         

  3034.           <li class="md-nav__item">

  3035.   <a href="#parameters_11" class="md-nav__link">

  3036.     Parameters

  3037.   </a>

  3038.   

  3039. </li>

  3040.         

  3041.           <li class="md-nav__item">

  3042.   <a href="#returns_2" class="md-nav__link">

  3043.     Returns

  3044.   </a>

  3045.   

  3046. </li>

  3047.         

  3048.       </ul>

  3049.     </nav>

  3050.   

  3051. </li>

  3052.         

  3053.           <li class="md-nav__item">

  3054.   <a href="#llama_sample_token_mirostat_v2safellamacontexthandle-intptr-single-single-single" class="md-nav__link">

  3055.     llama_sample_token_mirostat_v2(SafeLLamaContextHandle, IntPtr, Single, Single, Single*)

  3056.   </a>

  3057.   

  3058.     <nav class="md-nav" aria-label="llama_sample_token_mirostat_v2(SafeLLamaContextHandle, IntPtr, Single, Single, Single*)">

  3059.       <ul class="md-nav__list">

  3060.         

  3061.           <li class="md-nav__item">

  3062.   <a href="#parameters_12" class="md-nav__link">

  3063.     Parameters

  3064.   </a>

  3065.   

  3066. </li>

  3067.         

  3068.           <li class="md-nav__item">

  3069.   <a href="#returns_3" class="md-nav__link">

  3070.     Returns

  3071.   </a>

  3072.   

  3073. </li>

  3074.         

  3075.       </ul>

  3076.     </nav>

  3077.   

  3078. </li>

  3079.         

  3080.           <li class="md-nav__item">

  3081.   <a href="#llama_sample_token_greedysafellamacontexthandle-intptr" class="md-nav__link">

  3082.     llama_sample_token_greedy(SafeLLamaContextHandle, IntPtr)

  3083.   </a>

  3084.   

  3085.     <nav class="md-nav" aria-label="llama_sample_token_greedy(SafeLLamaContextHandle, IntPtr)">

  3086.       <ul class="md-nav__list">

  3087.         

  3088.           <li class="md-nav__item">

  3089.   <a href="#parameters_13" class="md-nav__link">

  3090.     Parameters

  3091.   </a>

  3092.   

  3093. </li>

  3094.         

  3095.           <li class="md-nav__item">

  3096.   <a href="#returns_4" class="md-nav__link">

  3097.     Returns

  3098.   </a>

  3099.   

  3100. </li>

  3101.         

  3102.       </ul>

  3103.     </nav>

  3104.   

  3105. </li>

  3106.         

  3107.           <li class="md-nav__item">

  3108.   <a href="#llama_sample_tokensafellamacontexthandle-intptr" class="md-nav__link">

  3109.     llama_sample_token(SafeLLamaContextHandle, IntPtr)

  3110.   </a>

  3111.   

  3112.     <nav class="md-nav" aria-label="llama_sample_token(SafeLLamaContextHandle, IntPtr)">

  3113.       <ul class="md-nav__list">

  3114.         

  3115.           <li class="md-nav__item">

  3116.   <a href="#parameters_14" class="md-nav__link">

  3117.     Parameters

  3118.   </a>

  3119.   

  3120. </li>

  3121.         

  3122.           <li class="md-nav__item">

  3123.   <a href="#returns_5" class="md-nav__link">

  3124.     Returns

  3125.   </a>

  3126.   

  3127. </li>

  3128.         

  3129.       </ul>

  3130.     </nav>

  3131.   

  3132. </li>

  3133.         

  3134.           <li class="md-nav__item">

  3135.   <a href="#llama_empty_call" class="md-nav__link">

  3136.     llama_empty_call()

  3137.   </a>

  3138.   

  3139.     <nav class="md-nav" aria-label="llama_empty_call()">

  3140.       <ul class="md-nav__list">

  3141.         

  3142.           <li class="md-nav__item">

  3143.   <a href="#returns_6" class="md-nav__link">

  3144.     Returns

  3145.   </a>

  3146.   

  3147. </li>

  3148.         

  3149.       </ul>

  3150.     </nav>

  3151.   

  3152. </li>

  3153.         

  3154.           <li class="md-nav__item">

  3155.   <a href="#llama_context_default_params" class="md-nav__link">

  3156.     llama_context_default_params()

  3157.   </a>

  3158.   

  3159.     <nav class="md-nav" aria-label="llama_context_default_params()">

  3160.       <ul class="md-nav__list">

  3161.         

  3162.           <li class="md-nav__item">

  3163.   <a href="#returns_7" class="md-nav__link">

  3164.     Returns

  3165.   </a>

  3166.   

  3167. </li>

  3168.         

  3169.       </ul>

  3170.     </nav>

  3171.   

  3172. </li>

  3173.         

  3174.           <li class="md-nav__item">

  3175.   <a href="#llama_mmap_supported" class="md-nav__link">

  3176.     llama_mmap_supported()

  3177.   </a>

  3178.   

  3179.     <nav class="md-nav" aria-label="llama_mmap_supported()">

  3180.       <ul class="md-nav__list">

  3181.         

  3182.           <li class="md-nav__item">

  3183.   <a href="#returns_8" class="md-nav__link">

  3184.     Returns

  3185.   </a>

  3186.   

  3187. </li>

  3188.         

  3189.       </ul>

  3190.     </nav>

  3191.   

  3192. </li>

  3193.         

  3194.           <li class="md-nav__item">

  3195.   <a href="#llama_mlock_supported" class="md-nav__link">

  3196.     llama_mlock_supported()

  3197.   </a>

  3198.   

  3199.     <nav class="md-nav" aria-label="llama_mlock_supported()">

  3200.       <ul class="md-nav__list">

  3201.         

  3202.           <li class="md-nav__item">

  3203.   <a href="#returns_9" class="md-nav__link">

  3204.     Returns

  3205.   </a>

  3206.   

  3207. </li>

  3208.         

  3209.       </ul>

  3210.     </nav>

  3211.   

  3212. </li>

  3213.         

  3214.           <li class="md-nav__item">

  3215.   <a href="#llama_init_from_filestring-llamacontextparams" class="md-nav__link">

  3216.     llama_init_from_file(String, LLamaContextParams)

  3217.   </a>

  3218.   

  3219.     <nav class="md-nav" aria-label="llama_init_from_file(String, LLamaContextParams)">

  3220.       <ul class="md-nav__list">

  3221.         

  3222.           <li class="md-nav__item">

  3223.   <a href="#parameters_15" class="md-nav__link">

  3224.     Parameters

  3225.   </a>

  3226.   

  3227. </li>

  3228.         

  3229.           <li class="md-nav__item">

  3230.   <a href="#returns_10" class="md-nav__link">

  3231.     Returns

  3232.   </a>

  3233.   

  3234. </li>

  3235.         

  3236.       </ul>

  3237.     </nav>

  3238.   

  3239. </li>

  3240.         

  3241.           <li class="md-nav__item">

  3242.   <a href="#llama_init_backend" class="md-nav__link">

  3243.     llama_init_backend()

  3244.   </a>

  3245.   

  3246. </li>

  3247.         

  3248.           <li class="md-nav__item">

  3249.   <a href="#llama_freeintptr" class="md-nav__link">

  3250.     llama_free(IntPtr)

  3251.   </a>

  3252.   

  3253.     <nav class="md-nav" aria-label="llama_free(IntPtr)">

  3254.       <ul class="md-nav__list">

  3255.         

  3256.           <li class="md-nav__item">

  3257.   <a href="#parameters_16" class="md-nav__link">

  3258.     Parameters

  3259.   </a>

  3260.   

  3261. </li>

  3262.         

  3263.       </ul>

  3264.     </nav>

  3265.   

  3266. </li>

  3267.         

  3268.           <li class="md-nav__item">

  3269.   <a href="#llama_apply_lora_from_filesafellamacontexthandle-string-string-int32" class="md-nav__link">

  3270.     llama_apply_lora_from_file(SafeLLamaContextHandle, String, String, Int32)

  3271.   </a>

  3272.   

  3273.     <nav class="md-nav" aria-label="llama_apply_lora_from_file(SafeLLamaContextHandle, String, String, Int32)">

  3274.       <ul class="md-nav__list">

  3275.         

  3276.           <li class="md-nav__item">

  3277.   <a href="#parameters_17" class="md-nav__link">

  3278.     Parameters

  3279.   </a>

  3280.   

  3281. </li>

  3282.         

  3283.           <li class="md-nav__item">

  3284.   <a href="#returns_11" class="md-nav__link">

  3285.     Returns

  3286.   </a>

  3287.   

  3288. </li>

  3289.         

  3290.       </ul>

  3291.     </nav>

  3292.   

  3293. </li>

  3294.         

  3295.           <li class="md-nav__item">

  3296.   <a href="#llama_get_kv_cache_token_countsafellamacontexthandle" class="md-nav__link">

  3297.     llama_get_kv_cache_token_count(SafeLLamaContextHandle)

  3298.   </a>

  3299.   

  3300.     <nav class="md-nav" aria-label="llama_get_kv_cache_token_count(SafeLLamaContextHandle)">

  3301.       <ul class="md-nav__list">

  3302.         

  3303.           <li class="md-nav__item">

  3304.   <a href="#parameters_18" class="md-nav__link">

  3305.     Parameters

  3306.   </a>

  3307.   

  3308. </li>

  3309.         

  3310.           <li class="md-nav__item">

  3311.   <a href="#returns_12" class="md-nav__link">

  3312.     Returns

  3313.   </a>

  3314.   

  3315. </li>

  3316.         

  3317.       </ul>

  3318.     </nav>

  3319.   

  3320. </li>

  3321.         

  3322.           <li class="md-nav__item">

  3323.   <a href="#llama_set_rng_seedsafellamacontexthandle-int32" class="md-nav__link">

  3324.     llama_set_rng_seed(SafeLLamaContextHandle, Int32)

  3325.   </a>

  3326.   

  3327.     <nav class="md-nav" aria-label="llama_set_rng_seed(SafeLLamaContextHandle, Int32)">

  3328.       <ul class="md-nav__list">

  3329.         

  3330.           <li class="md-nav__item">

  3331.   <a href="#parameters_19" class="md-nav__link">

  3332.     Parameters

  3333.   </a>

  3334.   

  3335. </li>

  3336.         

  3337.       </ul>

  3338.     </nav>

  3339.   

  3340. </li>

  3341.         

  3342.           <li class="md-nav__item">

  3343.   <a href="#llama_get_state_sizesafellamacontexthandle" class="md-nav__link">

  3344.     llama_get_state_size(SafeLLamaContextHandle)

  3345.   </a>

  3346.   

  3347.     <nav class="md-nav" aria-label="llama_get_state_size(SafeLLamaContextHandle)">

  3348.       <ul class="md-nav__list">

  3349.         

  3350.           <li class="md-nav__item">

  3351.   <a href="#parameters_20" class="md-nav__link">

  3352.     Parameters

  3353.   </a>

  3354.   

  3355. </li>

  3356.         

  3357.           <li class="md-nav__item">

  3358.   <a href="#returns_13" class="md-nav__link">

  3359.     Returns

  3360.   </a>

  3361.   

  3362. </li>

  3363.         

  3364.       </ul>

  3365.     </nav>

  3366.   

  3367. </li>

  3368.         

  3369.           <li class="md-nav__item">

  3370.   <a href="#llama_copy_state_datasafellamacontexthandle-byte" class="md-nav__link">

  3371.     llama_copy_state_data(SafeLLamaContextHandle, Byte[])

  3372.   </a>

  3373.   

  3374.     <nav class="md-nav" aria-label="llama_copy_state_data(SafeLLamaContextHandle, Byte[])">

  3375.       <ul class="md-nav__list">

  3376.         

  3377.           <li class="md-nav__item">

  3378.   <a href="#parameters_21" class="md-nav__link">

  3379.     Parameters

  3380.   </a>

  3381.   

  3382. </li>

  3383.         

  3384.           <li class="md-nav__item">

  3385.   <a href="#returns_14" class="md-nav__link">

  3386.     Returns

  3387.   </a>

  3388.   

  3389. </li>

  3390.         

  3391.       </ul>

  3392.     </nav>

  3393.   

  3394. </li>

  3395.         

  3396.           <li class="md-nav__item">

  3397.   <a href="#llama_set_state_datasafellamacontexthandle-byte" class="md-nav__link">

  3398.     llama_set_state_data(SafeLLamaContextHandle, Byte[])

  3399.   </a>

  3400.   

  3401.     <nav class="md-nav" aria-label="llama_set_state_data(SafeLLamaContextHandle, Byte[])">

  3402.       <ul class="md-nav__list">

  3403.         

  3404.           <li class="md-nav__item">

  3405.   <a href="#parameters_22" class="md-nav__link">

  3406.     Parameters

  3407.   </a>

  3408.   

  3409. </li>

  3410.         

  3411.           <li class="md-nav__item">

  3412.   <a href="#returns_15" class="md-nav__link">

  3413.     Returns

  3414.   </a>

  3415.   

  3416. </li>

  3417.         

  3418.       </ul>

  3419.     </nav>

  3420.   

  3421. </li>

  3422.         

  3423.           <li class="md-nav__item">

  3424.   <a href="#llama_load_session_filesafellamacontexthandle-string-int32-uint64-uint64" class="md-nav__link">

  3425.     llama_load_session_file(SafeLLamaContextHandle, String, Int32[], UInt64, UInt64*)

  3426.   </a>

  3427.   

  3428.     <nav class="md-nav" aria-label="llama_load_session_file(SafeLLamaContextHandle, String, Int32[], UInt64, UInt64*)">

  3429.       <ul class="md-nav__list">

  3430.         

  3431.           <li class="md-nav__item">

  3432.   <a href="#parameters_23" class="md-nav__link">

  3433.     Parameters

  3434.   </a>

  3435.   

  3436. </li>

  3437.         

  3438.           <li class="md-nav__item">

  3439.   <a href="#returns_16" class="md-nav__link">

  3440.     Returns

  3441.   </a>

  3442.   

  3443. </li>

  3444.         

  3445.       </ul>

  3446.     </nav>

  3447.   

  3448. </li>

  3449.         

  3450.           <li class="md-nav__item">

  3451.   <a href="#llama_save_session_filesafellamacontexthandle-string-int32-uint64" class="md-nav__link">

  3452.     llama_save_session_file(SafeLLamaContextHandle, String, Int32[], UInt64)

  3453.   </a>

  3454.   

  3455.     <nav class="md-nav" aria-label="llama_save_session_file(SafeLLamaContextHandle, String, Int32[], UInt64)">

  3456.       <ul class="md-nav__list">

  3457.         

  3458.           <li class="md-nav__item">

  3459.   <a href="#parameters_24" class="md-nav__link">

  3460.     Parameters

  3461.   </a>

  3462.   

  3463. </li>

  3464.         

  3465.           <li class="md-nav__item">

  3466.   <a href="#returns_17" class="md-nav__link">

  3467.     Returns

  3468.   </a>

  3469.   

  3470. </li>

  3471.         

  3472.       </ul>

  3473.     </nav>

  3474.   

  3475. </li>

  3476.         

  3477.           <li class="md-nav__item">

  3478.   <a href="#llama_evalsafellamacontexthandle-int32-int32-int32-int32" class="md-nav__link">

  3479.     llama_eval(SafeLLamaContextHandle, Int32[], Int32, Int32, Int32)

  3480.   </a>

  3481.   

  3482.     <nav class="md-nav" aria-label="llama_eval(SafeLLamaContextHandle, Int32[], Int32, Int32, Int32)">

  3483.       <ul class="md-nav__list">

  3484.         

  3485.           <li class="md-nav__item">

  3486.   <a href="#parameters_25" class="md-nav__link">

  3487.     Parameters

  3488.   </a>

  3489.   

  3490. </li>

  3491.         

  3492.           <li class="md-nav__item">

  3493.   <a href="#returns_18" class="md-nav__link">

  3494.     Returns

  3495.   </a>

  3496.   

  3497. </li>

  3498.         

  3499.       </ul>

  3500.     </nav>

  3501.   

  3502. </li>

  3503.         

  3504.           <li class="md-nav__item">

  3505.   <a href="#llama_eval_with_pointersafellamacontexthandle-int32-int32-int32-int32" class="md-nav__link">

  3506.     llama_eval_with_pointer(SafeLLamaContextHandle, Int32*, Int32, Int32, Int32)

  3507.   </a>

  3508.   

  3509.     <nav class="md-nav" aria-label="llama_eval_with_pointer(SafeLLamaContextHandle, Int32*, Int32, Int32, Int32)">

  3510.       <ul class="md-nav__list">

  3511.         

  3512.           <li class="md-nav__item">

  3513.   <a href="#parameters_26" class="md-nav__link">

  3514.     Parameters

  3515.   </a>

  3516.   

  3517. </li>

  3518.         

  3519.           <li class="md-nav__item">

  3520.   <a href="#returns_19" class="md-nav__link">

  3521.     Returns

  3522.   </a>

  3523.   

  3524. </li>

  3525.         

  3526.       </ul>

  3527.     </nav>

  3528.   

  3529. </li>

  3530.         

  3531.           <li class="md-nav__item">

  3532.   <a href="#llama_tokenizesafellamacontexthandle-string-encoding-int32-int32-boolean" class="md-nav__link">

  3533.     llama_tokenize(SafeLLamaContextHandle, String, Encoding, Int32[], Int32, Boolean)

  3534.   </a>

  3535.   

  3536.     <nav class="md-nav" aria-label="llama_tokenize(SafeLLamaContextHandle, String, Encoding, Int32[], Int32, Boolean)">

  3537.       <ul class="md-nav__list">

  3538.         

  3539.           <li class="md-nav__item">

  3540.   <a href="#parameters_27" class="md-nav__link">

  3541.     Parameters

  3542.   </a>

  3543.   

  3544. </li>

  3545.         

  3546.           <li class="md-nav__item">

  3547.   <a href="#returns_20" class="md-nav__link">

  3548.     Returns

  3549.   </a>

  3550.   

  3551. </li>

  3552.         

  3553.       </ul>

  3554.     </nav>

  3555.   

  3556. </li>

  3557.         

  3558.           <li class="md-nav__item">

  3559.   <a href="#llama_tokenize_nativesafellamacontexthandle-sbyte-int32-int32-boolean" class="md-nav__link">

  3560.     llama_tokenize_native(SafeLLamaContextHandle, SByte[], Int32[], Int32, Boolean)

  3561.   </a>

  3562.   

  3563.     <nav class="md-nav" aria-label="llama_tokenize_native(SafeLLamaContextHandle, SByte[], Int32[], Int32, Boolean)">

  3564.       <ul class="md-nav__list">

  3565.         

  3566.           <li class="md-nav__item">

  3567.   <a href="#parameters_28" class="md-nav__link">

  3568.     Parameters

  3569.   </a>

  3570.   

  3571. </li>

  3572.         

  3573.           <li class="md-nav__item">

  3574.   <a href="#returns_21" class="md-nav__link">

  3575.     Returns

  3576.   </a>

  3577.   

  3578. </li>

  3579.         

  3580.       </ul>

  3581.     </nav>

  3582.   

  3583. </li>

  3584.         

  3585.           <li class="md-nav__item">

  3586.   <a href="#llama_n_vocabsafellamacontexthandle" class="md-nav__link">

  3587.     llama_n_vocab(SafeLLamaContextHandle)

  3588.   </a>

  3589.   

  3590.     <nav class="md-nav" aria-label="llama_n_vocab(SafeLLamaContextHandle)">

  3591.       <ul class="md-nav__list">

  3592.         

  3593.           <li class="md-nav__item">

  3594.   <a href="#parameters_29" class="md-nav__link">

  3595.     Parameters

  3596.   </a>

  3597.   

  3598. </li>

  3599.         

  3600.           <li class="md-nav__item">

  3601.   <a href="#returns_22" class="md-nav__link">

  3602.     Returns

  3603.   </a>

  3604.   

  3605. </li>

  3606.         

  3607.       </ul>

  3608.     </nav>

  3609.   

  3610. </li>

  3611.         

  3612.           <li class="md-nav__item">

  3613.   <a href="#llama_n_ctxsafellamacontexthandle" class="md-nav__link">

  3614.     llama_n_ctx(SafeLLamaContextHandle)

  3615.   </a>

  3616.   

  3617.     <nav class="md-nav" aria-label="llama_n_ctx(SafeLLamaContextHandle)">

  3618.       <ul class="md-nav__list">

  3619.         

  3620.           <li class="md-nav__item">

  3621.   <a href="#parameters_30" class="md-nav__link">

  3622.     Parameters

  3623.   </a>

  3624.   

  3625. </li>

  3626.         

  3627.           <li class="md-nav__item">

  3628.   <a href="#returns_23" class="md-nav__link">

  3629.     Returns

  3630.   </a>

  3631.   

  3632. </li>

  3633.         

  3634.       </ul>

  3635.     </nav>

  3636.   

  3637. </li>

  3638.         

  3639.           <li class="md-nav__item">

  3640.   <a href="#llama_n_embdsafellamacontexthandle" class="md-nav__link">

  3641.     llama_n_embd(SafeLLamaContextHandle)

  3642.   </a>

  3643.   

  3644.     <nav class="md-nav" aria-label="llama_n_embd(SafeLLamaContextHandle)">

  3645.       <ul class="md-nav__list">

  3646.         

  3647.           <li class="md-nav__item">

  3648.   <a href="#parameters_31" class="md-nav__link">

  3649.     Parameters

  3650.   </a>

  3651.   

  3652. </li>

  3653.         

  3654.           <li class="md-nav__item">

  3655.   <a href="#returns_24" class="md-nav__link">

  3656.     Returns

  3657.   </a>

  3658.   

  3659. </li>

  3660.         

  3661.       </ul>

  3662.     </nav>

  3663.   

  3664. </li>

  3665.         

  3666.           <li class="md-nav__item">

  3667.   <a href="#llama_get_logitssafellamacontexthandle" class="md-nav__link">

  3668.     llama_get_logits(SafeLLamaContextHandle)

  3669.   </a>

  3670.   

  3671.     <nav class="md-nav" aria-label="llama_get_logits(SafeLLamaContextHandle)">

  3672.       <ul class="md-nav__list">

  3673.         

  3674.           <li class="md-nav__item">

  3675.   <a href="#parameters_32" class="md-nav__link">

  3676.     Parameters

  3677.   </a>

  3678.   

  3679. </li>

  3680.         

  3681.           <li class="md-nav__item">

  3682.   <a href="#returns_25" class="md-nav__link">

  3683.     Returns

  3684.   </a>

  3685.   

  3686. </li>

  3687.         

  3688.       </ul>

  3689.     </nav>

  3690.   

  3691. </li>

  3692.         

  3693.           <li class="md-nav__item">

  3694.   <a href="#llama_get_embeddingssafellamacontexthandle" class="md-nav__link">

  3695.     llama_get_embeddings(SafeLLamaContextHandle)

  3696.   </a>

  3697.   

  3698.     <nav class="md-nav" aria-label="llama_get_embeddings(SafeLLamaContextHandle)">

  3699.       <ul class="md-nav__list">

  3700.         

  3701.           <li class="md-nav__item">

  3702.   <a href="#parameters_33" class="md-nav__link">

  3703.     Parameters

  3704.   </a>

  3705.   

  3706. </li>

  3707.         

  3708.           <li class="md-nav__item">

  3709.   <a href="#returns_26" class="md-nav__link">

  3710.     Returns

  3711.   </a>

  3712.   

  3713. </li>

  3714.         

  3715.       </ul>

  3716.     </nav>

  3717.   

  3718. </li>

  3719.         

  3720.           <li class="md-nav__item">

  3721.   <a href="#llama_token_to_strsafellamacontexthandle-int32" class="md-nav__link">

  3722.     llama_token_to_str(SafeLLamaContextHandle, Int32)

  3723.   </a>

  3724.   

  3725.     <nav class="md-nav" aria-label="llama_token_to_str(SafeLLamaContextHandle, Int32)">

  3726.       <ul class="md-nav__list">

  3727.         

  3728.           <li class="md-nav__item">

  3729.   <a href="#parameters_34" class="md-nav__link">

  3730.     Parameters

  3731.   </a>

  3732.   

  3733. </li>

  3734.         

  3735.           <li class="md-nav__item">

  3736.   <a href="#returns_27" class="md-nav__link">

  3737.     Returns

  3738.   </a>

  3739.   

  3740. </li>

  3741.         

  3742.       </ul>

  3743.     </nav>

  3744.   

  3745. </li>

  3746.         

  3747.           <li class="md-nav__item">

  3748.   <a href="#llama_token_bos" class="md-nav__link">

  3749.     llama_token_bos()

  3750.   </a>

  3751.   

  3752.     <nav class="md-nav" aria-label="llama_token_bos()">

  3753.       <ul class="md-nav__list">

  3754.         

  3755.           <li class="md-nav__item">

  3756.   <a href="#returns_28" class="md-nav__link">

  3757.     Returns

  3758.   </a>

  3759.   

  3760. </li>

  3761.         

  3762.       </ul>

  3763.     </nav>

  3764.   

  3765. </li>

  3766.         

  3767.           <li class="md-nav__item">

  3768.   <a href="#llama_token_eos" class="md-nav__link">

  3769.     llama_token_eos()

  3770.   </a>

  3771.   

  3772.     <nav class="md-nav" aria-label="llama_token_eos()">

  3773.       <ul class="md-nav__list">

  3774.         

  3775.           <li class="md-nav__item">

  3776.   <a href="#returns_29" class="md-nav__link">

  3777.     Returns

  3778.   </a>

  3779.   

  3780. </li>

  3781.         

  3782.       </ul>

  3783.     </nav>

  3784.   

  3785. </li>

  3786.         

  3787.           <li class="md-nav__item">

  3788.   <a href="#llama_token_nl" class="md-nav__link">

  3789.     llama_token_nl()

  3790.   </a>

  3791.   

  3792.     <nav class="md-nav" aria-label="llama_token_nl()">

  3793.       <ul class="md-nav__list">

  3794.         

  3795.           <li class="md-nav__item">

  3796.   <a href="#returns_30" class="md-nav__link">

  3797.     Returns

  3798.   </a>

  3799.   

  3800. </li>

  3801.         

  3802.       </ul>

  3803.     </nav>

  3804.   

  3805. </li>

  3806.         

  3807.       </ul>

  3808.     </nav>

  3809.   

  3810. </li>

  3811.       

  3812.     </ul>

  3813.   

  3814. </nav>

  3815.                   </div>

  3816.                 </div>

  3817.               </div>

  3818.             

  3819.           

  3820.           

  3821.             <div class="md-content" data-md-component="content">

  3822.               <article class="md-content__inner md-typeset">

  3823.                 

  3824.                   

  3825. 

  3826. 

  3827. <h1 id="nativeapi">NativeApi</h1>

  3828. <p>Namespace: LLama.Native</p>

  3829. <pre><code class="language-csharp">public class NativeApi

  3830. </code></pre>

  3831. <p>Inheritance <a href="https://docs.microsoft.com/en-us/dotnet/api/system.object">Object</a> → <a href="./">NativeApi</a></p>

  3832. <h2 id="constructors">Constructors</h2>

  3833. <h3 id="nativeapi_1"><strong>NativeApi()</strong></h3>

  3834. <pre><code class="language-csharp">public NativeApi()

  3835. </code></pre>

  3836. <h2 id="methods">Methods</h2>

  3837. <h3 id="llama_print_timingssafellamacontexthandle"><strong>llama_print_timings(SafeLLamaContextHandle)</strong></h3>

  3838. <pre><code class="language-csharp">public static void llama_print_timings(SafeLLamaContextHandle ctx)

  3839. </code></pre>

  3840. <h4 id="parameters">Parameters</h4>

  3841. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3842. <h3 id="llama_reset_timingssafellamacontexthandle"><strong>llama_reset_timings(SafeLLamaContextHandle)</strong></h3>

  3843. <pre><code class="language-csharp">public static void llama_reset_timings(SafeLLamaContextHandle ctx)

  3844. </code></pre>

  3845. <h4 id="parameters_1">Parameters</h4>

  3846. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3847. <h3 id="llama_print_system_info"><strong>llama_print_system_info()</strong></h3>

  3848. <p>Print system information</p>

  3849. <pre><code class="language-csharp">public static IntPtr llama_print_system_info()

  3850. </code></pre>

  3851. <h4 id="returns">Returns</h4>

  3852. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br></p>

  3853. <h3 id="llama_model_quantizestring-string-llamaftype-int32"><strong>llama_model_quantize(String, String, LLamaFtype, Int32)</strong></h3>

  3854. <pre><code class="language-csharp">public static int llama_model_quantize(string fname_inp, string fname_out, LLamaFtype ftype, int nthread)

  3855. </code></pre>

  3856. <h4 id="parameters_2">Parameters</h4>

  3857. <p><code>fname_inp</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.string">String</a><br></p>

  3858. <p><code>fname_out</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.string">String</a><br></p>

  3859. <p><code>ftype</code> <a href="../llama.native.llamaftype/">LLamaFtype</a><br></p>

  3860. <p><code>nthread</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  3861. <h4 id="returns_1">Returns</h4>

  3862. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  3863. <h3 id="llama_sample_repetition_penaltysafellamacontexthandle-intptr-int32-uint64-single"><strong>llama_sample_repetition_penalty(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single)</strong></h3>

  3864. <p>Repetition penalty described in CTRL academic paper https://arxiv.org/abs/1909.05858, with negative logit fix.</p>

  3865. <pre><code class="language-csharp">public static void llama_sample_repetition_penalty(SafeLLamaContextHandle ctx, IntPtr candidates, Int32[] last_tokens, ulong last_tokens_size, float penalty)

  3866. </code></pre>

  3867. <h4 id="parameters_3">Parameters</h4>

  3868. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3869. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3870. Pointer to LLamaTokenDataArray</p>

  3871. <p><code>last_tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32[]</a><br></p>

  3872. <p><code>last_tokens_size</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  3873. <p><code>penalty</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br></p>

  3874. <h3 id="llama_sample_frequency_and_presence_penaltiessafellamacontexthandle-intptr-int32-uint64-single-single"><strong>llama_sample_frequency_and_presence_penalties(SafeLLamaContextHandle, IntPtr, Int32[], UInt64, Single, Single)</strong></h3>

  3875. <p>Frequency and presence penalties described in OpenAI API https://platform.openai.com/docs/api-reference/parameter-details.</p>

  3876. <pre><code class="language-csharp">public static void llama_sample_frequency_and_presence_penalties(SafeLLamaContextHandle ctx, IntPtr candidates, Int32[] last_tokens, ulong last_tokens_size, float alpha_frequency, float alpha_presence)

  3877. </code></pre>

  3878. <h4 id="parameters_4">Parameters</h4>

  3879. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3880. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3881. Pointer to LLamaTokenDataArray</p>

  3882. <p><code>last_tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32[]</a><br></p>

  3883. <p><code>last_tokens_size</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  3884. <p><code>alpha_frequency</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br></p>

  3885. <p><code>alpha_presence</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br></p>

  3886. <h3 id="llama_sample_softmaxsafellamacontexthandle-intptr"><strong>llama_sample_softmax(SafeLLamaContextHandle, IntPtr)</strong></h3>

  3887. <p>Sorts candidate tokens by their logits in descending order and calculate probabilities based on logits.</p>

  3888. <pre><code class="language-csharp">public static void llama_sample_softmax(SafeLLamaContextHandle ctx, IntPtr candidates)

  3889. </code></pre>

  3890. <h4 id="parameters_5">Parameters</h4>

  3891. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3892. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3893. Pointer to LLamaTokenDataArray</p>

  3894. <h3 id="llama_sample_top_ksafellamacontexthandle-intptr-int32-uint64"><strong>llama_sample_top_k(SafeLLamaContextHandle, IntPtr, Int32, UInt64)</strong></h3>

  3895. <p>Top-K sampling described in academic paper "The Curious Case of Neural Text Degeneration" https://arxiv.org/abs/1904.09751</p>

  3896. <pre><code class="language-csharp">public static void llama_sample_top_k(SafeLLamaContextHandle ctx, IntPtr candidates, int k, ulong min_keep)

  3897. </code></pre>

  3898. <h4 id="parameters_6">Parameters</h4>

  3899. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3900. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3901. Pointer to LLamaTokenDataArray</p>

  3902. <p><code>k</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  3903. <p><code>min_keep</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  3904. <h3 id="llama_sample_top_psafellamacontexthandle-intptr-single-uint64"><strong>llama_sample_top_p(SafeLLamaContextHandle, IntPtr, Single, UInt64)</strong></h3>

  3905. <p>Nucleus sampling described in academic paper "The Curious Case of Neural Text Degeneration" https://arxiv.org/abs/1904.09751</p>

  3906. <pre><code class="language-csharp">public static void llama_sample_top_p(SafeLLamaContextHandle ctx, IntPtr candidates, float p, ulong min_keep)

  3907. </code></pre>

  3908. <h4 id="parameters_7">Parameters</h4>

  3909. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3910. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3911. Pointer to LLamaTokenDataArray</p>

  3912. <p><code>p</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br></p>

  3913. <p><code>min_keep</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  3914. <h3 id="llama_sample_tail_freesafellamacontexthandle-intptr-single-uint64"><strong>llama_sample_tail_free(SafeLLamaContextHandle, IntPtr, Single, UInt64)</strong></h3>

  3915. <p>Tail Free Sampling described in https://www.trentonbricken.com/Tail-Free-Sampling/.</p>

  3916. <pre><code class="language-csharp">public static void llama_sample_tail_free(SafeLLamaContextHandle ctx, IntPtr candidates, float z, ulong min_keep)

  3917. </code></pre>

  3918. <h4 id="parameters_8">Parameters</h4>

  3919. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3920. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3921. Pointer to LLamaTokenDataArray</p>

  3922. <p><code>z</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br></p>

  3923. <p><code>min_keep</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  3924. <h3 id="llama_sample_typicalsafellamacontexthandle-intptr-single-uint64"><strong>llama_sample_typical(SafeLLamaContextHandle, IntPtr, Single, UInt64)</strong></h3>

  3925. <p>Locally Typical Sampling implementation described in the paper https://arxiv.org/abs/2202.00666.</p>

  3926. <pre><code class="language-csharp">public static void llama_sample_typical(SafeLLamaContextHandle ctx, IntPtr candidates, float p, ulong min_keep)

  3927. </code></pre>

  3928. <h4 id="parameters_9">Parameters</h4>

  3929. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3930. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3931. Pointer to LLamaTokenDataArray</p>

  3932. <p><code>p</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br></p>

  3933. <p><code>min_keep</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  3934. <h3 id="llama_sample_temperaturesafellamacontexthandle-intptr-single"><strong>llama_sample_temperature(SafeLLamaContextHandle, IntPtr, Single)</strong></h3>

  3935. <pre><code class="language-csharp">public static void llama_sample_temperature(SafeLLamaContextHandle ctx, IntPtr candidates, float temp)

  3936. </code></pre>

  3937. <h4 id="parameters_10">Parameters</h4>

  3938. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3939. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br></p>

  3940. <p><code>temp</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br></p>

  3941. <h3 id="llama_sample_token_mirostatsafellamacontexthandle-intptr-single-single-int32-single"><strong>llama_sample_token_mirostat(SafeLLamaContextHandle, IntPtr, Single, Single, Int32, Single*)</strong></h3>

  3942. <p>Mirostat 1.0 algorithm described in the paper https://arxiv.org/abs/2007.14966. Uses tokens instead of words.</p>

  3943. <pre><code class="language-csharp">public static int llama_sample_token_mirostat(SafeLLamaContextHandle ctx, IntPtr candidates, float tau, float eta, int m, Single* mu)

  3944. </code></pre>

  3945. <h4 id="parameters_11">Parameters</h4>

  3946. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3947. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3948. A vector of <code>llama_token_data</code> containing the candidate tokens, their probabilities (p), and log-odds (logit) for the current position in the generated text.</p>

  3949. <p><code>tau</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br>

  3950. The target cross-entropy (or surprise) value you want to achieve for the generated text. A higher value corresponds to more surprising or less predictable text, while a lower value corresponds to less surprising or more predictable text.</p>

  3951. <p><code>eta</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br>

  3952. The learning rate used to update <code>mu</code> based on the error between the target and observed surprisal of the sampled word. A larger learning rate will cause <code>mu</code> to be updated more quickly, while a smaller learning rate will result in slower updates.</p>

  3953. <p><code>m</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br>

  3954. The number of tokens considered in the estimation of <code>s_hat</code>. This is an arbitrary value that is used to calculate <code>s_hat</code>, which in turn helps to calculate the value of <code>k</code>. In the paper, they use <code>m = 100</code>, but you can experiment with different values to see how it affects the performance of the algorithm.</p>

  3955. <p><code>mu</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single*">Single*</a><br>

  3956. Maximum cross-entropy. This value is initialized to be twice the target cross-entropy (<code>2 * tau</code>) and is updated in the algorithm based on the error between the target and observed surprisal.</p>

  3957. <h4 id="returns_2">Returns</h4>

  3958. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  3959. <h3 id="llama_sample_token_mirostat_v2safellamacontexthandle-intptr-single-single-single"><strong>llama_sample_token_mirostat_v2(SafeLLamaContextHandle, IntPtr, Single, Single, Single*)</strong></h3>

  3960. <p>Mirostat 2.0 algorithm described in the paper https://arxiv.org/abs/2007.14966. Uses tokens instead of words.</p>

  3961. <pre><code class="language-csharp">public static int llama_sample_token_mirostat_v2(SafeLLamaContextHandle ctx, IntPtr candidates, float tau, float eta, Single* mu)

  3962. </code></pre>

  3963. <h4 id="parameters_12">Parameters</h4>

  3964. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3965. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3966. A vector of <code>llama_token_data</code> containing the candidate tokens, their probabilities (p), and log-odds (logit) for the current position in the generated text.</p>

  3967. <p><code>tau</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br>

  3968. The target cross-entropy (or surprise) value you want to achieve for the generated text. A higher value corresponds to more surprising or less predictable text, while a lower value corresponds to less surprising or more predictable text.</p>

  3969. <p><code>eta</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single">Single</a><br>

  3970. The learning rate used to update <code>mu</code> based on the error between the target and observed surprisal of the sampled word. A larger learning rate will cause <code>mu</code> to be updated more quickly, while a smaller learning rate will result in slower updates.</p>

  3971. <p><code>mu</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.single*">Single*</a><br>

  3972. Maximum cross-entropy. This value is initialized to be twice the target cross-entropy (<code>2 * tau</code>) and is updated in the algorithm based on the error between the target and observed surprisal.</p>

  3973. <h4 id="returns_3">Returns</h4>

  3974. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  3975. <h3 id="llama_sample_token_greedysafellamacontexthandle-intptr"><strong>llama_sample_token_greedy(SafeLLamaContextHandle, IntPtr)</strong></h3>

  3976. <p>Selects the token with the highest probability.</p>

  3977. <pre><code class="language-csharp">public static int llama_sample_token_greedy(SafeLLamaContextHandle ctx, IntPtr candidates)

  3978. </code></pre>

  3979. <h4 id="parameters_13">Parameters</h4>

  3980. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3981. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3982. Pointer to LLamaTokenDataArray</p>

  3983. <h4 id="returns_4">Returns</h4>

  3984. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  3985. <h3 id="llama_sample_tokensafellamacontexthandle-intptr"><strong>llama_sample_token(SafeLLamaContextHandle, IntPtr)</strong></h3>

  3986. <p>Randomly selects a token from the candidates based on their probabilities.</p>

  3987. <pre><code class="language-csharp">public static int llama_sample_token(SafeLLamaContextHandle ctx, IntPtr candidates)

  3988. </code></pre>

  3989. <h4 id="parameters_14">Parameters</h4>

  3990. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  3991. <p><code>candidates</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  3992. Pointer to LLamaTokenDataArray</p>

  3993. <h4 id="returns_5">Returns</h4>

  3994. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  3995. <h3 id="llama_empty_call"><strong>llama_empty_call()</strong></h3>

  3996. <pre><code class="language-csharp">public static bool llama_empty_call()

  3997. </code></pre>

  3998. <h4 id="returns_6">Returns</h4>

  3999. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.boolean">Boolean</a><br></p>

  4000. <h3 id="llama_context_default_params"><strong>llama_context_default_params()</strong></h3>

  4001. <pre><code class="language-csharp">public static LLamaContextParams llama_context_default_params()

  4002. </code></pre>

  4003. <h4 id="returns_7">Returns</h4>

  4004. <p><a href="../llama.native.llamacontextparams/">LLamaContextParams</a><br></p>

  4005. <h3 id="llama_mmap_supported"><strong>llama_mmap_supported()</strong></h3>

  4006. <pre><code class="language-csharp">public static bool llama_mmap_supported()

  4007. </code></pre>

  4008. <h4 id="returns_8">Returns</h4>

  4009. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.boolean">Boolean</a><br></p>

  4010. <h3 id="llama_mlock_supported"><strong>llama_mlock_supported()</strong></h3>

  4011. <pre><code class="language-csharp">public static bool llama_mlock_supported()

  4012. </code></pre>

  4013. <h4 id="returns_9">Returns</h4>

  4014. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.boolean">Boolean</a><br></p>

  4015. <h3 id="llama_init_from_filestring-llamacontextparams"><strong>llama_init_from_file(String, LLamaContextParams)</strong></h3>

  4016. <p>Various functions for loading a ggml llama model.

  4017.  Allocate (almost) all memory needed for the model.

  4018.  Return NULL on failure</p>

  4019. <pre><code class="language-csharp">public static IntPtr llama_init_from_file(string path_model, LLamaContextParams params_)

  4020. </code></pre>

  4021. <h4 id="parameters_15">Parameters</h4>

  4022. <p><code>path_model</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.string">String</a><br></p>

  4023. <p><code>params_</code> <a href="../llama.native.llamacontextparams/">LLamaContextParams</a><br></p>

  4024. <h4 id="returns_10">Returns</h4>

  4025. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br></p>

  4026. <h3 id="llama_init_backend"><strong>llama_init_backend()</strong></h3>

  4027. <p>not great API - very likely to change. 

  4028.  Initialize the llama + ggml backend

  4029.  Call once at the start of the program</p>

  4030. <pre><code class="language-csharp">public static void llama_init_backend()

  4031. </code></pre>

  4032. <h3 id="llama_freeintptr"><strong>llama_free(IntPtr)</strong></h3>

  4033. <p>Frees all allocated memory</p>

  4034. <pre><code class="language-csharp">public static void llama_free(IntPtr ctx)

  4035. </code></pre>

  4036. <h4 id="parameters_16">Parameters</h4>

  4037. <p><code>ctx</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br></p>

  4038. <h3 id="llama_apply_lora_from_filesafellamacontexthandle-string-string-int32"><strong>llama_apply_lora_from_file(SafeLLamaContextHandle, String, String, Int32)</strong></h3>

  4039. <p>Apply a LoRA adapter to a loaded model

  4040.  path_base_model is the path to a higher quality model to use as a base for

  4041.  the layers modified by the adapter. Can be NULL to use the current loaded model.

  4042.  The model needs to be reloaded before applying a new adapter, otherwise the adapter

  4043.  will be applied on top of the previous one</p>

  4044. <pre><code class="language-csharp">public static int llama_apply_lora_from_file(SafeLLamaContextHandle ctx, string path_lora, string path_base_model, int n_threads)

  4045. </code></pre>

  4046. <h4 id="parameters_17">Parameters</h4>

  4047. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4048. <p><code>path_lora</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.string">String</a><br></p>

  4049. <p><code>path_base_model</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.string">String</a><br></p>

  4050. <p><code>n_threads</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4051. <h4 id="returns_11">Returns</h4>

  4052. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br>

  4053. Returns 0 on success</p>

  4054. <h3 id="llama_get_kv_cache_token_countsafellamacontexthandle"><strong>llama_get_kv_cache_token_count(SafeLLamaContextHandle)</strong></h3>

  4055. <p>Returns the number of tokens in the KV cache</p>

  4056. <pre><code class="language-csharp">public static int llama_get_kv_cache_token_count(SafeLLamaContextHandle ctx)

  4057. </code></pre>

  4058. <h4 id="parameters_18">Parameters</h4>

  4059. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4060. <h4 id="returns_12">Returns</h4>

  4061. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4062. <h3 id="llama_set_rng_seedsafellamacontexthandle-int32"><strong>llama_set_rng_seed(SafeLLamaContextHandle, Int32)</strong></h3>

  4063. <p>Sets the current rng seed.</p>

  4064. <pre><code class="language-csharp">public static void llama_set_rng_seed(SafeLLamaContextHandle ctx, int seed)

  4065. </code></pre>

  4066. <h4 id="parameters_19">Parameters</h4>

  4067. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4068. <p><code>seed</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4069. <h3 id="llama_get_state_sizesafellamacontexthandle"><strong>llama_get_state_size(SafeLLamaContextHandle)</strong></h3>

  4070. <p>Returns the maximum size in bytes of the state (rng, logits, embedding

  4071.  and kv_cache) - will often be smaller after compacting tokens</p>

  4072. <pre><code class="language-csharp">public static ulong llama_get_state_size(SafeLLamaContextHandle ctx)

  4073. </code></pre>

  4074. <h4 id="parameters_20">Parameters</h4>

  4075. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4076. <h4 id="returns_13">Returns</h4>

  4077. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  4078. <h3 id="llama_copy_state_datasafellamacontexthandle-byte"><strong>llama_copy_state_data(SafeLLamaContextHandle, Byte[])</strong></h3>

  4079. <p>Copies the state to the specified destination address.

  4080.  Destination needs to have allocated enough memory.

  4081.  Returns the number of bytes copied</p>

  4082. <pre><code class="language-csharp">public static ulong llama_copy_state_data(SafeLLamaContextHandle ctx, Byte[] dest)

  4083. </code></pre>

  4084. <h4 id="parameters_21">Parameters</h4>

  4085. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4086. <p><code>dest</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.byte">Byte[]</a><br></p>

  4087. <h4 id="returns_14">Returns</h4>

  4088. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  4089. <h3 id="llama_set_state_datasafellamacontexthandle-byte"><strong>llama_set_state_data(SafeLLamaContextHandle, Byte[])</strong></h3>

  4090. <p>Set the state reading from the specified address

  4091.  Returns the number of bytes read</p>

  4092. <pre><code class="language-csharp">public static ulong llama_set_state_data(SafeLLamaContextHandle ctx, Byte[] src)

  4093. </code></pre>

  4094. <h4 id="parameters_22">Parameters</h4>

  4095. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4096. <p><code>src</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.byte">Byte[]</a><br></p>

  4097. <h4 id="returns_15">Returns</h4>

  4098. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  4099. <h3 id="llama_load_session_filesafellamacontexthandle-string-int32-uint64-uint64"><strong>llama_load_session_file(SafeLLamaContextHandle, String, Int32[], UInt64, UInt64*)</strong></h3>

  4100. <p>Load session file</p>

  4101. <pre><code class="language-csharp">public static bool llama_load_session_file(SafeLLamaContextHandle ctx, string path_session, Int32[] tokens_out, ulong n_token_capacity, UInt64* n_token_count_out)

  4102. </code></pre>

  4103. <h4 id="parameters_23">Parameters</h4>

  4104. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4105. <p><code>path_session</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.string">String</a><br></p>

  4106. <p><code>tokens_out</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32[]</a><br></p>

  4107. <p><code>n_token_capacity</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  4108. <p><code>n_token_count_out</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64*">UInt64*</a><br></p>

  4109. <h4 id="returns_16">Returns</h4>

  4110. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.boolean">Boolean</a><br></p>

  4111. <h3 id="llama_save_session_filesafellamacontexthandle-string-int32-uint64"><strong>llama_save_session_file(SafeLLamaContextHandle, String, Int32[], UInt64)</strong></h3>

  4112. <p>Save session file</p>

  4113. <pre><code class="language-csharp">public static bool llama_save_session_file(SafeLLamaContextHandle ctx, string path_session, Int32[] tokens, ulong n_token_count)

  4114. </code></pre>

  4115. <h4 id="parameters_24">Parameters</h4>

  4116. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4117. <p><code>path_session</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.string">String</a><br></p>

  4118. <p><code>tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32[]</a><br></p>

  4119. <p><code>n_token_count</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.uint64">UInt64</a><br></p>

  4120. <h4 id="returns_17">Returns</h4>

  4121. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.boolean">Boolean</a><br></p>

  4122. <h3 id="llama_evalsafellamacontexthandle-int32-int32-int32-int32"><strong>llama_eval(SafeLLamaContextHandle, Int32[], Int32, Int32, Int32)</strong></h3>

  4123. <p>Run the llama inference to obtain the logits and probabilities for the next token.

  4124.  tokens + n_tokens is the provided batch of new tokens to process

  4125.  n_past is the number of tokens to use from previous eval calls</p>

  4126. <pre><code class="language-csharp">public static int llama_eval(SafeLLamaContextHandle ctx, Int32[] tokens, int n_tokens, int n_past, int n_threads)

  4127. </code></pre>

  4128. <h4 id="parameters_25">Parameters</h4>

  4129. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4130. <p><code>tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32[]</a><br></p>

  4131. <p><code>n_tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4132. <p><code>n_past</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4133. <p><code>n_threads</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4134. <h4 id="returns_18">Returns</h4>

  4135. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br>

  4136. Returns 0 on success</p>

  4137. <h3 id="llama_eval_with_pointersafellamacontexthandle-int32-int32-int32-int32"><strong>llama_eval_with_pointer(SafeLLamaContextHandle, Int32*, Int32, Int32, Int32)</strong></h3>

  4138. <pre><code class="language-csharp">public static int llama_eval_with_pointer(SafeLLamaContextHandle ctx, Int32* tokens, int n_tokens, int n_past, int n_threads)

  4139. </code></pre>

  4140. <h4 id="parameters_26">Parameters</h4>

  4141. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4142. <p><code>tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32*">Int32*</a><br></p>

  4143. <p><code>n_tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4144. <p><code>n_past</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4145. <p><code>n_threads</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4146. <h4 id="returns_19">Returns</h4>

  4147. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4148. <h3 id="llama_tokenizesafellamacontexthandle-string-encoding-int32-int32-boolean"><strong>llama_tokenize(SafeLLamaContextHandle, String, Encoding, Int32[], Int32, Boolean)</strong></h3>

  4149. <p>Convert the provided text into tokens.

  4150.  The tokens pointer must be large enough to hold the resulting tokens.

  4151.  Returns the number of tokens on success, no more than n_max_tokens

  4152.  Returns a negative number on failure - the number of tokens that would have been returned</p>

  4153. <pre><code class="language-csharp">public static int llama_tokenize(SafeLLamaContextHandle ctx, string text, Encoding encoding, Int32[] tokens, int n_max_tokens, bool add_bos)

  4154. </code></pre>

  4155. <h4 id="parameters_27">Parameters</h4>

  4156. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4157. <p><code>text</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.string">String</a><br></p>

  4158. <p><code>encoding</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.text.encoding">Encoding</a><br></p>

  4159. <p><code>tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32[]</a><br></p>

  4160. <p><code>n_max_tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4161. <p><code>add_bos</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.boolean">Boolean</a><br></p>

  4162. <h4 id="returns_20">Returns</h4>

  4163. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4164. <h3 id="llama_tokenize_nativesafellamacontexthandle-sbyte-int32-int32-boolean"><strong>llama_tokenize_native(SafeLLamaContextHandle, SByte[], Int32[], Int32, Boolean)</strong></h3>

  4165. <pre><code class="language-csharp">public static int llama_tokenize_native(SafeLLamaContextHandle ctx, SByte[] text, Int32[] tokens, int n_max_tokens, bool add_bos)

  4166. </code></pre>

  4167. <h4 id="parameters_28">Parameters</h4>

  4168. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4169. <p><code>text</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.sbyte">SByte[]</a><br></p>

  4170. <p><code>tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32[]</a><br></p>

  4171. <p><code>n_max_tokens</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4172. <p><code>add_bos</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.boolean">Boolean</a><br></p>

  4173. <h4 id="returns_21">Returns</h4>

  4174. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4175. <h3 id="llama_n_vocabsafellamacontexthandle"><strong>llama_n_vocab(SafeLLamaContextHandle)</strong></h3>

  4176. <pre><code class="language-csharp">public static int llama_n_vocab(SafeLLamaContextHandle ctx)

  4177. </code></pre>

  4178. <h4 id="parameters_29">Parameters</h4>

  4179. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4180. <h4 id="returns_22">Returns</h4>

  4181. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4182. <h3 id="llama_n_ctxsafellamacontexthandle"><strong>llama_n_ctx(SafeLLamaContextHandle)</strong></h3>

  4183. <pre><code class="language-csharp">public static int llama_n_ctx(SafeLLamaContextHandle ctx)

  4184. </code></pre>

  4185. <h4 id="parameters_30">Parameters</h4>

  4186. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4187. <h4 id="returns_23">Returns</h4>

  4188. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4189. <h3 id="llama_n_embdsafellamacontexthandle"><strong>llama_n_embd(SafeLLamaContextHandle)</strong></h3>

  4190. <pre><code class="language-csharp">public static int llama_n_embd(SafeLLamaContextHandle ctx)

  4191. </code></pre>

  4192. <h4 id="parameters_31">Parameters</h4>

  4193. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4194. <h4 id="returns_24">Returns</h4>

  4195. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4196. <h3 id="llama_get_logitssafellamacontexthandle"><strong>llama_get_logits(SafeLLamaContextHandle)</strong></h3>

  4197. <p>Token logits obtained from the last call to llama_eval()

  4198.  The logits for the last token are stored in the last row

  4199.  Can be mutated in order to change the probabilities of the next token

  4200.  Rows: n_tokens

  4201.  Cols: n_vocab</p>

  4202. <pre><code class="language-csharp">public static Single* llama_get_logits(SafeLLamaContextHandle ctx)

  4203. </code></pre>

  4204. <h4 id="parameters_32">Parameters</h4>

  4205. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4206. <h4 id="returns_25">Returns</h4>

  4207. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.single*">Single*</a><br></p>

  4208. <h3 id="llama_get_embeddingssafellamacontexthandle"><strong>llama_get_embeddings(SafeLLamaContextHandle)</strong></h3>

  4209. <p>Get the embeddings for the input

  4210.  shape: [n_embd] (1-dimensional)</p>

  4211. <pre><code class="language-csharp">public static Single* llama_get_embeddings(SafeLLamaContextHandle ctx)

  4212. </code></pre>

  4213. <h4 id="parameters_33">Parameters</h4>

  4214. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4215. <h4 id="returns_26">Returns</h4>

  4216. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.single*">Single*</a><br></p>

  4217. <h3 id="llama_token_to_strsafellamacontexthandle-int32"><strong>llama_token_to_str(SafeLLamaContextHandle, Int32)</strong></h3>

  4218. <p>Token Id -&gt; String. Uses the vocabulary in the provided context</p>

  4219. <pre><code class="language-csharp">public static IntPtr llama_token_to_str(SafeLLamaContextHandle ctx, int token)

  4220. </code></pre>

  4221. <h4 id="parameters_34">Parameters</h4>

  4222. <p><code>ctx</code> <a href="../llama.native.safellamacontexthandle/">SafeLLamaContextHandle</a><br></p>

  4223. <p><code>token</code> <a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4224. <h4 id="returns_27">Returns</h4>

  4225. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.intptr">IntPtr</a><br>

  4226. Pointer to a string.</p>

  4227. <h3 id="llama_token_bos"><strong>llama_token_bos()</strong></h3>

  4228. <pre><code class="language-csharp">public static int llama_token_bos()

  4229. </code></pre>

  4230. <h4 id="returns_28">Returns</h4>

  4231. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4232. <h3 id="llama_token_eos"><strong>llama_token_eos()</strong></h3>

  4233. <pre><code class="language-csharp">public static int llama_token_eos()

  4234. </code></pre>

  4235. <h4 id="returns_29">Returns</h4>

  4236. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4237. <h3 id="llama_token_nl"><strong>llama_token_nl()</strong></h3>

  4238. <pre><code class="language-csharp">public static int llama_token_nl()

  4239. </code></pre>

  4240. <h4 id="returns_30">Returns</h4>

  4241. <p><a href="https://docs.microsoft.com/en-us/dotnet/api/system.int32">Int32</a><br></p>

  4242. 

  4243. 

  4244. 

  4245. 

  4246. 

  4247.                 

  4248.               </article>

  4249.             </div>

  4250.           

  4251.           

  4252.         </div>

  4253.         

  4254.       </main>

  4255.       

  4256.         <footer class="md-footer">

  4257.   

  4258.   <div class="md-footer-meta md-typeset">

  4259.     <div class="md-footer-meta__inner md-grid">

  4260.       <div class="md-copyright">

  4261.   

  4262.   

  4263.     Made with

  4264.     <a href="https://squidfunk.github.io/mkdocs-material/" target="_blank" rel="noopener">

  4265.       Material for MkDocs

  4266.     </a>

  4267.   

  4268. </div>

  4269.       

  4270.     </div>

  4271.   </div>

  4272. </footer>

  4273.       

  4274.     </div>

  4275.     <div class="md-dialog" data-md-component="dialog">

  4276.       <div class="md-dialog__inner md-typeset"></div>

  4277.     </div>

  4278.     

  4279.     <script id="__config" type="application/json">{"base": "../..", "features": [], "search": "../../assets/javascripts/workers/search.208ed371.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}, "version": {"provider": "mike"}}</script>

  4280.     

  4281.     

  4282.       <script src="../../assets/javascripts/bundle.a51614de.min.js"></script>

  4283.       

  4284.     

  4285.   </body>

  4286. </html>