You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Rinne a7634877aa Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
..
llama.abstractions.adaptercollection Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.icontextparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.ihistorytransform Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.iinferenceparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.illamaexecutor Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.illamaparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.imodelparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.itextstreamtransform Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.itexttransform Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.loraadapter Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.metadataoverride Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.metadataoverrideconverter Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.tensorsplitscollection Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.tensorsplitscollectionconverter Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.antipromptprocessor Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.alreadypromptedconversationexception Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.batchedexecutor Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.cannotforkwhilerequiresinferenceexception Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.cannotmodifywhilerequiresinferenceexception Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.cannotsamplerequiresinferenceexception Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.cannotsamplerequirespromptexception Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.conversation Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.conversationextensions Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.experimentalbatchedexecutorexception Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.chatsession Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.chatsession-1 Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.authorrole Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.chathistory Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.fixedsizequeue-1 Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.inferenceparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.mirostattype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.modelparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarexpectedname Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarexpectednext Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarexpectedprevious Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarformatexception Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedcharaltelement Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedcharrngelement Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedendelement Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedendofinput Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedhexcharscount Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunknownescapecharacter Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.llamadecodeerror Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.loadweightsfailedexception Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.runtimeerror Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.extensions.icontextparamsextensions Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.extensions.imodelparamsextensions Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.grammars.grammar Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.grammars.grammarrule Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.ichatmodel Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamacache Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamaembedder Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamamodel Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamamodelv1 Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamaparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamaquantizer Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamastate Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamatransforms Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llavaweights Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.decoderesult Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.ggmltype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.gpusplitmode Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamabatch Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamabeamsstate Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamabeamview Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamachatmessage Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamacontextparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamaftype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamagrammarelement Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamagrammarelementtype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamakvcacheview Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamakvcacheviewcell Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamakvcacheviewsafehandle Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamaloglevel Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamamodelkvoverridetype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamamodelmetadataoverride Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamamodelparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamamodelquantizeparams Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamanativebatch Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamapoolingtype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamapos Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamaropetype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamaseqid Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatoken Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatokendata Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatokendataarray Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatokendataarraynative Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatokentype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamavocabtype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llavaimageembed Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.nativeapi Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.nativelibraryconfig Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.ropescalingtype Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellamacontexthandle Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellamagrammarhandle Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellamahandlebase Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellamamodelhandle Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellavaimageembedhandle Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellavamodelhandle Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.quantizer Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.basesamplingpipeline Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.defaultsamplingpipeline Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.greedysamplingpipeline Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.isamplingpipeline Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.isamplingpipelineextensions Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.mirostate2samplingpipeline Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.mirostatesamplingpipeline Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sessionstate Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.streamingtokendecoder Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletion Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionchoice Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionchunk Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionchunkchoice Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionchunkdelta Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionmessage Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatmessagerecord Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatrole Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completion Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completionchoice Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completionchunk Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completionlogprobs Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completionusage Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.embedding Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.embeddingdata Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.embeddingusage Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
logger Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
index.html Deployed be980ed to 0.11.2 with MkDocs 1.4.3 and mike 1.1.2 1 year ago

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。

C# Text Metal JavaScript HTML+Razor other

Contributors (1)