You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Rinne f08de8c05a Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
..
llama.abstractions.adaptercollection Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.icontextparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.ihistorytransform Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.iinferenceparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.illamaexecutor Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.illamaparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.imodelparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.itextstreamtransform Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.itexttransform Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.loraadapter Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.metadataoverride Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.metadataoverrideconverter Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.tensorsplitscollection Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.abstractions.tensorsplitscollectionconverter Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.antipromptprocessor Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.alreadypromptedconversationexception Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.batchedexecutor Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.cannotforkwhilerequiresinferenceexception Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.cannotmodifywhilerequiresinferenceexception Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.cannotsamplerequiresinferenceexception Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.cannotsamplerequirespromptexception Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.conversation Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.conversationextensions Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.batched.experimentalbatchedexecutorexception Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.chatsession Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.chatsession-1 Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.authorrole Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.chathistory Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.fixedsizequeue-1 Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.inferenceparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.mirostattype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.common.modelparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarexpectedname Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarexpectednext Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarexpectedprevious Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarformatexception Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedcharaltelement Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedcharrngelement Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedendelement Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedendofinput Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunexpectedhexcharscount Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.grammarunknownescapecharacter Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.llamadecodeerror Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.loadweightsfailedexception Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.exceptions.runtimeerror Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.extensions.icontextparamsextensions Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.extensions.imodelparamsextensions Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.grammars.grammar Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.grammars.grammarrule Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.ichatmodel Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamacache Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamaembedder Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamamodel Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamamodelv1 Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamaparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamaquantizer Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamastate Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llamatransforms Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.llavaweights Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.decoderesult Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.ggmltype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.gpusplitmode Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamabatch Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamabeamsstate Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamabeamview Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamachatmessage Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamacontextparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamaftype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamagrammarelement Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamagrammarelementtype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamakvcacheview Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamakvcacheviewcell Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamakvcacheviewsafehandle Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamaloglevel Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamamodelkvoverridetype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamamodelmetadataoverride Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamamodelparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamamodelquantizeparams Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamanativebatch Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamapoolingtype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamapos Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamaropetype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamaseqid Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatoken Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatokendata Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatokendataarray Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatokendataarraynative Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamatokentype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llamavocabtype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.llavaimageembed Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.nativeapi Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.nativelibraryconfig Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.ropescalingtype Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellamacontexthandle Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellamagrammarhandle Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellamahandlebase Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellamamodelhandle Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellavaimageembedhandle Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.native.safellavamodelhandle Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.quantizer Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.basesamplingpipeline Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.defaultsamplingpipeline Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.greedysamplingpipeline Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.isamplingpipeline Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.isamplingpipelineextensions Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.mirostate2samplingpipeline Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sampling.mirostatesamplingpipeline Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.sessionstate Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.streamingtokendecoder Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletion Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionchoice Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionchunk Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionchunkchoice Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionchunkdelta Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatcompletionmessage Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatmessagerecord Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.chatrole Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completion Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completionchoice Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completionchunk Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completionlogprobs Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.completionusage Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.embedding Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.embeddingdata Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
llama.types.embeddingusage Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
logger Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago
index.html Deployed b4317ee to 0.11.0 with MkDocs 1.4.3 and mike 1.1.2 1 year ago

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。

C# Text Metal JavaScript HTML+Razor other

Contributors (1)