+ "ݳj'<^RIHt^RIt^RIHt^RIHt]!4tRt]PPRR4'g!R]PR&]PR4]PPR R4'g!R ]PR &]PR 4R ]P9dR ]P9d]PR ^RI t^RI H t Ht^RIHtHtHtHt^RIt^RIHt^RIHtHt^RIHt^RIHtHtHt^RI H!t!^RI"H#t#H$t$H%t%^RI&H't'H(t(^RI)H*t*H+t+^RI,H-t-H.t.H/t/H0t0H1t1^RI2H3t3^RI4H5t5^RI6H7t7^RI8H9t9^RI:H;t;^RIt>H?t?^RI@HAtA^R IBHCtC^R!IDHEtE^R"IFHGtG^R#IHHItI^R$IJHKtK^R%ILHMtM^R&INHOtO^R'IPHQtQ^R(IRHStS^R)ITHUtU^R*IVHWtW^R+IXHYtY^R,IZH[t[^R-I\H]t]^R.I^H_t_^R/I`Hata^R0IbHctc^R1IdHete^R2IfHgtg^R3IhHiti^R4IjHktk^R5IlHmtm^R6InHoto^R7IpHqtq^R8IrHsts^R9ItHutu^R:IvHwtw^R;IxHyty^RIHtHt^R?IHtHt^R@IHtHt^RAIHt^RBIHt^RCIHt^RDIHt^REIHtHt^RFIHt^RGIHt^RHIHt^RIIHt^RJIHt^RKIHt^RLIHt^RMIHt^RNIHt^ROIHt^RPIHt^RQIHt^RRIHt^RSIHt^RTIHt^RUIHt^RVIHt^RWIHt^RXIHt^RYIHt^RZIHt^R[IHt^R\IHt^R]IHt^R^IHt^R_IHt^R`IHt^RaIHt^RbIHt^RcIHt^RdIHt^ReIHt^RfIHt^RgIHt^RhIHtHt^RiIHt^RjIHt^RkIHt^RlIHt^RmIHt^RnIHt^RoIHt^RpIHt^RqIHt^RrIHt^RsIHt^RtIHt^RuIHt^RvIHt^RwIHt^RxIHt^RyIHtHt^RzIHt^R{IEHEt^R|EIEHEt^R}EIEHEt^R~EIEHEt^REIEHEt^REI EH Et ^REI EH Et ^REI EHEt^REIEHEt^REIEHEt^REIEHEt^REIEHEt^REIEHEt^REIEHEt^REIEHEt^REIEHEt^REIEHEt^REI EH!Et!^REI"EH#Et#EH$Et$^REI%EH&Et&^REI'EH(Et(^REI)EH*Et*^REI+EH,Et,^REI-EH.Et.^REI/EH0Et0^REI1EH2Et2^REI3EH4Et4^REI5EH6Et6^REI7EH8Et8^REI9EH:Et:^REI;EHEt>^REI?EH@Et@^REIAEHBEtB^REICEHDEtD^REIEEHFEtF^REIGEHHEtH^REIIEHJEtJ^REIKEHLEtL^REIMEHNEtN^REIOEHPEtP^REIQEHREtR^REISEHTEtT^REIUEHVEtV]!]4]!R48EtWE]W'd&^REIXEHYEtY^REIZEH[Et[^REI\EH]Et]^REI^EH_Et_M REtYREt[REt]REt_/R]?bR]=bR]>bR]AbR]gbR]kbR]GbR]IbR]bR][bR]bR]bR]bR]bR]bR]bR]b/R]bR]bR]bRE]bRE]bR]KbR]bR]bR]bR]bR]bR]bR]bR]bR]bR]bR]bC/R]bR]MbR]bR]bR]ObR]QbRE]BbRE]BbRE]BbR]ybR]CbR]bR]bR]bR]bR]bR]bC/R]bR]bR]bR]bR]bRE](bR]bR]bRE]RbR]WbR]WbR]bR]bRE]JbR]bRE]*bRE]4bC/RE]>bR]bR]bR]{bR]~bR]}bR]bR]bR]bR]bR]bR]bRE]!bRE]#bRE]&bRE]$bERE]bC/ER]bER]bER]bER]bER]bER]bER]bER]bER E]bER E]bER ]bER E]0bER E]6bERE]8bERE]2bERE]2bERE].bC/ERE].bERE],bERE]:bERE]]obER?]qbER@]qbERA]bERBE]DbERCE]FbERDE]HbC/ERE]bERF]bERG]bERH]bERIE] bERJE] bERKE]bERLE]bERM]EbERN]EbERO]bERP]bERQ]bERR]bERS]bERT];bERUE]NbCERVE]P/CEt`E]YeE]YE]`ERW&E]_E]`ERX&E][eE][E]`ERY&E]]E]`ERZ&E]a!E]`EP44EtcER[ER\lEtdER]ER^lEte]ER_4Etf]ER`4EtgERaERblEthERfERclEti!ERdERe4EtjR#(g) annotationsN)contextmanager) setup_loggeru* ┌─────────────┐ ┌────────────────────────┐ ┌────────────┐ ┌─────────┐ │ GPT-QModel │ -> │ ▓▓▓▓▓▓▓▓▓▓▓▓ 16bit │ -> │ ▒▒▒▒ 8bit │ -> │ ░░ 4bit │ └─────────────┘ └────────────────────────┘ └────────────┘ └─────────┘ PYTORCH_ALLOC_CONFzOexpandable_segments:True,max_split_size_mb:256,garbage_collection_threshold:0.7zENV: Auto setting PYTORCH_ALLOC_CONF='expandable_segments:True,max_split_size_mb:256,garbage_collection_threshold:0.7' for memory saving.CUDA_DEVICE_ORDER PCI_BUS_IDz?ENV: Auto setting CUDA_DEVICE_ORDER=PCI_BUS_ID for correctness.CUDA_VISIBLE_DEVICESROCR_VISIBLE_DEVICES)isdirjoin)DictListOptionalUnion)Version) AutoConfigPreTrainedTokenizerBase) __version__)AdapterLoranormalize_adapter) TorchLinear)METHODQUANT_CONFIG_FILENAMEQuantizeConfig)BACKENDPROFILE)normalize_backendnormalize_profile)get_hf_gguf_load_kwargs&normalize_model_id_or_path_for_hf_ggufnormalize_torch_dtype_kwarg$patch_remote_code_before_config_loadresolve_trust_remote_code)list_repo_files) find_modules)torch_empty_cache) BaseQModel) AfMoeQModel)Apertus1p5QModelApertus1p5TextQModel ApertusQModel) AXK2QModel)BaiChuanQModel)BailingMoeQModel) BloomQModel) BrumbyQModel) ChatGLMQModel) CodeGenQModel)Cohere2MoeQModel)CohereCompassQModel) DbrxQModel)DbrxConvertedQModel) DeciLMQModel)DeepSeekV2QModel)DeepSeekV3QModel)DeepSeekV32QModel)DeepSeekV4QModel)DeepSeekOCR2QModel)DeepSeekVLQModel)DeepSeekVLV2QModel)DiffusionGemmaQModel) Dots1QModel) DreamQModel)Ernie4_5QModel)Ernie4_5_MoeQModel)Ernie4_5_VLMoeQModel) ExaOneQModel) Exaone4QModel)FalconH1QModel)FalconMambaQModel) Gemma2QModel)"Gemma3ForConditionalGenerationGPTQ Gemma3QModel)#Gemma3nForConditionalGenerationGPTQGemma3nTextQModel)"Gemma4ForConditionalGenerationGPTQGemma4TextQModel))Gemma4UnifiedForConditionalGenerationGPTQGemma4UnifiedTextQModel) GlmQModel) GLM4MoEGPTQ)Glm4MoeLiteQModel) Glm4vGPTQ)Glm4vMoeQModelGlm4vMoeTextQModel)GlmMoeDsaQModel)Glm5NextQModel) GlmOCRGPTQ) GlmASRGPTQ) GPT2QModel)GptBigCodeQModel) GptNeoQModel) GPTNeoXQModel) GPTOSSGPTQ) GptJQModel)GraniteMoeHybridQModel) GrinMoeQModel) HrmTextQModel)HunYuanDenseV1QModel)HunYuanMoEV1QModel)HunYuanVLQModel) HYV3QModel) HymbaQModel)InstellaQModel)InklingMMQModel)InternLMQModel)InternLM2QModel)InternS2PreviewQModel)InternS1QModel)InternVLChatQModel)K2HorizonQModel) KlearQModel) KimiK25QModel) LagunaQModel) LFM2QModel) LFM2MoeQModel) LFM2VLQModel)LLaDA2MoeQModel) LlamaQModel) Llama4QModelLlama4TextQModel)LlavaQwen2QModel)LongCatFlashQModel)LocateAnythingQModel) MageVLQModel) MimoQModel) MimoV2QModel) MiniCPMGPTQ)MiniCpm3QModel)MiniCPMOQModel)MiniCPMVQModel)MiniCPMV4_6QModel) MiniMaxM2GPTQ)MiniMaxM3VLGPTQ)Ministral3GPTQ) Mistral3GPTQ) MixtralQModel) MLlamaQModelMLlamaTextQModel)MobileLLMQModel) MossQModel) MptQModel)MuseGlimmerQModel)NanbeigeQModel)NemotronLabsDiffusionQModel)NemotronHQModel)NemotronHPuzzleQModel)NemotronOmniQModel) Olmo3QModel) OptQModel) OuroQModel) OvisQModel) Ovis2QModel) Ovis2_5QModel)Ovis2_6_MoeQModel)Ovis2_6_NextQModel)PanguAlphaQModel) PhiQModel) Phi3QModelPhiMoEGPTQForCausalLM) Phi4MMGPTQ) QwenQModel) Qwen2QModel)Qwen2_5_OmniGPTQ)Qwen2_5_VLQModel)Qwen2MoeQModel) Qwen2VLQModel) Qwen3QModel)Qwen3MoeQModel) Qwen3NextGPTQ)Qwen3OmniMoeGPTQ)Qwen3_VLQModel)QwenDriveQModel)Qwen4ExpQModel) RwgQModel)SolarOpenQModel)SolarOpen2QModel)Spark2_5QModel)Starcoder2QModel)TeleChat2QModel)UnlimitedOCRQModel) VoxtralGPTQ) XverseQModel) ZambaQModel) Zamba2QModelz5.2.0) Qwen3_5QModel)Qwen3_5_MoeQModel)Qwen3_5_MoeTextQModel)Qwen3_5TextQModelapertus apertus1p5apertus1p5_textaxk2diffusion_gemmadreambloombrumbygpt_neokimi_k2kimi_k25klearlagunagpt_neoxgptjgpt2llamasmollm3llama4 llama4_textoptmosschatglmglmglm4glm4v glm4v_moeglm4v_moe_textglmasrglm_ocrglm4_moe glm4_moe_lite glm_moe_dsa glm5_next gpt_bigcodecodegencoherecohere2 cohere2_moecohere_compassrefinedWebModel refinedWebfalcon falcon_mambabaichuaninternlm internlm2intern_s2_previewinterns1 internvl_chathrm_texthunyuan_v1_densehunyuan_v1_moe hunyuan_vlhy_v3 k2_horizonqwenmistralyixversedeciz nemotron-nasstablelm_epochstablelm starcoder2mixtralqwen2qwen3 qwen_drive longllamagemmagemma2 gemma3_textgemma3 gemma3n_textgemma3n gemma4_textgemma4gemma4_unified_textgemma4_unifiedphiphi3phi4mmphimoemptminicpmminicpm3minicpmominicpmv minicpmv4_6minimax minimax_m2 minimax_m3_vl muse_glimmernanbeige ministral3 qwen2_moe qwen3_moe qwen3_nextqwen2_vl qwen2_vl_text qwen2_5_vlqwen2_5_vl_text qwen2_5_omniqwen3_omni_moeqwen3_vl qwen4_expdbrxdbrx_converted deepseek_v2 deepseek_v3 deepseek_v32 deepseek_v4 deepseek_ocr2 deepseek_vldeepseek_vl_v2dots1exaoneexaone4grinmoemllamamllama_text_modelmarinmage_vlgranitegranitemoehybrid mobilellmhymbaolmo2olmo3ouroovisovis2ovis2_5 ovis2_6_moe ovis2_6_nexttelechatinstellainkling_mm_modelmimomimo_v2 falcon_h1zambazamba2 gpt_panguernie4_5 ernie4_5_moeernie4_5_moe_vlernie4_5_vl_moeseed_oss solar_open solar_open2spark2_5gpt_oss longcat_flashlocateanything llava_qwen2 nemotron_hnemotron_h_puzzlenemotron_labs_diffusion nemotronh_nano_omni_reasoning_v3 bailing_moebailing_hybridlfm2lfm2_moelfm2_vl llada2_moemistral3afmoez unlimited-ocrvoxtralqwen3_5 qwen3_5_text qwen3_5_moeqwen3_5_moe_textc V^8dQhRRRR/#)quantization_configdictreturn Optional[str])formats"V/home/luca/screen-checking/.venv/lib/python3.14/site-packages/gptqmodel/models/auto.py __annotate__rwst cVPR4p\V\4'ddVP4FOp\V\4'gKVPR4p\V\4'gKDV'gKNR# VPR4p\V\4'd V'dR#RF8pVPV4p\V\4'gK,V'gK6Vu# R#)ayReturn the first activation-quantization field that makes this config unsupported. GPT-QModel can load weight-only quantized checkpoints through the Transformers surface, but it does not currently implement activation-quantized runtime semantics. This helper keeps the rejection logic in one place for both ModelOpt-style grouped configs and flatter HF quantization payloads. config_groupsinput_activationskv_cache_schemeN)r{activation_quantization activations)get isinstancerqvalues)rprz group_cfgr{r|keyvalues& rv_activation_quantization_moders(++O-?q B  '**>:L,$$););)=        B * $ $X/B/F/F~/V WF&#6<<>        6 $ rxc#`"\VRR4pVfRxR#\VRR4p\V\4'gRxR#^RIHpVP \V44RxR# \ dMi;i\TRR4Rx\TRT4R# \TRT4i;i5i)rNrp)AutoQuantizationConfig)rrrqtransformers.quantizersr from_dict Exceptionsetattr)modelrrprs& rv._hide_unsupported_quantization_config_for_evalrs UHd +F ~ !&*?F )4 0 0 B((.A)BC      F)40D -/BC-/BCsBAB. A*$B.* A85B.7A88B. B B.B++B.c#v"\V4;_uu_4RxRRR4R# +'giR#;i5iN)r)rs&rv1_hide_unsupported_quantization_config_for_lm_evalrs! 7 > >  ? > > >s9% 9 6 9c V^8dQhRRRR/#)rokwargsrqrrrt)rus"rvrwrws++D+T+rxc\V4#r)r )rs&rv_get_config_load_kwargsrs "6 **rxc RV9d\VVRR7p\WR7p\V4\P!V3RV/VBpVP P 4pV\9d\#\V,#) gguf_filecheck_and_get_model_definitionapi_nametrust_remote_coder) r!r$r#rfrom_pretrained model_typerSUPPORTED_MODELSr( MODEL_MAP) model_dirrconfig_load_kwargsrrs&&, rvrrs,,:  5 2)a(3  ' ' mEV mZl mF""((*J)) Z  rxc]tRtRtRt]RRR]P]PR3RRll4t ]]P]PR3RRll4t ]RR]PRR3R R ll4t ] RR R ll4t !R R4tRtR#) GPTQModelic \R4h)zGPT-QModel is not designed to be instantiated use `from_pretrained()` to load a pretrained model and prepare for quantization via `.quantize()`. use `from_quantized()` for inference with a post-quantized model.)EnvironmentError)selfs&rv__init__GPTQModel.__init__s P  rxNFc4V^8dQhRRRRRRRRR R R R R R/#)romodel_id_or_pathrsquantize_configzOptional[QuantizeConfig | Dict] device_map0Optional[Union[str, Dict[str, Union[str, int]]]]device"Optional[Union[str, torch.device]]backendUnion[str, BACKEND]profileUnion[str, int, PROFILE]rrrt)rus"rvrwGPTQModel.__annotate__!sZVV+V=VI V 7 V ) V.V $Vrxc \VVRR7p\V\4'dVP4pTp \ WR7p\V\ 4'd \ R/VBp\V4p\V4pRp \V\4;'d3\V4;'g \PPV4p Rp V 'd\V4'd.\V4\P!V3RV/\!V4Bp V e\#V 4'dRp M~\$R3Frp V 'dH\V4'd5\PP'\)W44'dRp M(KPKR\+VR7pVFpW8XgK Rp Kp Kt V 'd!VP,!RR VR VR VR VRVR V /VBpV#VP!RR VRVR VR VR VRVRVR V /VBpV#)zGPTQModel.loadrrFNrTzquant_config.json)repo_idrrrrtokenizer_trust_remote_coderrrt)r!rrstripr$r rrrr ospathisabsr#rrrrrexistsr r%from_quantized)clsrrrrrrrrrequested_trust_remote_codeis_gptqmodel_quantizedtreat_as_local_path model_cfgnamefilesfms&&&&&&&&, rvloadGPTQModel.load sZB  %  & , ,/557 &7#56Fl ot , ,,??O#G,#G,!&()93?  " # F Frww}}5E'F  #E2B,C,C 01A B"22 "3*&1I  %Fy%Q%Q%) "/0CD&-..277>>$GWB^3_3_15.4`.,4DEE"9592!#E """!1%  #4  -H A4!## !1  / &      #4 -H  A rxc 0V^8dQhRRRRRRRRR R R R /#) rorrrrrrrrrrrrr(rt)rus"rvrwr{sF7 7 !7 ,7 ) 7 . 7 $ 7  7 rxc \VVRR7p\VRR7\V4p\V4pTpVP RV4p\ WR7p\ P!V3RV/\V4Bp \V 4'd(\PR4VPWR7#V'd(VP'd\PR4\VV3/\V4Bp V P!R RVRVR VR VRVRV/VB#) zGPTQModel.from_pretrainedrrrrzModel is already quantized, will use `from_quantized` to load quantized model. If you want to quantize the model, please pass un_quantized model path or id, and use `from_pretrained` with `quantize_config`.zGPT-QModel's per-module `dynamic` quantization feature is fully supported in latest vLLM and SGLang but not yet available in hf transformers.pretrained_model_id_or_pathrrrrt)r!r"rrpopr$rrrrrwarnrdynamicr) rrrrrrmodel_init_kwargsrrrmodel_definitions &&&&&&, rvrGPTQModel.from_pretrainedzshB  0  $ 0 $G,#G,&7#&7&;&; ) '' #66Fl++  / &&78  -V 4 4 HHG H%%&6%\ \ 666 HH` a:   &&78   // (8 +    0  )D     rxc4V^8dQhRRRRRRRRR R R R R R/#)rorrsrrrzOptional[Union[str, int]]rradapterzOptional[Adapter | Dict]rrrrr(rt)rus"rvrwrsQ+ + ++ I+ . + ) + . +  $+  + rxc ,\VVRR7p\VRR7TpVPRV4p \WR7p\ V4p\ RV 24\ VV3/\V4Bp \V4pV P!R RVRVRVRVR VRV R V/VB#) zGPTQModel.from_quantizedrrrzfrom_quantized: adapter: rrrrrrrt) r!r"rr$rprintrrrr) rrrrrrrrrrrs &&&&&&&, rvrGPTQModel.from_quantizedsB  /  $ / '8#&,jj1NPk&l#56Fl#G, )'349   &f-  $G,..  -  !      0  )D      rxc(V^8dQhRRRRRRRR/#)rorr target_pathrurrrt)rus"rvrwrs)4:4:4:34:4:X\4:rxc \WR7p\P!WR7pVP'g \ R4hVPpVP RVP RR44p\ V4P4pV\PP8Xd\PpEMV\PP8Xd\PpMV\PP8Xd\PpMV\P P8Xd\P"pMpV\P$P8Xd\P&pM@V\P(P8Xd\P*pM\P,p\.P1WR7p VR8XdA^RIHp Hp ^RIHp T !Y TT P>4wrT !YR R 7T !YR ,R 7M0VR8Xd*^RI H!pV!V PD4pVPGV4V PHPGV4R# \<d \ R 4hi;i)rzModel is not quantizedrr)rmlx) save_config save_model)convert_gptq_to_mlx_weightszXMLX not installed. Please install via `pip install gptqmodel[mlx] --no-build-isolation`.T) donate_modelz /config.json) config_pathhf)dequantize_modelN)%r$rrrprrrrrrrr GGUF_TORCHrr AWQ_TORCHrPAROQUANT_CUDAr FP8_TORCHr EXL3_TORCH GPTQ_TORCHrr mlx_lm.utilsrr utils.mlxr ImportErrorlm_headnn_modules.qlinear.torchrrsave_pretrained tokenizer)rrrurr gptq_configrnormalized_methodr gptq_modelrrr mlx_weights mlx_configrdequantized_models&&&& rvexportGPTQModel.exports56Fl++,<b)))56 600 ;??>2+NOK--/  1 1 1((G &"5"5";"; ;**G &**"2"2 2''G &++"3"3 3,,G &**"2"2 2''G &++"3"3 3((G((G^^$4^F U? p@C 'BBR`kBLBTBT'V #K {d C  n0L M t^ C 01A1A B   - -k : ,,[9# p npp ps I##I:c0]tRtRt]RRRll4tRtR#)GPTQModel.adapteriNcHV^8dQhRRRRRRRRRR R R R R R RRR RRRRRR/ #)rorrrrquantized_model_id_or_pathcalibration_datasetzPUnion[List[Dict[str, Union[List[int], torch.LongTensor]]], List[str], List[int]]calibration_dataset_concat_sizez Optional[int]calibration_dataset_sortrs batch_sizerz!Optional[PreTrainedTokenizerBase]calibration_concat_separatorrrdtypez!Optional[Union[str, torch.dtype]]rrrt)rus"rvrwGPTQModel.adapter.__annotate__s; ; ; " ;  ), ;  "r ; .;; '4; &; 9; +8;  $; 5; 7; rxc  <V'd\V\4'g\RV R24hVPRR7\P R4\ PV\PV V V R7p V Pp\V P\.R7p? \4\P R4\ PVV\PV V V R7p\P R 4VPVVVVVVVV R 7R #) z9Adapter: expected `adapter` type to be `Lora`: actual = `z`.T)localzModel: Quant Model Loading...)rrrrr)modulelayerszModel: Native Model Loading...)rrrrrrz!Model: Adapter generation started)rquantized_modulesrrrrrrN)rrr validate_pathrinforrrrrr&rrr'_eora_generate)rrrrrrrrrrrrrquantized_modelqcfgqModulesrs&&&&&&&&&&&&& rvgenerateGPTQModel.adapter.generates$*Wd";"; #\]d\eeg!hii  ! ! ! - HH4 5'nn!;**"3 -O#22D/;?CXCXbman/oH   HH5 6NN!1 $**"3 #E HH8 9  "*$70O)A%#-I !  rxrt)NNNNFNN)__name__ __module__ __qualname____firstlineno__ classmethodr&__static_attributes__rtrxrvrrs ;  ; rxrrtF)r)r*r+r,rr-rAUTOrrrr staticmethodrrr.rtrxrvrrs @DKO9=+2<<07 &+VVr ,3<<07 &+ 7 7 rLP04+2<<04&++ + Z4:4:l==rxrr/(k __future__rr contextlibr utils.loggerrr ASCII_LOGOenvironrr!os.pathr r typingr rrrtorchpackaging.versionr transformersrrrTRANSFORMERS_VERSIONadapter.adapterrrrrr quantizationrrrutilsrr utils.backendrrutils.hfr r!r"r#r$ utils.hubr% utils.modelr& utils.torchr'baser(definitions.afmoer)definitions.apertusr*r+r,definitions.axk2r-definitions.baichuanr.definitions.bailing_moer/definitions.bloomr0definitions.brumbyr1definitions.chatglmr2definitions.codegenr3definitions.cohere2_moer4definitions.cohere_compassr5definitions.dbrxr6definitions.dbrx_convertedr7definitions.decilmr8definitions.deepseek_v2r9definitions.deepseek_v3r:definitions.deepseek_v32r;definitions.deepseek_v4r<definitions.deepseek_ocr2r=definitions.deepseek_vlr>definitions.deepseek_vl_v2r?definitions.diffusion_gemmar@definitions.dots1rAdefinitions.dreamrBdefinitions.ernie4_5rCdefinitions.ernie4_5_moerDdefinitions.ernie4_5_vl_moerEdefinitions.exaonerFdefinitions.exaone4rGdefinitions.falcon_h1rHdefinitions.falcon_mambarIdefinitions.gemma2rJdefinitions.gemma3rKrLdefinitions.gemma3nrMrNdefinitions.gemma4rOrPdefinitions.gemma4_unifiedrQrRdefinitions.glmrSdefinitions.glm4_moerTdefinitions.glm4_moe_literUdefinitions.glm4vrVdefinitions.glm4v_moerWrXdefinitions.glm_moe_dsarYdefinitions.glm5_nextrZdefinitions.glm_ocrr[definitions.glmasrr\definitions.gpt2r]definitions.gpt_bigcoder^definitions.gpt_neor_definitions.gpt_neoxr`definitions.gpt_ossradefinitions.gptjrbdefinitions.granitemoehybridrcdefinitions.grinmoerddefinitions.hrm_textredefinitions.hunyuan_v1_denserfdefinitions.hunyuan_v1_moergdefinitions.hunyuan_vlrhdefinitions.hy_v3ridefinitions.hymbarjdefinitions.instellarkdefinitions.inklingrldefinitions.internlmrmdefinitions.internlm2rndefinitions.intern_s2_previewrodefinitions.interns1rpdefinitions.internvl_chatrqdefinitions.k2_horizonrrdefinitions.klearrsdefinitions.kimi_k25rtdefinitions.lagunarudefinitions.lfm2rvdefinitions.lfm2_moerwdefinitions.lfm2_vlrxdefinitions.llada2rydefinitions.llamarzdefinitions.llama4r{r|definitions.llava_qwen2r}definitions.longcat_flashr~definitions.locateanythingrdefinitions.mage_vlrdefinitions.mimordefinitions.mimo_v2rdefinitions.minicpmrdefinitions.minicpm3rdefinitions.minicpm_ordefinitions.minicpmvrdefinitions.minicpmv_4_6rdefinitions.minimax_m2rdefinitions.minimax_m3_vlrdefinitions.ministral3rdefinitions.mistral3rdefinitions.mixtralrdefinitions.mllamarrdefinitions.mobilellmrdefinitions.mossrdefinitions.mptrdefinitions.muse_glimmerrdefinitions.nanbeiger#definitions.nemotron_labs_diffusionrdefinitions.nemotron_hrdefinitions.nemotron_h_puzzlerdefinitions.nemotron_omnirdefinitions.olmo3rdefinitions.optrdefinitions.ourordefinitions.ovisrdefinitions.ovis2rdefinitions.ovis2_5rdefinitions.ovis2_6_moerrdefinitions.pangu_alphardefinitions.phirdefinitions.phi3rrdefinitions.phi4rdefinitions.qwenrdefinitions.qwen2rdefinitions.qwen2_5_omnirdefinitions.qwen2_5_vlrdefinitions.qwen2_moerdefinitions.qwen2_vlrdefinitions.qwen3rdefinitions.qwen3_moerdefinitions.qwen3_nextrdefinitions.qwen3_omni_moerdefinitions.qwen3_vlrdefinitions.qwen_driverdefinitions.qwen4_exprdefinitions.rwrdefinitions.solar_openrdefinitions.solar_open2rdefinitions.spark2_5rdefinitions.starcoder2rdefinitions.telechat2rdefinitions.unlimited_ocrrdefinitions.voxtralrdefinitions.xverserdefinitions.zambardefinitions.zamba2rTRANSFORMERS_SUPPORTS_QWEN3_5definitions.qwen3_5rdefinitions.qwen3_5_moerdefinitions.qwen3_5_moe_textrdefinitions.qwen3_5_textrrlistkeysrrrrrrrrrtrxrvrs# %'n  zz~~*D11'xBJJ#$HHYZ zz~~)400&2BJJ"#HH NORZZ',Bbjj,P )* .. %<<>>2HH$@(&+*VV(05*,..5;(;,557595:=**08=,.17,PWTj&-8(E41+*(5-/+(@./>:3)*0002@093*/,(/-/*>59<-(-,0107162..>2(&&7700LL33@@99**&&((((**..667755&&??((((**664411//**111188003311%%335500442299,,,,**,,!((< =AQ Q  22::CC;;M l  }l "l +l  J l  + l   [ l  [l  ll |l l  l  [l  ll  l  Jl   J!l " [#l ${%l & l'l (#)l * 9+l , J-l .}/l 0 91l 2 I3l 4 Y5l 67l 8(9l : j;l <z=l > ?l @&Al B?Cl DEl F#Gl H}Il J kKl L{Ml N#Ol P)Ql RySl T)Ul V iWl X%Yl Z[l \]l ^_l `.al bcl d'el f gl h,il j(kl l/ml n Zol p/ql r Jsl t{ul v +wl x lyl z L{l |L}l ~kl @ Al B"Cl D}El F [Gl H [Il J/Kl LMl N [Ol P lQl R