+ "ݳj0^RIHt^RIHtHtHtHtHt^RIt^RI t ^RI t ^RI H t ^RI Ht^RIHt] !4tRR.tRtR tR t!R R 4t!R R4t]!RR]44t]P34]/tRRltR#)) dataclass)DictListOptionalTupleUnionN) setup_logger) LoraConfig) resolve_pathzadapter_model.safetensorszadapter_config.jsonzbase_model.model.ca]tRt^toRt/t]V3RlRl4t]R4t]V3RlRl4t ]R4t V3Rlt R t Vt R #) AdapterCachez9Caches loaded adapter configs and tensors by source path.c v<V^8dQhRS[RS[S[S[S[S[S[P 3,3,,/#)pathreturn)strrrr rtorchTensor)format __classdict__s"Z/home/luca/screen-checking/.venv/lib/python3.14/site-packages/gptqmodel/adapter/adapter.py __annotate__AdapterCache.__annotate__s833s3xj$sELL?P:Q.Q(RS3c pVPPV4pV'gR#VR,VR,3#)zAReturns cached adapter config and weights for a path, if present.Nconfigweights)cacheget)clsrdatas&& rr AdapterCache.gets/yy}}T">4 ?2 2rc >\PR4/VnR#)z Clears the global adapter cache.zAdapter Cache: Resetting cacheN)loginforr!s&rresetAdapterCache.reset's 12 rcV<V^8dQhRS[RS[RS[S[S[P3,/#)rrrr)rr rrr)rrs"rrr/s5AAsAJAc5<<>O9PArc ,RVRV/VPV&R#)z?Stores adapter config and weight tensors under the source path.rrN)r)r!rrrs&&&&raddAdapterCache.add.s$VY@ $rc >VPPVR4R#)z3Drops cached adapter state for a path if it exists.N)rpop)r!rs&&rremoveAdapterCache.remove4s dD!rc|<V^8dQh/S[S[S[S[S[S[S[P 3,3,3,;R&#)rr)rrrr rr)rrs"rrrs4 T#uZ%=>>?? @ErN)__name__ __module__ __qualname____firstlineno____doc__r classmethodr r(r,r0__annotate_func____static_attributes____classdictcell__rs@rrrsdCCEE33 AA "";rrca]tRt^;toRtRV3RlRlltRRltV3RlRltV3RlR ltR t ] V3R lR l4t ] V3R lRl4t Rt VtR#)AdapterzGBase interface for runtime adapters applied on top of quantized layers.Nc&<V^8dQhRS[RS[/#)rrankr)intr)rrs"rrAdapter.__annotate__>sDDSDsDrc zWn\V\4'dVP4VnR#TVnR#)z:Initializes adapter identity and optional source location.N)rA isinstancerstripr)selfrArs&&&r__init__Adapter.__init__>s( $.tS$9$9DJJL t rc |VP'd!\VP\4'g \R4hVPP R4'd\RVP R24hV'd=VPP R4'd\RVP R24hR#R#) zLValidates that the configured adapter path matches the expected source type.z Adapter: `path` str is required.z .safetensorsz{Adapter: `path` must be a directory path or repo depending if you are saving (directory path) or loading (repo): actual = ``httpzGAdapter: `path` str in this context must be a local os path: actual = ``.N)rrEr ValueErrorendswith startswith)rGlocals&&r validate_pathAdapter.validate_pathDsyyy 499c : :?@ @ 99  n - -NOSOXOXNYYZ[\ \ yy##F++ #jkoktktjuuw!xyy, rch<V^8dQhRS[PRS[PRS[P/#rxoutrrr)rrs"rrrCUs.  u|| %,, 5<< rc R#)z:Applies the adapter contribution to a layer output tensor.Nr3)rGrVrWs&&&rapply Adapter.applyU rc:<V^8dQhRS[RS[P/#)r weight_keydevice)rrr_)rrs"rrrC[s  C  rc R#)z=Loads or finalizes adapter tensors for a specific weight key.Nr3)rGr^r_kwargss&&&,r post_initAdapter.post_init[r\rc R#)z>Applies optional backend-specific optimizations after loading.Nr3rGs&roptimizeAdapter.optimizear\rc0<V^8dQhRS[S[,/#rrrr)rrs"rrrChs  T#Y rc R#)z)Returns the serialized adapter type name.Nr3r's&rname Adapter.nameg rc"<V^8dQhRS[./#rir)rrs"rrrCos  u rc R#)z>Lists tensor attribute names expected on the adapter instance.Nr3r's&rparameter_keysAdapter.parameter_keysnrnr)rrANN)F)r4r5r6r7r8rHrRrZrbrfr9rlrrr;r<r=s@rr?r?;s[QDD z"         rr?caa]tRt^utoRtRV3RlV3Rlllt]V3RlRl4t]V3RlRl4tRV3RlR llt V3R lR lt RV3R lR llt V3RlRlt Rt RtVtV;t#)Loraz>LoRA adapter implementation backed by A/B projection matrices.cZ<V^8dQhRS[RS[RS[PRS[P/#)rrArlora_Alora_B)rBrrr)rrs"rrLora.__annotate__ys4SELLY^YeYerc ><\SV`W4W0nW@nR#)z>Initializes the adapter with optional preloaded LoRA matrices.N)superrHrxry)rGrArrxry __class__s&&&&&rrH Lora.__init__ys $  rc <V^8dQhRS[/#rirp)rrs"rrrzsSrc R#)z>Returns the canonical adapter type used in serialized configs.lorar3r's&rrl Lora.namesrc0<V^8dQhRS[S[,/#rirj)rrs"rrrzs$$tCy$rc RR.#)zCLists the tensor attributes that store the LoRA projection weights.rxryr3r's&rrrLora.parameter_keyss(##rc,<V^8dQhRS[RS[RS[/#)rbackendmode fullgraph)rbool)rrs"rrrzs"    t rc R#)z:Reserved hook for compiling the adapter path when enabled.Nr3)rGrrrs&&&&rrf Lora.optimizer\rch<V^8dQhRS[PRS[PRS[P/#rUrX)rrs"rrrzs.==u||=%,,=5<<=rc  VPVPP8wg&VPVPP8wd\PP RVPP RVPP RVP RVP R2 4VPP VPVPR7VnVPP VPVPR7VnVP4VP48dVP^,^8duVPpVPRVPR,4pVPWP,VP,4VPV4pV#VPWP,VP,4#)zQAdds the LoRA update to the kernel output, reshaping batched outputs when needed.z%Adapter: Lora A/B auto changed from `z` on `z` to `z` to match forward input.r_dtype) rrxr_r%r&oncetorydimshapeviewadd_)rGrVrWout_orgi_shapes&&& rrZ Lora.applys[ 77dkk'' '188t{{7I7I+I HHMM7 8I8I7J&QUQ\Q\QcQcPdewwivahhZ/HJ ++...HDK++...HDK 779quuw 399Q*CJ88Q_ ;< PIRVPB RVPB R24TPKY#PB\"PL8Xd\"PNM VPBR7VnTPKY$PB\"PL8Xd\"PNM VPBR7VnR#)zCLoads, caches, and materializes LoRA tensors for the target module.N)rfilenamez#Adapter: Expected `LoraConfig` in `z `, actual = `rKz5Adapter: `rank` must match `LoraConfig.r`, expected `z.lora_A.weightz.lora_B.weight) memory_formatz"Adapter: Consumed all Lora weightsz%Adapter: Lora weights not found for `zNAdapter: `lora_A` and `lora_B` must both be present in the weights: actual = `z` and `)lora_cfgr^zhAdapter: `lora_A` and `lora_B` tensors should be of dtype = [torch.float16, torch.bfloat16]: actual = `[z, z]`.r)(rxryrr rr from_pretrainedHF_ADAPTER_CONFIG_FILE_NAMEgptqmodel_pathrErNrArr HF_ADAPTER_FILE_NAMEr, safetensorsr load_fileloweritemsrOTappendclonecontiguous_formatr/lenr0r%r&warndynamic_rank_overriderfloat16bfloat16rrfloat64float32)rGr^r_rxry lora_cacher lora_path lora_weightslora_A_weight_keylora_B_weight_keypop_keyskvs&&&&& rrbLora.post_inits  &"4'- $DK !%%dii0  !11tyyKfgH&*iiH #h 33 #FtyykQ^_g^hhi!jkkyy $JJ 99 *$'\]a]f]f\ggtu}uuuAAB&CDD$TYY0DEI   TYY+2C2C2M2Mi2X Y%))$))4J) ))",%%'  *l.9)l.9 &&(DAzz+,,"-..QSS8O8OP" )   #< A%##DII.=> HH >&,,W\WdWdfkftftVuBu HHMMEFLFRFRESSUV\VbVbUccfg hiivllV[VcVcFcU]]ioiuiuiv iivllV[VcVcFcU]]ioiuiuiv rc,<V^8dQhRS[RS[RS[/#)rrr^r)r rr)rrs"rrrzs"jcdrc VPeVfQhVP'dVPP4Fwr4\V\4'd\V\4'gQhVP 4pV^8gQhW#8XgEVP V4'g.\P!V4PV4'gKW@n \PRVP RV R24R# R#)zKOverrides the adapter rank when the config defines a matching rank pattern.zAdapter: Base Lora `rank` = `z` has been overridden by `z3` due to dynamic `LoraConfig.rank_pattern` control.TF) rank_patternrrErrBrrOpcrecompilematchrAr%r&)rGrr^rrs&&& rrLora.dynamic_rank_overrides$$0Z5KKK   --335!!S))jC.@.@@@GGI1u u?ajj&<&< Q@U@UV`@a@a !IHHYhXiiklmm $$\2JA/BVBVBXAYYdfrdttvwxxK$/w/  K=gYbIJJKs 5B??C) dataclassesrtypingrrrrrrrr utils.loggerr peftr remoter r%LORA_MERGED_WEIGHT_PATHSrrHF_ADAPTER_WEIGHT_KEY_PREFIXrr?rvrlrrr3rrrs "55  ' n ":232 " "F7 7 t k 7k  k Z99;%r