+ "ݳj[<B^RIt^RIt^RIHtHtHtHtHtHt^RI t ^RI H t ^RI H t ^RIHtHtHt^RIHtHtHtHt^RIHt^RIHt^R IHtHtHtHtH t H!t!^R I"H#t#^R I$H%t%^R I&H't'^R I(H)t)^RI*H+t+H,t,H-t-H.t.H/t/^RI*H0t0H1t1H.t.H/t/]%!4t2!RR]4t3R#)N)AnyCallableDictListOptionalTuple)Module)Lora)eora_compute_loraeora_process_inputmerge_eora_segments)DTYPE_SIZE_COLUMNExecutionConfigMODULE_FEATURE_COLUMN LoopProcessor NamedModule BaseQModel)PROCESS_LOG_FWD_TIMEPROCESS_LOG_LAYERPROCESS_LOG_MODULEPROCESS_LOG_NAMEPROCESS_LOG_TIMEPROCESS_USED_MEMORY)QuantizeConfig) setup_logger) get_device)move_to)CPUDEVICE_0DEVICE_1torch_streamCtx torch_sync)HAS_CUDAtf32_disable_guardr#r$c"aa]tRt^toRtRV3RlV3RllltV3RltV3RltRtV3RlRlt V3R lR lt V3R lR lt V3R lRlt V3RlRlt RV3RlRlltV3RlRltV3RlV3RlltV3RlRltV3RlRltRtVtV;t#) EoraProcessorzOBuilds LoRA-style error adapters from dequantization residuals and activations.c n<V^8dQhRS[RS[S[,RS[S[,RS[RS[RS[S[,/#)qcfgcalibration_concat_sizecalibration_sort batch_size require_fwdcalibration_concat_separator)rrintstrbool)format __classdict__s"`/home/luca/screen-checking/.venv/lib/python3.14/site-packages/gptqmodel/looper/eora_processor.py __annotate__EoraProcessor.__annotate__!sU*5*5*5 "*# *5#3-*5*5*5'/sm*5c  $<\S V`VVVVVV VV\VR7R7 /Vn/Vn\ P PP^@8d ^@\ P Pn\Vn \Vn R#)zFInitializes EoRA processing and per-module segment accumulation state.)r/) tokenizerr+ calibrationr,r-r0prepare_dataset_funcr.execution_configN) super__init__r_segment_accumulators_module_target_devicestorch_dynamoconfigcache_size_limitr r ) selfr;r+r<r=r,r-r.r/r0 __class__s &&&&&&&&&&r6r@EoraProcessor.__init__!s #$;-)E!5!,E  UW"?A# ==   0 02 546EMM 1"3"4r9c <\SV`4pVR,P4UUu/uF8wr#VRVPRVPRVP RVP /bK: uppVR&V#uuppi)resultsrankpathlora_Alora_B)r?continuation_state_dictitemsrLrMrNrO)rGstatenameadapterrHs& r6rP%EoraProcessor.continuation_state_dictMs/1"'y!1!7!7!9 ":    '..'..   ": i  s>A1c <\V4pVR,P4UUu/uFwr4V\R/VBbK uppVR&\SV`V4R#uuppi)rKN)dictrQr r?load_continuation_state_dict)rGrRrestoredrSspecrHs&& r6rY*EoraProcessor.load_continuation_state_dict[sZ;16y1A1G1G1I 1I:4D$,, 1I  ,X6 sAc 2Wn\V4VnR#)zDStores the calibration dataset because EoRA depends on batch counts.N)calibration_datasetlen num_batches)rGr^s&&r6set_calibration_dataset%EoraProcessor.set_calibration_datasetbs$7 23r9c <V^8dQhRS[/#)r*moduler)r4r5s"r6r7r8hsr9c BVPPVPR7R8Xd RVnR#\P !VPP 4pVPPVPRRVPR7VnW1n\VP4pVPR8Xd\P!R4p\P!V4VPVP&/VPVP&R#) zLClones adapter config, applies rank overrides, and initializes accumulators. layer_nameFNrTrL)keysub_keydefaultmetacpu)r+ dynamic_get full_name adapter_cfgcopydeepcopyrTrLrrdtyperCdevicerBrSrA)rGrdkwargsro target_devices&&, r6 preprocessEoraProcessor.preprocesshs 99 F,<,< = F!%F  mmDII$5$56  9900  #(( 1* )"6==1    '!LL/M38<< 3N##FKK024""6;;/r9c&<V^8dQhRS[RS[/#)r*rdreturn)rr3)r4r5s"r6r7r8s0000r9c $VPR/39#)zDReports whether EoRA was disabled for this module by dynamic config.N)ro)rGrds&&r6 is_skippedEoraProcessor.is_skippeds!!dBZ//r9c<V^8dQhRS[RS[S[S[S[P R3,S[P .R3,/#)r*rSry.N)r2rr rrCTensor)r4r5s"r6r7r8sC65WZIZC[]b]i]i:jlp:p1qr9c aaRVV3RllpV#)zEReturns the forward hook that accumulates EoRA activation statistics.crV^8dQhR\\PR3,R\P/#)r*input.output)rrCr~)r4s"r6r78EoraProcessor.pre_process_fwd_hook..__annotate__s,  uU\\3%67  r9c<SP4pSPVSSPVPPP R7wrEpSP SVVVVR7R#)z@Processes one batch of inputs into an EoRA contribution segment.)rrS sample_sizers)rS batch_indexbatch contributionscaleN)current_batch_indexr r`weightdatars_accumulate_eora_contribution) rdrrrrrrrSrGs &&& r6tmp/EoraProcessor.pre_process_fwd_hook..tmpst224K)-)@)@ ,,}}))00 *A* &E  . .') / r9rW)rGrSrsff r6pre_process_fwd_hook"EoraProcessor.pre_process_fwd_hooks  $ r9c `<V^8dQhRS[RS[S[,RS[RS[PRS[RR/#)r*rSrrrrryN)r2rr1rCr~float)r4r5s"r6r7r8sQ999c] 9  9 ll 99 9r9c  V^8:dR#VP4p\P!VP4p\V4pVP;_uu_4VP P V/4pVPV4p Ve \V4M^p V fRVRVRV RV R^/p WV&RRR4R#V R,p V PVP8wdV PVPR7p V PV4V PV4WR&V R;;,V,uu&V R;;,^, uu&VeE\V4p V R,eWR,8dWR&V R,eWR,8dWR&M9V PR4fV R,^, V R&V R,^, V R&?RRR4R# +'giR#;i)zEMerges one EoRA contribution segment into the per-device accumulator.Ntotal scale_product start_index end_indexcountrs) detachrCrsrlockrA setdefaultgetr1tomul_add_) rGrSrrrrrs scale_value accumulatorsrecord index_valuer batch_values &$$$$$ r6r+EoraProcessor._accumulate_eora_contributions A: #**, l112El YYY55@@rJL!%%f-F.9.E#k*1K~\#[!;Q (.V$Y"7OE|||222 (;(;< JJ{ # JJ| $#7O ? #{ 2 # 7Oq O&!+. -(0KBW4W,7=)+&.+{@S2S*5;'::m,4,27Oa,?F=)&,Wo&9{#OYYYsAG7DG G$ c:<V^8dQhRS[RS[P/#)r*rSry)r2rCr~)r4r5s"r6r7r8s22325<<2r9c VP;_uu_4VPPV/4pVPPVR4pRRR4X'g\ RV R24h\ VP 4RR7pXf1V^,R,p\P!VP4p.pVFapVR,pVPV8wd"VPV\PR7pVPV\VR,434Kc \V4# +'giL;i) z?Merges accumulated EoRA segments into the final scaling matrix.NzEoRA statistics for module 'z'' were not collected before processing.c&VPR^4#)r)r)rs&r6>EoraProcessor._finalize_eigen_scaling_matrix..svzz-;r9)rhrrsdtyper)rrApoprB RuntimeErrorsortedvaluesrCrsrfloat32appendrr ) rGrSsegmentsruordered_segments first_total segment_pairsrrs && r6_finalize_eigen_scaling_matrix,EoraProcessor._finalize_eigen_scaling_matrixsYYY1155dB?H 77;;D$GM.tf4[\ " OO ;   *1-g6K!LL););P=RVP@ RVP 24R R R 4\$PBPE\F4pVPR^4R, pVPR^4R, p\$PBPI4^8da\$PBPE\J4pVPR^4R, pVPR^4R, pVR RVR R2pMVR R2p\LVP 4\NVP@\PVP\RVPUV4\VVPYV4\ZVR \\VP_4\`V/pVPbPde*VPbPgVPhR7VR&VP8;_uu_4VPjP=V4R R R 4VPmV4\VPP,\1VP#VP R7\2R7\1VP#VP R7\2R7R7pVPP/RV/4VPP!RR 4R # +'giEL;i +'giL;i)zCComputes and installs the LoRA correction for one quantized module.zEoRA: Processing z (z ) in layer tp_pad_infopad_colsoriginal_columns w_wq_diff)rrs:NNNNwqrzw_wq_delta dtype: ) w_wq_deltarSeigen_scaling_diag_matrixrLrrsrzlayer--zactive_bytes.all.currentzactive_bytes.all.peakz.2fzMB, MBz.3frfdynamic)r)rLrNrOrTi)7 isinstanceror draw_progressrS module_dtypetimerrRrrrshaperXr1rsrrrCrrr rLupdaterr float16bfloat16r durationsr module_names layer_indexcuda memory_statsr! device_countr"rrrrmodule_feature_summaryrmodule_dtype_size_summaryrrformatted_fwd_timerr+rrmrnlog log_new_row) rGrdrsrrrrstartrtp_infor original_colsrur valid_colsr wq_deviceAB computed_wqcomputed_wq_trimwq_trimdurationstats_0active_0 peak_active_0stats_1active_1 peak_active_1 max_memorystateoras &&&&&&& r6processEoraProcessor.processsF&,,d3333 .v{{m2f>Q>Q=RR\]^ $($G$G $T!,,""=1 **003 gt $ $7;;z15::;H ,> NOM **11 #)<<#3#3K#@#C#C-- $D$  &1J#A{ {N3J!<<- A{ {N#BEE6I6IEJ 5==0Y4FzGWGWFX2YY0%%!&?##((%%==%%,, & 1 &!AE*..RXXm.T *1n}n+<= N]N*+G* G  ''#.    U]]ENN$CCCC.00v}}7I7I7O7OXe0f  {99;& YYY NN ! !( +    $ $vf.@.@-A6;;-%P Q**))(3;;91= I $;Q?)K :: " " $q (jj--h7G{{#=qAIMH#KK(?CiOM)#.d=2ERHJ)#.b1J diik v11  !4#>#>v#F t==fE # $"9"9";    99   ("ii33v?O?O3PDO YYY HHOOD ! '',,qtt&*=*=t>sKqtt&*=*=t>sK   t    -_YY>Ys AY;Z; Z  Z c&<V^8dQhRS[RS[/#)r*rdmodel)rr)r4r5s"r6r7r8sHHHZHr9c pVPVPVPPR44R#)z@Stores the finalized adapter object in the processor result map.rTN) result_savernrRr)rGrdrrts&&&,r6submodule_finalize EoraProcessor.submodule_finalizes) ))6<<+;+;I+FGr9c <V^8dQhRS[/#)r*rr)r4r5s"r6r7r8s 0 0j 0r9c ^<V=V=VP4Vn\SV`!RRV/VBR#)zGReleases accumulators and attaches the collected adapters to the model.rNrW)rArBrK lora_resultsr?finalize)rGrrtrHs&&,r6rEoraProcessor.finalizes6  &  '"\\^ /u//r9c&<V^8dQhRS[RS[/#)r*processor_indexry)r1r3)r4r5s"r6r7r8s#$r9c JVPfV^8Xd \R4hR#R#)zPRequires calibration on the first EoRA stage and reuses later caches thereafter.z5EoraProcessor's calibration_dataset must be provided.FT)r^ ValueError)rGrs&&r6verify_calibration_dataset(EoraProcessor.verify_calibration_datasets*  # # +!# !XYYr9c <V^8dQhRS[/#)r*ry)r2)r4r5s"r6r7r8scr9c R#)zAReturns the processor label used in logs and lifecycle reporting.rrW)rGs&r6rSEoraProcessor.namesr9)rBrAr^r r r`)TN)NNNNN)__name__ __module__ __qualname____firstlineno____doc__r@rPrYrarvr{rrrrrrrrS__static_attributes____classdictcell__ __classcell__)rHr5s@@r6r(r(sY*5*5X 74 :00 .99v22rsg  == "RRll-VV0'%!NNSSnCMCr9