+ "ݳjAb^RIt^RIHtHt^RIHt^RIHtHt^RI t ^RI H t ^RI H t ^RI HtHtHtHt^RIHt] !]4tR R ltR R lt!R R]] P0P24tRRltRRRlltRRRlltRRRllt]!RR44t!RR4t ] !4t!R#)N)ABCabstractmethod) dataclass)DictType)LogBar)tqdm)compile_module_name_filteris_within_max_layers*is_transformers_version_greater_or_equal_5matches_module_name_filter)DEBUG_ONcPV^8dQhR\PPRR/#modelreturnNtorchnnModule)formats"a/home/luca/screen-checking/.venv/lib/python3.14/site-packages/defuser/modeling/replace_modules.py __annotate__rs"$$UXX__$$cRRlpVPV4RpVP4F=wr4VPPR8XgK"\P RV R24RpK? VP 4F=wr5VPPR8XgK"\P RV R24RpK? V'g"\'d\PR 4\V4R #) zCMaterialize any deferred replacement weights attached to ``model``.cPV^8dQhR\PPRR/#rmodulerNr)rs"rr'materialize_model..__annotate__!s"))EHHOO))rcV\V\4'dVP4R#R#N) isinstanceReplacementModuleBasematerialize_weightsrs&r_materialize_module.materialize_model.._materialize_module!s! f3 4 4  & & ( 5rFmetaz Parameter z/ is still on meta device after materialization.TzBuffer zCAll parameters and buffers have been materialized from meta device.N) applynamed_parametersdevicetypeloggerwarn named_buffersrdebugrelease_original_module_)rr' found_metanameparambuffers& rmaterialize_modelr7s)  KK#$J--/  <<   & KK*TF*YZ [J0 ++-  ==   ' KK'$'VW XJ.  8V\\"ghU#rcPV^8dQhR\PPRR/#rr)rs"rrr9s"&&EHHOO&&rc4RRlpVPV4R#)zHDrop references to original fused modules after replacement is complete.cPV^8dQhR\PPRR/#rr)rs"rr.release_original_module_..__annotate__<s"--UXX__--rcV\V\4'dVP4R#R#r")r#r$release_original_moduler&s&r_clear_source_module6release_original_module_.._clear_source_module<s! f3 4 4  * * , 5rN)r*)rr>s& rr2r29s- KK$%rchaa]tRt^CtoRt/tV3RltV3RlV3Rllt]V3RlRl4t ]V3RlRl4t ]V3R lR l4t ]V3R lR l4t ]] V3R lRl44t]] V3RlRl44tRtV3RlRltV3RlRltV3RlRltV3RlRltV3RltRtVtV;t#)r$ad Abstract base class for module replacement during calibration phase. Replacement modules replace original modules to ensure all components receive data for proper quantization statistics. Subclasses must: 1. Implement `original_module_class()` to return the target module class name 2. Implement `__init__()` with signature: (self, original, config) c P<\SV`!R /VB\VRR4'EgVP4f\ VP R24hVP4VP 9dYVP VP4,p\RVP4 RVP RVP R24hWP VP4&\'d6\PRVP R VP4 24R#R#R#) z>Automatically register subclasses in the replacement registry.__abstractmethods__Nzi must implement 'original_module_class()' class method to return the name of the module class it replaceszModule 'z' already registered to z. Cannot register .z Registered z for replacing ) super__init_subclass__getattroriginal_module_class TypeError__name___replacement_registry ValueErrorrr.r1)clskwargsexisting __class__s&, rrF'ReplacementModuleBase.__init_subclass__Ss !+F+s1488((*2||n%II ((*c.G.GG44S5N5N5PQ s88:;;S(());CLL>L FI % %c&?&?&A Bx CLL>QTQjQjQlPm&nox9rcH<V^8dQhRS[PP/#)roriginalr)r __classdict__s"rr"ReplacementModuleBase.__annotate__is # # #rc<\SV`4Wn\\ V44Vn\ PVP VPPVR7RVn R#))r4original_class replacementFN) rE__init___original_modulestrid _tracker_name_global_trackerregister_replacementrPrJ _materialized)selfrSrPs&&rrYReplacementModuleBase.__init__is\  ( D],,###--66 - #rc4<V^8dQhRS[RS[R,/#)rmodule_class_namerr$)r[r)rrTs"rrrUus%@@c@dCZ>[@rc 8VPPV4#)z4Get replacement class for a given module class name.)rKgetrMrds&&rget_replacement_class+ReplacementModuleBase.get_replacement_classts((,,->??rc&<V^8dQhRS[RS[/#)rrdr)r[bool)rrTs"rrrUzs>>c>d>rc WP9#)z9Check if a module class has a replacement implementation.)rKrgs&&r is_registered#ReplacementModuleBase.is_registeredys!$=$===rcN<V^8dQhRS[PPRS[/#)rrSr)rrrrk)rrTs"rrrUs'>>hhoo> >rc LVPVPP4#)zuDetermine if the given module should be replaced. Users can extend this method to add custom logic for replacement. )rmrPrJ)rMrSs&&ris_to_be_replaced'ReplacementModuleBase.is_to_be_replaced~s!  !3!3!RVn\PV4R#)z8Release reference to the original module to free memory.N)rZr^release_originalrs&rr=-ReplacementModuleBase.release_original_modules $((.rcH<V^8dQhRS[PP/#rtr)rrTs"rrrUs%%ehhoo%rc LVPf \R4hVP#)z9Get the original module associated with this replacement.z*Original module has already been released.)rZ RuntimeErrorrs&r_get_original_module*ReplacementModuleBase._get_original_modules&  (KL L$$$rc<V^8dQhRR/#rrD)rrTs"rrrUs''d'rc 4RVnVP4R#)z,Mark the replacement module as materialized.TN)r`r=rs&rr2ReplacementModuleBase.post_process_materializations! $$&rcJ<V^8dQh/S[S[S[R,3,;R&#)rr$rK)rr[r)rrTs"rrrUCs" T*A%B BCHr)r`rZr])rJ __module__ __qualname____firstlineno____doc__rKrFrY classmethodrhrmrqryrrHrr%rr=rr__annotate_func____static_attributes____classdictcell__ __classcell__rPrTs@@rr$r$Cs GIp, # #@@>>>>66    0   // %% ''irr$c\V^8dQhR\PPR\RR/#)rrlabelrN)rrrr[)rs"rrrs)rc VP4F]wr#VPR4'gKRV9gK'\PRV RV RVPP RV 24R# R#)z>Log the first experts module found in the model for debugging.z.expertsrZz Experts (z) [z] (z): N) named_modulesendswithr.inforPrJ)rrr4rs&& r_log_first_moe_blockrsf++-  MM* % %&d2 KK)E7#dV3v7G7G7P7P6QQUV\U]^ _  .rcnV^8dQhR\PPR\\,/#)rrr)rrrrur[)rs"rrrs&uxxd3irc^RIHpHpV!4'g\P R4.#V!WR7pV'd#\P R\ V4 R24V#)zHandle fused MOE modules using transformers' linear_loop backend. Args: model: The model to process Returns: List of module names that were processed )is_linear_loop_available"prepare_model_for_moe_quantizationztransformers' linear_loop experts interface not available (requires transformers 5.0+). MOE modules with @use_experts_implementation decorator will fall back to custom replacements if registered. filter_rulesz Prepared z MOE modules for quantization)&defuser.modeling.moe_experts_interfacerrr.r/rlen)rrrrunfuseds&& r_handle_moe_modulesrsX $ % %    1RG iG ~-JKL NrcV^8dQhR\PPR\R\R,R\PP/#)rrauto_detect_moe max_layersNr)rrrrkint)rs"rrrsD''xx''$J'  XX__ 'rc\VR4V'd\4'd \WR7\WVR7\VR4V#)a7 Function to apply module replacements to a model. This scans all modules in the model and replaces any registered modules with their replacement equivalents. Non-permanent modules are tracked for later restoration. The model is modified in-place, so the same model object should be used. Args: model: The model to apply module replacement to (modified in-place). auto_detect_moe: If True, automatically detect and handle fused MOE modules (transformers 5.0+ pattern). Default is True. max_layers: If provided, only replace modules under ``layers.`` where ``idx < max_layers``. filter_rules: Optional regex rules selecting which candidate module paths are allowed to be defused. Negative rules take priority over positive ones. Returns: The model with modules replaced. zbefore replacementr)rrzafter replacement)rr r_apply_custom_replacements)rrrrs&&&&rapply_replacementsrsA4 45EGGE=u,W 34 LrcrV^8dQhR\PPR\R,R\/#)rrrNr)rrrrru)rs"rrr s7DDxxD$JD Drc .p\V4p\'d\PR4.pVP 4Fwrg\ V\ 4'dK\Wa4'gK0\Wd4'gKCVPPp\ PV4'gKv\ PV4PV4'gKVPWgV34K V'Ed\PR\!V4 R24\#VRR7EFowrgpVP%V4pVPPV8wdA\'d3\PRV RV RVPP 24Ks\Wd4'g(\'d\PRV R 24K\ PV4p V PV4'g(\'d\PRV R 24K\'VP)44P*p V P-VVP.4P1V 4p VP3Wk4VPWi34EKr M!\'d\PR 4V'd#\PR \!V4 R 24V#)zScan model and replace registered modules with custom implementations. Args: model: The model to scan and apply replacements to (modified in-place). Returns: List of (name, replacement_class) tuples for replaced modules. zScanning for modules to replacezFound z modules to replacezReplacing modules)desczSkipping replacement for z: class changed from z to z : module path excluded by filterz(: no longer matches replacement criteriaz No modules found for replacementz Replaced z modules)r rr.r1rr#r$r r rPrJrmrhrqappendrrr get_submodulenext parametersdtyperrto set_submodule) rrrreplacedmodule_name_filtermodules_to_replacer4r class_namereplacement_cls orig_dtyperXs &&& rrr sqH3LAx?@++-  f3 4 4 #D55 )$CC %%.. . .z : :?T?j?j@  F #@$@$  % %tZ&@ A. fS!3455HIJ(,-?FY(Z(Z $D*((.F((J68LL3D69NzlZ^_e_o_o_x_x^yz-dGG8LL#04 -rc<V^8dQhRR/#)rrrrD)rrTs"rr%ModuleReplacementTracker.__annotate__vs7rc NVPf V!4VnVP#)z*Get the singleton instance of the tracker.)rrxs&r get_instance%ModuleReplacementTracker.get_instanceus! == ECM}}rc0<V^8dQhRS[RS[RS[RR/#)rr4rWrXrN)r[r$)rrTs"rrr|s9PPP P/ P  Prc \V4pWPV&\VVPP\ P !V4R7VPV&\'d\PRV 24R#R#)zRegister a module replacement.)rHrrz#Registered replacement for module: N) r\rrrPrJweakrefrefrrr.r1)rar4rWrXreplacement_ids&&&& rr_-ModuleReplacementTracker.register_replacement|sjK48!!.1#5"0%0%:%:%C%C#*;;{#;$ 4 8V\\$Gv"NO8rc\<V^8dQhRS[RS[PPR,/#rrXrN)r$rrr)rrTs"rrrs*,,(=,%((//TXBX,rc VP#)z7Get the original module for a given replacement module.)rZ)rarXs&&r get_original%ModuleReplacementTracker.get_originals+++rc4<V^8dQhRS[RS[R,/#)rr4rN)r[r)rrTs"rrrs!S-?$-Frc VPPV4pVfR#VP4fVPVR#V#)z$Get replacement info by module name.N)rrfr)rar4rs&& rget_info_by_name)ModuleReplacementTracker.get_info_by_namesE!!%%d+ <  & & ( 0""4( rc$<V^8dQhRS[RR/#r)r$)rrTs"rrrs d d,A dd drc 6\V4pVPPVR4pVenVPP V4pVe'VP 4pVeWQJdVPV\ 'd\PRV 24R#R#R#)zARelease the original module associated with a replacement module.Nz)Released original module for replacement ) r\rpoprrfrrr.r1)rarXrr4rreplacement_refs&& rr)ModuleReplacementTracker.release_originalsK((,,^TB  %%))$/D"&"="="?"*o.L**40x(QR`Qa&bcx rc<V^8dQhRR/#rrD)rrTs"rrrs Y Yt Yrc ^pVPP4F9pVP4pVfKVPfK)RVnV^, pK; VPP 4VPP 4V^8d*\ 'd\PRV R24R#R#R#)z%Release all tracked original modules.Nz Released z original modules from tracker) rvaluesrrZrclearrr.r1)racountrrXs& rrelease_all_originals.ModuleReplacementTracker.release_all_originalss&&--/D557K&;+G+G+S/3 ,  0 !!'')   " 19x %8V&WXx rc<V^8dQhRR/#rrD)rrTs"rrrsHHtHrc VPP4VPP4\'d\P R4R#R#)zClear all tracked information.z"Cleared module replacement trackerN)rrrrr.r1rs&rrModuleReplacementTracker.clears9 !!'')   " 8V\\"FG8r)rr)rJrrrrrrrrYrrr_rrrrrrrrrs@@rrr[s~ IL 5 PP ,, d d Y YHHHrrr")TNN)NN)"rabcrr dataclassesrtypingrrrlogbarrr defuser.utils.commonr r r r defuserrrJr.r7r2rrr$rrrrrrr^rDrrrs#!   $6&w'Cw't:'TDN KK K ]H]H@+,r