+ j*aRt-0t^RIt^RIHt^RIHt^RIHuHuH t ^RI Ht^RI H t HtHt.ROtRtRtRtRtR t/]P,]P.3]b]P,]P.]P03]b]P2]P43]b]P2]P4]P03]b]P6]P83]b]P6]P8]P03]b]P,]P03]!] P:4b]P2]P03]!] P<4b]P6]P03]!] P>4b]P@]P.3]b]P@]P03]!] PB4b]P4]P03]!] PD4b]P8]P03]!] PF4b]PH]P.3]b]PJ]P43]b]PL]P83]bt']^kRR lt(R t)R t*R t+RRlt,R#)N)Callable)Any)get_combined_dict MatchAllNodePatternc~VPVP8wd \R4h\P\P \P \P\P\P/pV'dVPVP8wd \R4hVP'g \R4hVP'g \R4hVP\V44pVe V!W4#\!RW3 24h\P"P%W4#)aReturn the fused conv and bn modules. Given the conv and bn modules, fuses them and returns the fused module Args: is_qat: a flag for whether we are using quantization aware training fusion or post training quantization fusion conv: Module instance of type conv2d/conv3d bn: Spatial BN instance that needs to be fused with the conv Examples:: >>> m1 = nn.Conv2d(10, 20, 3) >>> b1 = nn.BatchNorm2d(20) >>> # xdoctest: +SKIP >>> m2 = fuse_conv_bn(m1, b1) :Conv and BN both must be in the same mode (train or eval).z@Output channel of Conv2d must match num_features of BatchNorm2d.7Only support fusing BatchNorm2d with affine set to TrueGOnly support fusing BatchNorm2d with tracking_running_stats set to TrueCannot fuse train modules: )trainingAssertionErrornnConv1dnniConvBn1dConv2dConvBn2dConv3dConvBn3d num_features out_channelsaffinetrack_running_statsgettypeNotImplementedErrorutilsfuse_conv_bn_eval)is_qatconvbnfused_module_class_mapfused_module_classs&&& l/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/ao/quantization/fuser_method_mappings.py fuse_conv_bnr&s" }} # H  3<< 3<< 3<<  ??d// / R yyy I %%% Y 477T C  )%d/ /%(CTJ<&PQ Qxx))$33cVPVPu;8XdVP8XgM\R4hRpV'd\P\P \P \P\P\P/pVPVP8wd \R4hVP'g \R4hVP'g \R4hVP\V44pVe V!WV4#\!RWV3 24h\P\P"\P \P$\P\P&/pVP\V44pVe2\P(P*P-W4pV!Ws4#\!RWV3 24h)aReturn the fused conv and bn modules. Given the conv and bn modules, fuses them and returns the fused module Args: is_qat: a flag for whether we are using quantization aware training fusion or post training quantization fusion conv: Module instance of type conv2d/conv3d bn: Spatial BN instance that needs to be fused with the conv Examples:: >>> m1 = nn.Conv2d(10, 20, 3) >>> b1 = nn.BatchNorm2d(20) >>> r1 = nn.ReLU(inplace=False) >>> # xdoctest: +SKIP >>> m2 = fuse_conv_bn_relu(m1, b1, r1) r Nz?Output channel of Conv2d must match num_features of BatchNorm2dr r r zCannot fuse eval modules: )r rrrr ConvBnReLU1dr ConvBnReLU2dr ConvBnReLU3drrrrrrr ConvReLU1d ConvReLU2d ConvReLU3drfusionr)r r!r"relu fused_modulemap_to_fused_module_trainmap_to_fused_module_eval fused_convs&&&& r%fuse_conv_bn_relur5Gs& MMR[[ 9DMM 9 H  04L IIs'' IIs'' IIs''% ! ??d// / Q yyy I %%% Y 144T$Z@  #$/ /%(CTtDTCU&VW W IIs~~ IIs~~ IIs~~$  033DJ?  #::4DJ 1 1%(BDdCSBT&UV Vr'cVPVP8wd \R4hV'dwVPVP8wd \R4hVP'g \R4hVP 'g \R4h\ P!W4#\PPPW4#)aReturn the fused linear and bn modules. Given the linear and bn modules, fuses them and returns the fused module Args: is_qat: a flag for whether we are using quantization aware training fusion or post training quantization fusion linear: Module instance of type Linear bn: BatchNorm1d instance that needs to be fused with the linear layer Examples:: >>> m1 = nn.Linear(20, 10) >>> b1 = nn.BatchNorm1d(10) >>> # xdoctest: +SKIP >>> m2 = fuse_linear_bn(m1, b1) z>r'cVPVP8wd \R4hV'd \R4h\PP P WRR7#)aReturn the fused ConvTranspose and bn modules. Given ConvTranspose and bn modules, fuses them and returns the fused module Args: convt: Module instance of type ConvTransposeNd bn: BatchNormNd instance that needs to be fused with the linear layer. batch norm N should match the ConvTranspose N Examples:: >>> m1 = nn.ConvTranspose2d(10, 20, 3) >>> b1 = nn.BatchNorm2d(20) >>> # xdoctest: +SKIP >>> m2 = fuse_convtranspose_bn(m1, b1) zCConvTranspose and BN both must be in the same mode (train or eval).z8Fusing ConvTranspose+BatchNorm not yet supported in QAT.T) transpose)r r Exceptionrrr/r)r convtr"s&&&r%fuse_convtranspose_bnr@sY  ~~$ Q   F  xx00d0KKr'caV3RlpV#)aReturn a sequential wrapped that for is_qat and two modules. Given a sequential class for two modules, return a function that takes is_qat, and then two modules as argument, that ignores the is_qat flag and always returns the sequential that combines the two input modules c<S!W4#N)r m1m2 sequentials&&&r% fuser_method*_sequential_wrapper2..fuser_methods"!!r'rD)rGrHsf r%_sequential_wrapper2rJs" r'c|Vf/p\\V4pVPVR4pVf\RV R24hV#)zGet fuser method for the given list of module types. Get fuser method for the given list of module types, return None if fuser method does not exist Ndid not find fuser method for:  )r _DEFAULT_OP_LIST_TO_FUSER_METHODrr)op_listadditional_fuser_method_mapping all_mappingsrHs&& r%get_fuser_methodrRsU '.*,'$(*IL ##GT2L>wiqIJJ r'caV3RlpV#)c<S!WV4#rCrD)r xyfs&&&r%reversed_reverse2..reversedsAr'rDrWrXsf r% _reverse2r[s Or'caV3RlpV#)c<Vwr4S!WW14#rCrD)r rUwrVzrWs&&& r%rX_reverse3..reversedsA!!r'rDrZsf r% _reverse3ras" Or'c\V\\34'd:VUu.uFp\V4NK pp\\P !V!4pV#V\ .pV#uupi)a Return a list of valid patterns generated from the op_pattern. Returns a list of valid patterns generated from the op_pattern, since MatchAllNode can match all types of nodes, e.g. pattern (torch.nn.Conv2d, torch.add) should also be able to match keys like (MatchAllNode, torch.add) and (torch.nn.Conv2d, MatchAllNode) Example Input: (torch.add, (torch.nn.ReLU, torch.nn.Conv2d)) Example Output: [(torch.add, (torch.nn.ReLU, torch.nn.Conv2d)), (torch.add, (torch.nn.ReLU, MatchAllNode)), (torch.add, (MatchAllNode, torch.nn.Conv2d)), (torch.add, (MatchAllNode, MatchAllNode)), (MatchAllNode, (torch.nn.ReLU, torch.nn.Conv2d)), (MatchAllNode, (torch.nn.ReLU, MatchAllNode)), (MatchAllNode, (MatchAllNode, torch.nn.Conv2d)), (MatchAllNode, (MatchAllNode, MatchAllNode)), ] ) isinstancetuplelist_get_valid_patterns itertoolsproductr) op_pattern sub_pattern sub_combsresults& r%rfrf sb.*udm,,IST+(5 Ti''34 Ml+ M UsA c|V^8dQhR\R\\\P\,3,/#)rifuser_method_mapping)rdictr Sequentialr)formats"r% __annotate__rs)s/w (@@Ar'c\V4pRpVFpVPV4pVfKM Vf\RV R24hV#)zGet fuser method. This will be made default after we deprecate the get_fuser_method Would like to implement this first and have a separate PR for deprecation NrLrM)rfrr)riro op_patternsrHs&& r%get_fuser_method_newrv)sY&j1KL! +// ;  # ">zl!LMM r'cV^8dQh/^\9d0\\\P\ ,3,;R&#)rnrN)__conditional_annotations__rprdrrqr)rrs"r%rsrss3h$ubmmh.F'F"Gir')r&r5r;r@rRrvrC).rxrgcollections.abcrtypingrtorch.ao.nn.intrinsicaor intrinsicrtorch.nntorch.ao.quantization.utilsrrr__all__r&r5r;r@rJr BatchNorm1dReLUr BatchNorm2dr BatchNorm3dr,r-r.Linear LinearReLUBNReLU2dBNReLU3dConvTranspose1dConvTranspose2dConvTranspose3drNrRr[rarfrvrs)rxs@r%rsc$##PP /4d:Wz%?PL: KYYKYY(*;KYYKYY(*; K YY K YY(*; KYY.s~~>KYY.s~~>KYY.s~~>KYYKYY.s~~>K^^RWW3CLLAK^^RWW3CLLAK(*?K(*?K (*?!K (">r'