+ j ^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIHt^RI H t H t ^RIH t ^RI HtHtHtHt^RIHtHt^RIHt^RIHt^R IHtHtHt^R IHt^R IH t ^R I!H"t"^R I#H$t$H%t%^RI&H't'H(t(^RI)H*t*]'d ^RI+t+^RI,H-t-^RI.t.^RI/H0uH1t2^RI3H4t4H5t5H6t6H7t7H8t8H9t9H:t:H;t;Ht>H?t?H@t@HAtAHBtBHCtC^RIDHEtE^RIHFtF^RIHGtG^RIHHItIHJtJ^RIKHLtL^RIMHNtN^RIOHPtP^RIQHRtR^RISHTtTHUtUHVtVHWtWHXtXHYtYHZtZH[t[H\t\H]t]H^t^H_t_H`t`.R8Ota] ].PP.]PR,3,td]P!RR44tf]P!RR44tgR thR!R"lti].PPP].PPP].PPP].PPP].PPP].PPP].PPP].PPP].PPP].PPP].PPP].PPP. tx].PPP].PPP].PPP].PPP].PPP].PPP].PPP].PPEP].PPEP. t] R#4tR$R%ltR&R'ltR(R)ltR*R+ltR,R-ltR.R/ltR0R1lt!R2R4tR3tR9R4R5lltR6tR7tR#):N) defaultdict)CallableIterator)contextmanager)Anyfinal NamedTuple TYPE_CHECKING)tracingTracingContext)autograd_not_implemented)FakeScriptObject)_deregister_op_impl_is_op_registered_to_fake_ruleregister_op_impl)FakeTensorMode)_ConstantAttributeType)#first_call_function_nn_module_stack)_PyTreeCodeGen _PyTreeInfo)immutable_dictimmutable_list)insert_deferred_runtime_asserts) ValueRanges) _build_cache_collect_all_valid_cia_ops_collect_and_set_constant_attrs_collect_param_buffer_metadata_detect_fake_mode_from_gm_fakify_params_buffers_get_decomp_for_cia_is_preservable_cia_op_name_hoo_subgraph_placeholders7_override_graph_signature_for_temp_registered_constants/_overwrite_signature_for_non_persistent_buffers)_populate_param_buffer_metadata_to_new_gm_register_constants_as_buffers_rename_without_collisions_special_op_to_preserve_ciaplaceholder_naming_pass)Verifierdetect_fake_modeunset_fake_temporarily) is_equivalentreorder_kwargsCustomDecompTable) compatibility) PassResult) PassManager) ArgumentSpecConstantArgumentCustomObjArgumentExportGraphSignature InputKind InputSpec OutputKind OutputSpecSymBoolArgumentSymFloatArgumentSymIntArgumentTensorArgument TokenArgumentExportedProgramModuleCallEntryModuleCallSignaturec6a]tRt^atoRtRtV3RltRtVtR#)rFNc VPF1pVPVP8XgK VPVnK3 VPF1pVPVP8XgK VPVnK3 R#N)inputsnameoutputs)self original_nodenew_nodeios&&& ^/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/export/exported_program.pyreplace_all_uses_with)ModuleCallSignature.replace_all_uses_withisZAvv+++!Avv+++!c<V^8dQh/S[S[,;R&S[S[,;R&S[P;R&S[P;R&S[S[,R,;R&#)rJrLin_specout_specNforward_arg_names)listr7pytreeTreeSpecstr)format __classdict__s"rR __annotate__ ModuleCallSignature.__annotate__as_  , __  oo  Cy4'. rU) __name__ __module__ __qualname____firstlineno__rZrS__annotate_func____static_attributes____classdictcell__r`s@rRrFrFas +/'rUc0a]tRt^rtoRtV3RltRtVtR#)rENc@<V^8dQh/S[;R&S[R,;R&#)rWfqnN signature)r^rF)r_r`s"rRraModuleCallEntry.__annotate__rs! H#T)0rUrc)rdrerfrgrorhrirjrks@rRrErErs-1IrUcFa\P!S4V3Rl4pV#)cv<\4;_uu_4S!V/VBuuRRR4# +'giR#;irIr.)argskwargsfns*,rRwrapper/_disable_prexisiting_fake_mode..wrapperys( # % %t&v&& % % %s' 8 ) functoolswraps)rurvsf rR_disable_prexisiting_fake_moderzxs%__R'' NrUc V^8dQhR\R,R\PR\R,R\PR\/#)rW spec1_typeN spec1_context spec2_type spec2_contextreturn)typer\Contextbool)r_s"rRrarasQGGt G>>Gt G>> G  GrUc>VeVfWJ;'dW8H#\V\\34'd!\V\\34'dW8H#\V\\34'd!\V\\34'dW8H#WJ;'dW8H#)z]Treat containers and their immutable variants as the same type. Otherwise compare as normal. ) issubclassdictrr[r)r|r}r~rs&&&&rR_fx_collection_equivalence_fnrsZ/'JJM,JJ*t^455*T>*;;--*t^455*T>*;;--  # F F (FFrUc #"/p\4pVP4EFwr4VPP4W&VP V4\ F7pWSP9gKVP V4!\VRR74K9 \V4p\PPPVP9d0VP\PPPVP \PPP4!V4Rp\V4'g(\V4!\P !VVR74\"F,pWP9gKVP V4!V4K. EK RxVFcp V PP%4V PP'W,4V P(P%4\+V 4Ke R# TFcp T PP%4T PP'Y,4T P(P%4\+T 4Ke i;i5i)T)deferred_errorc|VR,pVRV;_uu_4V!V/VBuuRRR4# +'giR#;i)original_callableNrc)fake_tensor_modeoprsrtorig_cia_callables&&*, rR$_force_dispatch_to_orig_cia_callableQ_override_composite_implicit_decomp.._force_dispatch_to_orig_cia_callables9 &': ; *+!!($9&9"!!!s* ; )rN)setitems py_kernelscopyadd(_AUTOGRAD_ALIAS_BACKEND_KEYS_TO_OVERRIDEpy_implr r!torch_C DispatchKeyCompositeImplicitAutogradrrrxpartial_BACKEND_KEYS_TO_OVERRIDEclearupdate_dispatch_cacher) cia_ops_to_callable saved_tables patched_ops op_overloaddecomp_callableoverride_dispatch_keyrrkeyrs & rR#_override_composite_implicit_decomprsL%K(;(A(A(C$ $/$:$:$?$?$A ! $%M !$,B,BB##$9:,[N&N0 < 88   9 9[=S=S S&&uxx';';'U'UVEHH00JJK   : .k:: [ )!!8&7 -C000 ##C():;#-Y)D~$ B MM   ! MM !1 2    $ $ &  # +B MM   ! MM !1 2    $ $ &  # s-A&J -DJ  J 0H4A+J A+J  J cV^8dQhR\\PP\3,R\ \\PP\3,R3,/#)rW decomp_tabler.)rr_ops OperatorBasertuple)r_s"rRrarasN,-,-uzz..89,- 4 ''1 2C 78,-rUc\\44p/p\VP44FzpW19d W,W#&VP V4WK(\ V4'gK;VP 4pVPR4'd\RV 24hW,W#&K| VF p\W%&K W 3#)atenz)This should be a custom op, got aten op: ) rrr[keysremover"rK startswithAssertionErrorr))rall_preservable_cia_opsrrop_nameks& rR,_split_decomp_table_to_cia_and_python_decomprs""<">?<$$&'$  (&2&6  # # * *2 . $B ' 'ggiG!!&))$?yI'3&6  #?(F%!<%  ,,rUcV^8dQhRR/#)rWrr3rc)r_s"rRraraBs 3rUc\4#)z This is the default decomposition table which contains decomposition of all ATEN operators to core aten opset. Use this API together with :func:`run_decompositions()` r2rcrUrRdefault_decompositionsrBs  rUc V^8dQhRRR\\PP\3,R\\PP\3,R\ R,/#)rWeprD cia_to_decomppython_decomp_tablejoint_loss_indexN)rrrrrint)r_s"rRraraKsjk@k@k@ //9:k@ejj55x?@ k@ Dj k@rUc$^RIHp^RIHp^RIHpHpHp Hp H p H p ^RI H p RpV!W4'EgTP4p/\VPRR74C\VP!RR74Cp^RIHpV!V4/\VPRR74C\VP!RR74Cp\'VP(4pVf\+V !4R R 7pVP,p\/VP0P2\44'g,\7R \9VP0P24 24hVP0P2P:P<pVf \7R 4hVP8\>\@39d\BPD!V.4p\5\GVVPHV44VP0nVPK4\MVPNVPPV4\SWPTVPNPV4p\YVV4p\[V4p^RI.H/pH0p.pVP0PbFpVPdR8XgK\/VPfR,\h4'dR pVPfR,Pjf0VPPVPfR,Pl,pM'VPfR,PjPnpVPqV4KVPqVPfR,4K \sV4pT;_uu_4\uV4;_uu_4V!VPv4;_uu_4\yV4;_uu_4\BPz!VVPH4pV!V.V^,OV^,P}4O5/V4;_uu_4wp p!p"p#p$V!V V!V"VV#VRVR7p%V%PPP4U&U'u/uF(wp&p'T&\/V'\4'd V$V',MT'bK* up'p&V%n(V%Pp(V%Pp)\V)V4p)\VV(V)4\VPNV)4p)/VPPCV%PPCp*V*PV!V(V)V#44\V(V)V V!V"VV*4R R R 4R R R 4R R R 4R R R 4R R R 4V !X(4V !V(4V !V(X)4\V(V)4wp(p)/VPTCVP4U+U,u/uFwp+p,V+V9gKV+V,bK up,p+Cp-VP4Fjwp+p,V+V-9d;\/V,\PP4'd\7RV+: R24hV+V-9gKPV+V9gKYV-PV+4Kl V(V)V-X*3#VP(P0PbUu.uFpVPdR8XgKVNK p.pV.Uu.uFpVPfR,NK p/pVP(P!4U+U0u.uFwp+p0V+NK p1p+p0V1Fp+\VP(V+4K \V/4p2V2f\P!4MT2p3V'd\PMTp4V !4;_uu_4T3;_uu_4\uV4;_uu_4V4!4;_uu_4T!VP(T/TVR JVeTMR R7wp(p5\/V(\PP4'g\7R\9V(4 24hV(P0P4R R R 4R R R 4R R R 4R R R 4Rp6X(P0PbUu.uFpVPdR8XgKVNK p7p\AV(P0P4P^,4p8\V74\V.48wd$\7R\V74 R\V.4 24h\V.V74Fwp9p:V9Pl;V:n6V:nXK /p;\\4p<\4p=V7F3p>V>PlV;V>Pl&\V>PlVpVPdR8XdK\V;V pSpEpFV8\XI4R FpXRVPl,pTXSVT,pFVFP\EP8Xd\EPpUXFPpQMKXFP\P8Xd\EP pUXTpQM\7R(XFP 24hXIPq\XU\VPlR#7XQ44K \V74\V.48wd$\7R\V74 R\V.4 24hE\ XHXIR)7p)V)EPpVV)EPpW\V.V74FwpXpY\/VXPfR,\EP4'g!XXPfR,XYPfR&XYPXV9gXYPXW9gK|XXPfP4FwpZp[V[XYPfVZ&K K V(V)VPTVPP3#uup'p&i +'giE L;i +'giE L ;i +'giE L;i +'giE L";i +'giE L.;iuup,p+iuupiuupiuup0p+i +'giE L;i +'giE L;i +'giE L;i +'giE L;iuupi +'giEL;iuupFpEiuupFpEiuup+pEiuupiuupFpEi)*r)_materialize_and_lift_constants)aot_export_module)2_disable_custom_triton_op_functional_decomposition_export_to_aten_ir_ignore_backend_decomps_verify_nn_module_stack_verify_placeholder_names_verify_stack_trace)ShapeEnvcJVRJ;'gVPPRJ#rI)graph_signaturebackward_signature)rrs&&rR_is_joint_ir_decompO_decompose_and_get_gm_with_new_signature_constants.._is_joint_ir_decomp_s/ D ( A A!!44D@ rUF)remove_duplicate)!unwrap_tensor_subclass_parametersNT) shape_envexportz6expected mod.graph._codegen to be _PyTreeCodeGen, got zout_spec must not be None)&_enable_graph_inputs_of_type_nn_module_fakify_script_objects placeholderval)r_prettify_placeholder_namesdecompose_custom_triton_opsz expected z6 not to be a torch.nn.Parameter when not in state_dict)decompositions trace_jointoutput_loss_indexz#expected torch.fx.GraphModule, got c\V\4'dV#\V\4'd\VPR7#\V\4'd\ VPR7#\V\ 4'd\ VPR7#\V\ 4'd\ VPR7#\R\V4 24h)rKzType of old_arg not supported: ) isinstancer8rBrKrAr@r? RuntimeErrorr)old_argnew_phs&&rR update_argF_decompose_and_get_gm_with_new_signature_constants..update_argms g/ 0 0N  0 0!v{{3 3  0 0!v{{3 3 !1 2 2#5 5  1 1" 4 4rBr LOSS_OUTPUTgetrgradients_to_user_inputs PARAMETERGRADIENT_TO_PARAMETERGRADIENT_TO_USER_INPUTr:inputs_to_parametersinputs_to_buffersTensor)\rrrrrrrrrrrrrrrmodwrapped_params_buffersrunwrapped_params_buffers fake_moderYorig_arg_namestemp_registered_constantsfake_params_buffersparams_buffers_to_node_metarrretracing_argsnodereal_script_objtxretracing_args_unwrapped patched_mod new_fake_argsnew_fake_kwargsnew_fake_constant_attrsmap_fake_to_realaten_export_artifactrnobjr new_graph_signaturerrKpnew_state_dictold_placeholders fake_args_buffers_to_remove fake_mode_det fake_mode_ctx#custom_triton_ops_decomposition_ctxrrnew_placeholders new_outputsold_phrname_mapfind_available used_namesphrrrrroutputrPspecold_new_placeholder_maprruser_inputs_indexmutation_namesexpected_names output_name input_name input_spec output_kindr gradientsspecssourcerr0r1old_noderOrvs\&$$$$ rR2_decompose_and_get_gm_with_new_signature_constantsrgKsY?? r 4 4iik" 3'''?@" 3$$e$<="    *#.$ 3'''?@$ 3$$e$<=$  .boo>  &DII==#)),,n== HciiN`N`IaHbc ++77AA   !<= = ==u -,,hZ8H+       ((:(:BLL#N%C  2 2 I I% ! 5YD&DS&I#  IIOODww-'dii.0ABB&*Oyy'008*,,,tyy7G7L7L*M*.))E*:*C*C*L*L"))/:"))$))E*:;$I & I /   323D3D E E BKK'-'<'< ( $(-a0-a0779' '9!#'+!4050K ($$%9$B$B$H$H$J 2 %KS %c+;<<)- ! %K 2$.*,,&:&>&># L+-F$ :/5H 'V&&(;'#ll*44   3/1H ('!#'E  F  n #B!"&9:"B ##   mm  8==??GD!55a? .335GD!>)a!3!344(#D8+ab~%77"&&t,6& AA..444=8P4/??.>d5!!.>I?-/__-J-J-LM-L'$-LM!&"%Y/M0=0EJ**,=M '  ?( !! +M::+--/ OO .(4$4$@ d  O"ehh2233 #FtBxj!QR R $$& . ;  "* N*,T477m;ST-22883G3G3I3N3Nq3Q-RK $4 55&s+;'<&==efijzf{e| }  .0@A&,kk1 fmBH%0%5N5JGGRWWnj9 77m # . nj$))TYY  $B'Y ==   ; ; ; 1 #2&  (!!'=+2N 0()LRXX)V(WX  LLNK)#  - - 5 b $66OO ** +s23E3E3Q3Q/R R 5c/:U:U6V5WX&&)"*<*<*H*H&I%JL  %R%7%7%C%CD D4$((N3 1O ' ' *D 0D   L 1 34Dtyy)F=DyyI///!77i222!88$';DII;%GHH   " 2 5& $4 55&s+;'<&==efijzf{e| }  /l/CC+==!"24DE((--. ==#+==#7HMM%  OO3 3"33 ++-1#$ a .F "BMM2<< ??O 27 KK F E E    IIP*@M .-- ;::   "!!DUV* "XOf s=AEAD= ,AD) AAD4AD .AC;8BAD ADAD) AD= $AE< AE% AE%?AE+AE+#AE0AE5 AF7(AF# <AF A>AE; AF AF# AF7AG AG ,&AG5%AG$,AG$0AAG*AG0"AG6%AG;9AG;C;ADD ADD ADD AD&D AD) D) AD:D4 AD= D= AE E AEE AE" E; AF F AF F AF F AF# F# AF4 F. AF7F7 AG G AG! cV^8dQhR\PPR\R\\PP\3,/#)rWr rGr)rrrr:r)r_s"rRrara9sC## #3G# 588  !5 56#rUcXVPpVPpVPVP44;_uu_4VPP EF pVP R8XgK\P!VP4wrVVFp\V\PP4'gK/VPV9gVPV9gKSVP R8XgKfVP\P P"P$P&JgKVP)VP^,4VPP+V4K EK# VP-4RRR4W3# +'giY3#;i)zI Removes redundant copy_ node that was introduced due to mutated buffer. rX call_functionN)buffers_to_mutateparameters_to_mutate_set_replace_hookget_replace_hookrrrr\ tree_flattenrsrrrNoderKropsrrdefaultrS erase_noder)r rGrkrlr<rsrLouts&& rRrr9s+ ,==.CC  1BBD E EHHNNDww(" --dii8C!#uxx}}55$5588';; FFo5 # eiinn.A.A.I.I I55chhqkBHH//4 #  F  ""! F E  ""s,)F.AFF%F89F6AF F) cLV^8dQhR\PP/#)rWr rrr)r_s"rRraraTs.. .rUc VPVP44;_uu_4VP4EF1p\V\P P 4'gK0/p/p\VPP4FpVPR8XdVP\PJdVPwrxWG, RV 2p W9dpVPWY,4VF5p V P fKV P PWeV ,4K7 VPP#V4KWeV &WV&KVP$WF&K EK4 RRR4R# +'giR#;i)rj.N)rmrnmodulesrrrrr[rrrroperatorgetitemrsrSrorsrK) r rmodule_call_graphrnode_idgetitemsr<rdidxnew_identrys &&& rR _common_getitem_elimination_passrTs)  o>>@ A AjjlFfehh&:&:;;02G13HV\\//077o-$++AQAQ2Q"&))KF '0#7F)2283CD%6E$: % E E$(6*:!"&7  //5+/((. $(IIGM!1 # B A A AsCE9 A$E99 F c V^8dQhR\PPR\R\PPR\R\\ ,/#)rWold_gmold_graph_signaturer rold_module_call_graph)rrrr:r[rE)r_s"rRraraqsZB!B! HH B!-B! B!* B!  0 B!rUc aa\P!V4pVPPUu/uFqfPVbK pp/SP CSP Cp/VP CVP Cp /VCSPCSPCo/V CVPCVPCp /p ^p VPPUu.uF!qfPR8XgKVPNK# p p\\VV3RlV 44p VPPUu.uF!qfPR8XgKVPNK# ppVPPEF-pVPPR.4;p'd"VPWR ,P&KIVPR8XgK\VPV 9dKoVPVP9dKVPV9gK\!VP\"4'g"\%R\'VP4 24hW,p\!V\"4'g\%R\'V4 24hVPV V&V ^, p EK0 \)\4pV P+4FhwppVP-R4'gVV9dVV V&K+K-RP/VP1R4^R 4pVV,P3V4Kj VEFpVP4pVfK.VP6OVP8OEFnpVPV9d\;RVP R 24hVPV 9dV VP,VnKYVPV9gKlVVP,pVPR 8XgKVP\<P>P@PBPD\<P>P@PBPF\<P>P@PBPH39gEK-VPJ^,PpVV 9d\;RV R 24hV V,VnEKq EK V#uupiuupiuupi) rrc<<VS9;'dVSP9#rI) input_tokens)xold_graph_non_user_inputsrs&rR0_get_updated_module_call_graph..s)a88::,999:rU from_nodez"expected node.name to be str, got z!expected old_name to be str, got zparametrizations.rxzIt looks like z is a tensor subclass. Preserving submodule that takes subclass parameter is not supported in inference IR because we desugar them, resulting in more tensorsrj)&rdeepcopyrrrKr0r1!inputs_to_lifted_tensor_constantsinputs_to_lifted_custom_objsrrr[filterrr+rrr^rrrrrjoinsplitr rorJrL ValueErrorrrqrto dtype_layoutdevicedtypers)rrr rrnew_module_call_graphr< old_nodesold_graph_params_buffersnew_graph_params_buffersnew_graph_non_user_inputs provenanceuser_input_counterold_user_input_namesnew_user_input_nameshistoryold_nameold_param_to_desugaredrKr old_targetrrorrers&f&&& @rR_get_updated_module_call_graphrqsf!MM*?@-3\\-?-?@-?TD-?I@   2 2   / /    . .   + + ! "!  ? ?!  : :! ! "!  ; ;!  6 6!"$J & 2 2 2gg6N  2  :  !# .'']2J  iimmK4 47 4+/99Jr{'' ( WW % 88;;/">">>;;"66%dii55,@dii@QR 4GH%h44,?X?OP,099Jx(&!+&/8).0668 f  !455//#' 4 0&,,s"3Ab"9:J ": . 5 5d ;9'OO   89##8i&7&78Avv// $QVVH-Z[ vv##AFF+9$$QVV,;;/1hooIINN%%22IINN%%,,IINN%%++J7 "*q!1!6!6J!3(,ZL9bc ( 3AFG9 'R ! sA4sSS'S+SScV^8dQhR\\PP\3,R\\PP\3,R\ R,R\ /#)rWrrrNr)rrrrrrr)r_s"rRraras`55 //9:5ejj55x?@ 5 Dj 5 "& 5rUc b\VVVVVR7wpppp\VPVPVVVP4p VP P VPP 4\VVP4p \VVPVVV V VPVR7p V #)rrrr)rootrrrrange_constraintsr|r r) rgrrrr|rr_get_updated_range_constraintsrrDrr ) rrrrrr rGrrrnew_range_constraintsexported_programs &$$$$ rR_decompose_exported_programrs ; #/)$?    ;     GGNN2??''(:   ' hh+//((  rUca]tRtRtoRtRDRR/V3RlRlllt]]!RR7R 44t]P]!RR7R 44t]]!RR7R 44t ] P]!RR7R 44t ]]!RR7R 44t ] P]!RR7R44t ]]!RR7R44t ] P]!RR7R44t ]!RR7V3RlRl4t ]!RR7V3RlRl4t]!RR7V3RlRl4t]!RR7V3RlRl4t]]!RR7R44t]P]!RR7R44t]]!RR7R44t]P]!RR7R44t]]!RR7R44t]P]!RR7R44t]]!RR7R44t]P]!RR7R 44t]]!RR7V3R!lR"l44t]P]!RR7R#44t]]!RR7V3R$lR%l44t]P]!RR7R&44t]]!RR7R'44t]P]!RR7R(44t]]!RR7R)44t]P]!RR7R*44t]]!RR7R+44t]P]!RR7R,44tR-tV3R.lR/ltV3R0lR1ltV3R2lR3ltREV3R4lR5lltR6t] RFV3R7lR8ll4t!V3R9lR:lt"R;t#]!RR7R<4t$]%R=4t&R>RR?RRR/V3R@lRAllt'V3RBlt(RCt)Vt*R#)GrDi.a Package of a program from :func:`export`. It contains an :class:`torch.fx.Graph` that represents Tensor computation, a state_dict containing tensor values of all lifted parameters and buffers, and various metadata. You can call an ExportedProgram like the original callable traced by :func:`export` with the same calling convention. To perform transformations on the graph, use ``.module`` property to access an :class:`torch.fx.GraphModule`. You can then use `FX transformation `_ to rewrite the graph. Afterwards, you can simply use :func:`export` again to construct a correct ExportedProgram. N verifiersc<V^8dQhRS[PPS[S[S[3,,RS[P PRS[RS[S[S[PS[PP,3,RRRS[ S[ ,RS[ S[ S[R 3,S[S[S[3,3,R ,R S[S[S[3,R ,R S[ S[S[,,R ,/ #) rWrrrrrdict[sympy.Symbol, Any]r|r .Nrr)rrModulerr^rrGraphr:r2rr[rErrrr+)r_r`s"rRraExportedProgram.__annotate__Xs)H)HhhooS#X.)Hxx~~)H. )H ellUXX-?-???@ )H 5 )H 0)HeCHotCH~=>E)H334t;)HX'$.)HrUc \PPP4Vn\ W4Vn\V\PP4'd0VP PPVP4\VP W64W0n W@n WPnVf \R4hW`nWpnT;'g/VnT ;'g\&.p \(;QJdRV 4F 'dK RM RM !RV 44'g\RV 24hWnVP-4\/VP 4VnR#)Nz"module_call_graph must not be Nonec3B"TFp\V\4xK R#5irI)rr+).0rfs& rR +ExportedProgram.__init__..ys>Iq:a**IsFTz2all verifiers must be subclasses of Verifier, got )rrrCodeGenr_create_graph_module_for_export _graph_modulerrrrr_graph_signature _state_dict_range_constraintsr_module_call_graph_example_inputs _constantsr+all _verifiersvalidate_convert_guards_to_code _guards_code) rMrrrrrr|r rrs &&&&&&&&&$rR__init__ExportedProgram.__init__Xs//1I>sss>I>>> DYKP $ 3D4F4FGrUF)is_backward_compatiblecVP#rI)rrMs&rRrExportedProgram.graph_modules!!!rUc\R4h)z7Unable to set ExportedProgram's graph_module attribute.rrMvalues&&rRrrsTUUrUc.VPP#rI)rrrs&rRrExportedProgram.graphs  &&&rUc\R4h)z0Unable to set ExportedProgram's graph attribute.rrs&&rRrrsMNNrUcVP#rI)rrs&rRrExportedProgram.graph_signatures$$$rUc\R4h)z:Unable to set ExportedProgram's graph_signature attribute.rrs&&rRrrsWXXrUcVP#rI)rrs&rRrExportedProgram.state_dictsrUc\R4h)z5Unable to set ExportedProgram's state_dict attribute.rrs&&rRrrsRSSrUcX<V^8dQhRS[S[PP,/#rWr)rrrr)r_r`s"rRrars#HUXX%7%78rUc# H"VP4F wrVxK R#5i)z8 Returns an iterator over original module's parameters. N)r)rMrLparams& rR parametersExportedProgram.parameterss! --/HAK0 "cn<V^8dQhRS[S[S[S[PP 3,,/#r)rrr^rrr)r_r`s"rRrars-::(5ehh6H6H1H+I"J:rUc# t"VPPFpWPV,3xK R#5i)z Returns an iterator over original module parameters, yielding both the name of the parameter as well as the parameter itself. N)rrr)rM param_names& rRr ExportedProgram.named_parameterss/ ..99Jooj99 9:s68cD<V^8dQhRS[S[P,/#r)rrr2)r_r`s"rRrars%,,/rUc# H"VP4F wrVxK R#5i)z3 Returns an iterator over original module buffers. N)r)rMrLbufs& rRbuffersExportedProgram.bufferss! ((*FAI+rcZ<V^8dQhRS[S[S[S[P3,,/#r)rrr^rr2)r_r`s"rRrars'>>xc5<<.?(@A>rUc# "\VPP4pRpVPPFpW19dW0PV,3xK!W0P 9dW0P V,3xKIW0P9dW0PV,3xKqVfVP P 4pW2V,3xK R#5i)zv Returns an iterator over original module buffers, yielding both the name of the buffer as well as the buffer itself. N)rrrrrrr)rMr gm_state_dict buffer_names& rRrExportedProgram.named_bufferss "%T%9%9%P%P!Q //77K4!>>+#>>>/!??;#???.!>>+#>>> !($($5$5$@$@$BM!#===8sCCcVP#rI)rrs&rRr!ExportedProgram.range_constraints&&&rUc\R4h)z.CallSpecicv<V^8dQh/S[PR,;R&S[PR,;R&#)rWNrXrY)r\r])r_r`s"rRra8ExportedProgram.call_spec..CallSpec.__annotate__s-__t+ +oo, ,rUrcN)rdrerfrgrhrirjrks@rRCallSpecrsrUrN)rXrYz=expected first module_call_graph fqn to be empty string, got )r rr|rnrrorXrY)rMrs& rRrExportedProgram.call_specs -z - t%% &! +D48 8  ! !! $ ( (B . OPTPfPfghPiPmPmOpq **1-77??++A.88AA  rUc\R4h)z4Unable to set ExportedProgram's call_spec attribute.rrs&&rRrr (QRRrUc <V^8dQhRS[/#rr)r_r`s"rRrar/s""#"rUc(VP^,#)rrrs&rRverifierExportedProgram.verifier-sq!!rUc\R4h)z3Unable to set ExportedProgram's verifier attribute.rrs&&rRrr2sPQQrUc <V^8dQhRS[/#rr^)r_r`s"rRrar9s***rUcnVPf \R4hVP^,P#)Nz_verifiers must not be None)rrdialectrs&rRrExportedProgram.dialect7s/ ?? " !>? ?q!)))rUc\R4h)z2Unable to set ExportedProgram's dialect attribute.rrs&&rRrr>sOPPrUcVP#rIrrs&rRrExportedProgram.verifiersCrUc\R4h)z4Unable to set ExportedProgram's verifiers attribute.rrs&&rRrrHr rUcVP#rIrrs&rRtensor_constants ExportedProgram.tensor_constantsMrrUc\R4h)z;Unable to set ExportedProgram's tensor_constants attribute.rrs&&rRrr Rs I  rUcVP#rIrrs&rRrExportedProgram.constantsYrrUc\R4h)z4Unable to set ExportedProgram's constants attribute.rrs&&rRrr#^r rUc VPPpVe \W#4p\P!W34wrEVP V4\ ;QJd.RV4FNK 5M !RV44pWe3#)agFlatten args, kwargs using pytree, then, check specs. Args: args: List[Any] original args passed to __call__ kwargs: Dict[str, Any] original kwargs passed to __call Returns: A tuple of (flat_args, received_spec) flat_args is flattened args / kwargs received_spec is the pytree spec produced while flattening the tuple (args, kwargs) c32"TF q^,xK R#5i)Nrc)rrs& rRr.ws<(;1A$$(;s)rrXr1r\tree_flatten_with_path_check_input_constraintsr)rMrsrtrXflat_args_with_path received_spec flat_argss&&& rR_get_flat_args_with_check)ExportedProgram._get_flat_args_with_checkcsv..((  #F4F-3-J-J N. * %%&9:E<(;Trying to flatten user inputs with exported input tree spec: z- but actually got inputs with tree spec of: F)rrXr.r0rrrrrr;r&r-r'r#r rrrrCONSTANT_TENSOR CUSTOM_OBJr) rMrsrtrXr-r,additional_inputsrinput_s &&& rR_graph_module_flat_inputs)ExportedProgram._graph_module_flat_inputszs..((#'#A#A$#O  } $A( ( Q)@ /#  **66F{{i222##  !$$-&,,T^^FMM-JK]]doo5%,,T__V]]-KL]]dnn4%,,T^^FMM-JK %,(,(9(9(D(D(F %,,]==-IJ))$$!"(( )FG576""34!,,rUc,<V^8dQhRS[RS[RS[/#r1r )r_r`s"rRrars"  c S S rUc\R4h)z\Unable to call ExportedProgram directly. You should use `exported_program.module()` instead.r)rMrsrts&*,rR__call__ExportedProgram.__call__s B  rUc <V^8dQhRS[/#rr)r_r`s"rRrars   rUcVPPRRR7PRR4p\VP4PRR4pRV RV RVP R2pV#)F) print_outputcolored z zExportedProgram: z Graph signature:z Range constraints: )rprint_readablereplacer^rr)rMrrstrings& rR__str__ExportedProgram.__str__s((778 '$ ! d223;;D(K .!./0""&"8"8!9 =   rUcH<V^8dQhRS[PP/#rrv)r_r`s"rRrars588+?+?rUc ^RIHpV!WR7pRRRllpRRRllp\P!WC4Vn\P!WS4VnV#)a Returns a self contained GraphModule with all the parameters/buffers inlined. - When `check_guards=True` (default), a `_guards_fn` submodule is generated and a call to a `_guards_fn` submodule is inserted right after placeholders in the graph. This module checks guards on inputs. - When `check_guards=False`, a subset of these checks are performed by a forward pre-hook on the graph module. No `_guards_fn` submodule is generated. )&_unlift_exported_program_lifted_states) check_guardsc$V^8dQhR\/#rWmoder)r_s"rRra,ExportedProgram.module..__annotate__s O Ot OrUc\R4h)z%Calling train() is not supported yet.NotImplementedErrorrMrMs&&rR_train&ExportedProgram.module.._trains%&MN NrUc$V^8dQhR\/#rLrN)r_s"rRrarOs N Nd NrUc\R4h)z$Calling eval() is not supported yet.rQrSs&&rR_eval%ExportedProgram.module.._evals%&LM MrUT)rrItypes MethodTypetraineval)rMrJrIrrTrXs&& rRrExportedProgram.modulesI D7X O N''7 &&u5  rUc\R\VPP44\ VPP44#)c3l"TF*wrVP\P8XgK&VxK, R#5irI)rr;r&)rrPss& rRr=ExportedProgram._num_lifted_params_buffers..s- HDA66Y111Hs#4 4)nextr"rrrrs&rR_num_lifted_params_buffers*ExportedProgram._num_lifted_params_bufferssC %d&;&;&G&GH  %%11 2   rUcv<V^8dQhRS[S[PPS[3,R,RS[RR/#)rWrNrrrD)rrrrrr)r_r`s"rRrarsGD D 5::22H<=DD &*D   D rUc Vf \4M \V4p\V\4'dVP 4p\ V4wpp\ VVVRVR7#)a Run a set of decompositions on the exported program and returns a new exported program. By default we will run the Core ATen decompositions to get operators in the `Core ATen Operator Set `_. For now, we do not decompose joint graphs. Args: decomp_table: An optional argument that specifies decomp behaviour for Aten ops (1) If None, we decompose to core aten decompositions (2) If empty, we don't decompose any operator Some examples: If you don't want to decompose anything .. code-block:: python ep = torch.export.export(model, ...) ep = ep.run_decompositions(decomp_table={}) If you want to get a core aten operator set except for certain operator, you can do following: .. code-block:: python ep = torch.export.export(model, ...) decomp_table = torch.export.default_decompositions() decomp_table[your_op] = your_custom_decomp ep = ep.run_decompositions(decomp_table=decomp_table) Nr)rrrr3 materializerr)rMrr _decomp_tablerrs&&& rRrun_decompositions"ExportedProgram.run_decompositionssnP)5(< " $$|BT  m%6 7 7)557M" 9 G  + ' 3!(C   rUc$<V^8dQhRS[RR/#)rWpassesrrD)PassType)r_r`s"rRrar1s ddXd:KdrUc T\\V44p^RIHpV!4;_uu_4V!VP4pRRR4Xe VPM VPpVf \ R4hWPPJdVP 'gV#RRlp\VVPV!VPV4VP\VVP4\P!VP4VP VP"VP$R7 pVPP&P)VPP&4VPP&P)VPP&4V# +'giELb;i)r)rNztransformed_gm must not be NonecdV^8dQhR\R\PPR\/#)rW old_signaturenew_gmr)r:rrr)r_s"rRra;ExportedProgram._transform_do_not_use..__annotate__Bs0> !> !/> !HH((> !"> !rUc .p\VPP4Fwr4VPR8wdMV\ VP 48d&\ RV R\ VP 4 R24hVP V,p\VP\\34'd VPM$\VP4!VP4pVP\VPVVP VP"44K \%VPP4R ,pVPR8wd\ RVP: 24h.p\VP&^,4Fwr4V\ VP(48d&\ RV R\ VP(4 R24hVP(V,p \V P\\34'd V PM$\V P4!VP4pVP\+V PWiP 44K \-W(R 7p V #) z7 Update the graph signature's user_input/user_outputs. rz9Number of inputs changed after transformation: got index z but only z input_specsrXz,expected last node to have op='output', got z:Number of outputs changed after transformation: got index z output_specsrr)r"rrrrrrrrr8r9rrKr r<rrr#r[rsrr>r:) rrrsnew_input_specsrPr<old_input_specrrnew_output_specsold_output_spec new_signatures && rR_get_updated_graph_signatureKExportedProgram._transform_do_not_use.._get_updated_graph_signatureBsU!O$V\\%7%7877m+M5566(STUSVW$$' (A(A$B#C<Q"/!:!:1!="&**-=?P,Q#&&n001$))<  &&&++&--&11 #94v||11226K~~)$B;>>BTU " $[%5%5a%89M6677(TUVTWX$$' (B(B$C#DMS#0"<"@Q-R$''o112499= !''33S:P:PQ:$1+M! rU rrrrrr|r rr)r6r[rrrrmodifiedrDrrrrrrrrr rrrr)rMrnpmrrestransformed_gmr{transformed_eps&* rR_transform_do_not_use%ExportedProgram._transform_do_not_use1sR f & @ $ & &T&&'C'-0_))$BSBS  ! !BC C .. .s|||K> !@) &&8$$n<&&#mmD,C,CD..nnnn  ##((//0A0A0F0FG##((//0@0@0E0EF}' & &s F F' cb^RIHpVPPUu.uFq3PR8XgKVNK pp\ W@P P4UUu.uF(wr5VP\P8XgK&VNK* pppV!WaVP4R#uupiuuppi)r)"_check_input_constraints_for_graphrN) torch._export.utilsrrrrrrrrr;r&r)rMr+rrH placeholdersrbinput_placeholderss&& rRr*(ExportedProgram._check_input_constraintssJ#'::#3#3M#3att}7L#3 ML*>*>*J*JK Kvv--- AK  + T5K5K N sB&B& #B+B+c&VP4R#rI) _validaters&rRrExportedProgram.validates  rUc\VP4^8Xd \R4hVPFpV!4PV4K R#)rz0ExportedProgram must have at least one verifier.N)rrrcheck)rMrfs& rRrExportedProgram._validates: t~~ ! # !ST TA CIIdO rUrrc<V^8dQhRR/#)rWrrDrc)r_r`s"rRrars    rUc 4\TVPTVeTM VP\P!VP 4\P!VP 4VPVeTM VPVeVR7 #VPR7 #)Nr}) rDrrrrrrr rr)rMrrrrrs&&&$$$rR_updateExportedProgram._updates$$+%/%;z"mmD,B,BC"mmD,C,CD..#,#8idnn#,#8i  ?Cnn  rUcf<V^8dQh/S[PP;R&S[;R&S[S[S[3,;R&R;R&S[S[,;R&S[ S[ S[R3,S[S[S[3,3,R,;R &S[S[S[ 3,;R &S[S[ S[ ,,;R &S[S[,;R &#) rWrrrzdict[sympy.Symbol, ValueRanges]rr.Nrrrr) rrrr:rr^rr[rErrrr+)r_r`s"rRrar.s 88'''!&+*',c3h-2:938_--9>5c?DcN:;dBB?DS0011EJT(^$$KPs)QrU) rrrrrrrrr)NNrZ)NF)+rdrerfrg__doc__rpropertyr4rsetterrrrrrrrrr|r rrrrrrr.r7r;rErrerzrkrr*rrrrrhrirjrks@rRrDrD.s(  PNVFKM;J)H26)H)HV%0"1"%0V1V%0'1' \\%0O1O%0%1%%0Y1Y%0 1 %0T1T%01%0:1:%01%0>1>2%0'1'%0 1 %0'1'%0 1 %0$1$%0%1%2%0 1 %0S1S%0"1"__%0R1R%0*1*  ^^%0Q1Q%01%0S1S%01%0 1 %01%0S1S(.6-6-p   2 $D D $D LddL  %01         GrUczVPPUu.uF6pVPPRR4fK#VPR,NK8 pp^RIHpV!V4pVe VP #VF;p\V\P4'gK%VPP u# R#uupi)rNr,) rrrr+ torch._guardsr-rrrSymIntr<)r r<valsr-r6rfs& rRr!r!sHHNN "D 99== %  %"   / &I"""  a & &66## # s B8B8cTV^8dQhR\PPRRRR/#)rWr old_range_constraintszdict[sympy.Symbol, Any] | Nonerrrv)r_s"rRraras0 ;rUcjVf \R4h\V4pVf/#\P!V4pVP4UUu/uFwrEWBP9gKWEbK pppVP P4F#wrEWBP9gKWC9gKWSV&K% V#uuppi)Nz&old_range_constraints must not be None)rr!rr replacements var_to_range)r rrrrrfs&& rRrrs$EFFr"I  "78*0022a?U?U6U2 &&,,. ** *q/I#$a / s B/#B/c\PPW4pV# \d_\P !R^R7\PPT\PP 44pYnT#i;i)zUnable to execute the generated python source code from the graph. The graph module will no longer be directly callable, but you can still run the ExportedProgram, and if needed, you can run the graph module eagerly using torch.fx.Interpreter.) stacklevel)rrr SyntaxErrorwarningswarnr_graph)rrr s&& rRrrsy XX ! !$ ." I!    G  XX ! !$(8 9 I!s#A%B  B c\V4pVf.#VPP4UUu0uFCwr#\;QJdRV4F 'dK RM RM !RV44'gKAVkKE ppp\P P PPVPRVP4pVPUu.uFKpVPPPV4'gK0VPVP4NKM ppVUu.uFpRV9gK VNK up#uuppiuupiuupi)Nc3"TF8p\V\PPP4'*xK: R#5irI)rrrrdConstantSource)rrds& rRr*_convert_guards_to_code.. s4 !65==#7#7#F#FG G G!sAAFTcVP#rIr)rbs&rRr)_convert_guards_to_code..sAFFrUz L['self'])r!var_to_sourcesrrrr experimentalsymbolic_shapesShapeGuardPythonPrinterguardsexpr free_symbolsissubsetdoprint)rrvarsources local_vars py_printerguardrets& rRrrs-|,I &44::<EEs ??%  @s)#EE2E-EE* E 8E )rDrErFrrI)rr dataclassesrxrzr[r collectionsrcollections.abcrrrtypingrrr r rr r torch._higher_order_ops.utilsr "torch._library.fake_class_registryrtorch._subclasses.fake_implsrrrtorch._subclasses.fake_tensorrtorch.fx._symbolic_tracertorch.fx._utilsrtorch.fx.graphrrtorch.fx.immutable_collectionsrrtorch.fx.passes.runtime_assertrsympytorch.utils._sympy.value_rangesrrtorch.utils._pytreeutils_pytreer\rrrrrrr r!r"r#r$r%r&r'r(r)r*torch._export.verifierr+r-r/torch.export._tree_utilsr0r1torch.export.decomp_utilsr3torch.fx._compatibilityr4torch.fx.passes.infra.pass_baser5"torch.fx.passes.infra.pass_managerr6rr7r8r9r:r;r<r=r>r?r@rArBrC__all__rrro dataclassrFrErzrrr AutogradCPU AutogradCUDA AutogradMeta AutogradXLA AutogradLazy AutogradIPU AutogradXPU AutogradMPS AutogradHPUAutogradPrivateUse1AutogradPrivateUse2AutogradPrivateUse3rCPUCUDAMetaXLALazyIPUXPUMPSHPUrrrrrgrrrrrDr!rrrrcrUrRrs(  #.%881B? 9;?6IJ ; $$$,*@B716:"  UXX))*J,== >  ' ' '  111 G: HH$$ HH%% HH%% HH$$ HH%% HH$$ HH$$ HH$$ HH$$ HH,, HH,, HH,, ,(, HH HH HH HH HH HH HH HH HH P$P$f,-^k@\#6.:B!J5pV  V  r $ 0,@rU