+ j aRt0t^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RI t ^RI H t ^RI H t HtHt^RIHt^RIHtHtHtHt^RIHt]'d^RIt^RIt^RIt^RIt^RIHuHt^RI H!t!^RI"H#t#H$t$^R I%H&t&H't'^R I(H)t)H*t*H+t+H,t,H-t-H.t.H/t/H0t0^R I1H2t2^R I3H4t4H5t5^R I6H7t7H8t8H9t9H:t:H;t;Ht>^RI?H@t@^RIAHBtB^RICHDtD^RIEHFtFHGtG^RIHHItI^RIJHKtK^RILHMtMHNtN^RIOHPtPHQtQ^RIRHStSHTtTHUtU^RIVHWtWHXtX^RIYHZtZ^RI[H\t\^RI]H^t^^RI_H`t`Hata^RIbHctc^RIdHete^RIfHgtgHhthHitiHjtjHktkHltlHmtm^RInHoto^R IpHqtq^R!IrHstsHtttHutu^R"IvHwtwHxtxHytyHztz^R#I{H|t|H}t}H~t~Ht^R$IHt^R%IHt^R&IHt^R'IHtHtHtHtHt^R(IHtHtHt]EP!]4t]]]3,]]R)3,,]],,t]^k]]u,]t,R,t]^k]EP0!R*R+44t]EP0!R,R-44t]EP0!R.R/7!R0R144t]!4t]EP:]EP<]EP>]EP@]EPB]EP"]EPD]] EPH0 ]n] R24t] R34tR4tR5tR6tR7R8ltR9R:ltRR;R<lltR=tR>tR?tR@tRARBltRCRDltRERFltRGRHltRIRJltRKRLltRMRNlt!RORP4tRQRRltRSR./RTRUlltRVRWltRXRYltRZR[ltRR\R]llt!R^R_]4tRR`RRaRbRcRbRdR.ReR.RfR./RgRhllltRiR./RjltRRkRlRmRbRnRRSR.RoRb/RpRqllltRRrRslltRtRultRvRwltRxRyltRzR{ltR|R}ltR~RltRRltRs]^kRs]^kRtRtRRltRRltRRRlltRRltRRlt] RRl4t] R4tRRltRR3RRlltRtRRltRRlt]]RRR.R`RRcRb/RRlll44t]]]`!RR7RRR.R`RRmRbRcRb/RRlll444tR#)N)Callable)contextmanager ExitStack nullcontext)chain)Anycast TYPE_CHECKING TypeAlias)mock)enable_python_dispatcher) UserError UserErrorType)exportdb_error_messageget_class_if_classified_error)_fakify_module_inputs_fakify_script_objects_gather_constant_attrs_NonStrictTorchFunctionHandler_override_builtin_opsmake_constraintsmake_fake_inputs$produce_guards_and_solve_constraints)CollectTracepointsPass)_materialize_and_lift_constantsConstantAttrMap)_collect_param_buffer_metadata_compiling_state_context_fakify_params_buffers)_populate_param_buffer_metadata_to_new_gm_update_gm_meta_if_possibleapply_runtime_assertion_passplaceholder_naming_passplaceholder_prefixes)SpecViolationError)_wrap_submodules)create_functional_call)_graph_input_names_graph_output_names)GraphSignature)get_subclass_typing_container)create_tree_flattened_fnregister_buffer_assignment_hook)_detect_attribute_assignment!aot_export_joint_with_descriptors)detect_fake_modetracingTracingContext)FakeScriptObjectmaybe_to_fake_obj)is_custom_class)dtrace_structuredFakeTensorMode)compile_time_strobelight_metalog_export_usage)find_legit_leaks_from_referrers)!_check_input_constraints_pre_hook)_check_dynamic_shapes _combine_args_combine_args_for_tracing _DimHintType _IntWrapper_normalize_dynamic_shapes_process_dynamic_shapes) OutputKind)_ConstantAttributeType),_SHAPES_SPEC_VS_DEFERRED_RUNTIME_ASSERTS_MSG ParamsSpec ShapesSpec)get_proxy_slotmake_fxPreDispatchTorchFunctionModetrack_tensor_tree)ConstraintViolationErrorfree_unbacked_symbolsGuardOnDataDependentSymNodeShapeEnv) _PyTreeInfo)TreeSpec)ValueRangeError)_disable_prexisiting_fake_modeExportedProgram InputKindModuleCallEntryModuleCallSignature)"_convert_to_export_graph_signature ArgumentSpecExportGraphSignature.ca]tRt^toRtRt]P!]R7t Rt Rt Rt Rt RtRtRtRtRtRtV3RltRtVtR#) ExportDynamoConfigz2 Manage Export-specific configurations of Dynamo. T)default_factoryFwarnc<V^8dQh/S[;R&S[S[,;R&S[;R&S[;R&S[;R&S[;R&S[;R&S[;R&S[;R &S[;R &S[;R &S[;R &#)  allow_rnnreorderable_logging_functionsdo_not_emit_runtime_assertsspecialize_intspecialize_floatassume_static_by_defaultautomatic_dynamic_shapes capture_dynamic_output_shape_opscapture_scalar_outputs+prefer_deferred_runtime_asserts_over_guardsreplay_side_effectsside_effect_replay_policy)boolsetrstr)format __classdict__s"T/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/export/_trace.py __annotate__ExportDynamoConfig.__annotate__s  $'x="&, !!"#*#$#*%&'+1'(!')*26=+,%-. #+/N)__name__ __module__ __qualname____firstlineno____doc__rb dataclassesfieldrorcrdrerfrgrhrirjrkrlrm__annotate_func____static_attributes____classdictcell__rrs@rsr]r]siI3>3D3D4!)-N!%*%*-1$#'8=/ %%+/rvr]c,a]tRt^toV3RltRtVtR#)ATenExportArtifactc<V^8dQh/S[PP;R&S[;R&S[S[S[3,;R&S[;R&#)ragmsig constantsinferred_out_spec)torchfx GraphModuler[dictrprErR)rqrrs"rsrtATenExportArtifact.__annotate__sL  C//00    rvrwNrxryrzr{rrrrs@rsrrrvrT)frozenc,a]tRt^toV3RltRtVtR#)ExportArtifactc<V^8dQh/S[;R&S[;R&S[;R&S[;R&S[S[S[S[S[P3,3,;R&#)raatenin_specout_spec fake_modemodule_call_specs)rrRr8rrppytree)rqrrs"rsrtExportArtifact.__annotate__s\     Cc6??&:!;;<< rvrwNrrs@rsrrrrvrc#"\PPPR4p\PPPR4p\PP PR4pRx\PPP!V!\PPP!V!\PP P!V!R# \PPP!T!\PPP!T!\PP P!T!i;i5iFN)rbackendsmkldnn set_flagsnnpackcudnn)orig_mkldnn_flagorig_nnpack_flagorig_cudnn_flags rs_ignore_backend_decompsrs~~,,66u=~~,,66u=nn**44U;O9  '')9: '')9: &&8 '')9: '')9: &&8s AC;%%AAA>A;c;s%B2AB-!B2!B//B2cT\PPP'*#Nrrwrvrs(custom_triton_ops_decomposition_disabledrs&&BB BBrvc&R\V4,#) L__self__) _strip_rootxs&rs _fixup_keyrs Q ''rvc\V\4'd7VPR4'd V\R4RpVP R4#V#) _export_rootN.) isinstancerp startswithlen removeprefix)rstrippeds& rsrrsE!Sall>::S(*+$$S)) Hrvc$V^8dQhR\/#)ranamerp)rqs"rsrtrts::s:rvcxVPR4p\V4^8dR#VR,PR4#)rT lifted_tensor)splitrr)rsplitted_namess& rs_is_bogus_const_namers5ZZ_N >Q "  ( ( 99rvcLV^8dQhR\PP/#)rarrrr)rqs"rsrtrts..!5!5.rvc VPPEF0pVP\PP P JgK8RVP9gKK\VPR,4pVPPV4;_uu_4VPPR\PP P VPRVRVPR,/R7pVPVn VPV4VPPV4RRR4EK3 R# +'giEKI;i)z In-place modify input graph module by replacing the export tracepoint with a new node that has the same target and args, but with the _export_root stripped from path. path call_functionkind)argskwargsN)graphnodestargetrops higher_order_export_tracepointrrinserting_before create_nodermetareplace_all_uses_with erase_node)rnodernew_nodes& rs_rewrite_tracepoint_noders  ;;%))00CC C$"4;;v#67XX..t44!xx33' ..AA!YY"D"DKK$7  4 H%)IIHM..x8HH''-54 544s !BE E c$V^8dQhR\/#)rainputs)r)rqs"rsrtrt sSrvc.p\V4FOwr#\V\P4'gK'VP VP P RV34KQ V'djV^,wrEpVR,FNwrxp WGJgK \RV RV RV RV RV RV RV RV RVP RV RV RVP 24h V#R #) z symint input:NNz shape env (z) from  z doesn't match mode (z shape env from z allocated at: z shape env from N) enumeraterrSymIntappendr shape_envAssertionErrorstack) r shape_envsi flat_inputrdesc1i1mdesc2i2s & rsdetect_shape_envr sJ"6*  j%,, / /   z88.!L M+)!} "&rNNLAb!$!)GE7!B4?TUVTWW^_d^eefgifjk&&+WAbT1A)//ARS&&+WAbT1A!''L+rvcaaaa.o.pVPPFjpVPR8Xd-SPVPP R44K@VPVPP R44Kl \ VRR4;p'd.o/o^oVVV3Rlp\P!Wa\VP44,4pV!V!p\VPPRR7V4FEwrI\V 4S9gKVPP R4SS\V 4,&KG \SV,4p \SV,4p V 'd&V 'dWP Jd \#R4hT p M+V 'd\%V R R 7p M\%\'4R R 7p ^oVV3R lp \P!W4p\P!W4pWV 3#) z Given a graph module, extract fakified input tensors from the metadata of its placeholders, and map them to the structure of given args and kwargs. Also return the fake mode used to fakify those inputs. placeholderval example_value_dynamo_bytecode_flattenNc<SPV4\V\P4'dTpM \ 4p\ V4S9dSS\ V4&S^, oV#r)rrrTensorobjectid)rret fake_inpsidx positionss& rs mark_inputs)_extract_fake_inputs..mark_inputs?sX   Q !U\\**h#wi'%( "S'" 1HCJrvopz7Detected shape env does not match fake mode's shape envT)rexportc|<\V\\P34'd SS,MTpS^, oV#r)rintrr)rrcountrs& rs lookup_fake)_extract_fake_inputs..lookup_fakejs2",Qell0C"D"Di!   rv)rrrrrgetgetattrrtree_maptuplevalueszip find_nodesrr0rrrr8rP)rrr fake_valsrdynamo_bytecode_flattenr dummy_args shuffled_args shuffled_argdetected_fake_modedetected_shape_envrr fake_args fake_kwargsrrrrs&&& @@@@rs_extract_fake_inputsr"s II 77m #   TYY]]51 2   TYY]]?; <  #*".H$"OOO   __[v}}9O2OP /< "% HH  =  1=# D,9,9=u9M )B|$456 # *)i*?@))i*?@ !)E)EE$M' "-?M "XZE E  2I//+6K 9 ,,rvcrVPFKpVP\P\P39gK4WP ,VnKM VP FKpVP\P\P39gK4WP ,VnKM R#r) input_specsrrV PARAMETERBUFFERr output_specsrDBUFFER_MUTATIONGRADIENT_TO_PARAMETER)param_buffer_tablerspecs&& rs_replace_param_buffer_namesr$vs 99        -[[9DK     99  & &  , ,  -[[9DK !rvc \V4\V4\V4,8wd1\R\V4 R\V4 R\V4 R24hV\V4RUu.uF q2V,NK pp.VOVO5#uupi)z,Total number of arg names is expected to be z but got z positional args, z kwargs.N)rr)orig_arg_namesrrkw_namereordered_kwargss&&& rs_convert_to_positional_argsr)s >c$i#f+55:3~;N:OP4yk!3CK= J  8Fc$ik7RS7RGw7RS     Ts*Bc Rp\P!RRV4pVP4EFp\V\P P 4'gK0VPPEFVpVPR 9dKRpVPPR/4;p'd\\VP444wr\P !V 4'd9\#V \P$P&4'dW8XdWJdRpM-\V \(4'g\+R\-V 4 24hV'gKRp W2VP.R,VP0,3/VCpVP34U UU u/uFwp wrW!V4V 3bK up pp VPR&EKY EK R #uup pp i) L['self']z [^a-zA-Z0-9]_Tnn_module_stackFzexpected ty to be str, got cbVR8XdR#VPR4'dV\R4R#V#)r+z L['self'].N)rr)rs&rsnormalize_path2_normalize_nn_module_stack..normalize_paths4{*!|44#C $5$788KrvrNroutput)resubmodulesrrrrrrrrr nextiterrinspectisclass issubclassnnModulerprtyperyrzitems) gm_torch_levelroot_clsrootroot_keyrradd_rootr-rtyr0keys && rs_normalize_nn_module_stackrGs DvvosD1H$$&"ehh2233 HHNNDww33H"&))--0A2"FFF_%;%;%= >???2&&:b%((//+J+J|#(%b#..,/J4PR8*-UVVx X%8%83%>AVAV%VW#&#,;+@+@+B0+BZd..33+B0 +,;#'@0sG cV^8dQhR\PPR\PPR\\\3,/#)raoriginal_module traced_modulereturnrr<r=rrp)rqs"rsrtrts>((XX__(88??( #s(^(rvcJ/p/pVPRR7F0wrEVP\V44eK#WB\V4&K2 VPRR7FwrFWC\V4&K /pVPRR7FAwrW9d\ RV: R24h\V 4V9gK-V\V 4,Wx&KC VPRR7FAwrW9d\ RV: R24h\V 4V9gK-V\V 4,Wx&KC V#)z Returns a mapping of parameter/buffer names from the new module to the original model. This is to help with restoring the FQN for parameter/buffers of a traced module to what the original module contains. Fremove_duplicatez dynamo_name z% already exists in param_buffer_tablez0 already exists in param_buffer_table for buffer)named_parametersr r named_buffersr) rIrJ param_lookup buffer_lookuprparambufferr" dynamo_name dynamo_param dynamo_buffers && rs_get_param_buffer_mappingrYsO$&L$&M&777O    BuI & .&*E #P(55u5M $(bj!N*,%2%C%C&D&!   , {o-RS  l | +.:2l;K.L  +&'4&A&A'B'"   , {o-]^  m  -.;B}s$%?%?588#7#7%?D%?rvc ^RIHp^RIHp^RIHpHpV!V4;pfR#VPUu0uF=pV!WdPVP34'gK)WeP9gK;VkK? ppVPPFepVPPRR4VPPR4;p fK@V!V R VVRR7;p 'gKWWPR&Kg R#uupi) a When we run an interpreter-based pass over a GraphModule, execution of data-dependent operators will produce example values with new unbacked symbols. To track that the new/old symbols are equivalent, we used to rely on the unbacked_renamings mapping. This led to problematic metadata where the unbacked_bindings keys mapped new symbols (u2) to paths containing old symbols (u0) in the example values, or worse, backed symbols or constants (e.g. if the original unbacked was replaced/specialized). Additionally this created problems with de/serialized programs, since we didn't comprehensively serialize ShapeEnv/unbacked renamings/node bindings. This pass attempts a simpler way of handling these for export, by throwing away the previously computed bindings, and re-running the pattern match used in compute_unbacked_bindings. This ensures we keep the original symbols contained in the example values, or delete bindings if they've been replaced/specialized. _get_shape_env_from_gm) _free_unbacked_symbols_with_path)symbol_is_typeSymTNunbacked_bindingsrTrpendingsimplifyrw)torch._export.utilsr|%torch.fx.experimental.symbolic_shapesr}torch.utils._sympy.symbolr~r var_to_range UNBACKED_INTUNBACKED_FLOATunbacked_renamingsrrrpopr ) rr|r}r~rrsymbolbase_unbacked_symbolsrrrs & rs_replace_unbacked_bindingsr>s;V>+B// 8 ,,,F #4d6I6I"J K  66 6 ,  )4099==' 'C 4!A#- "    .?II) * s&C7 C7.C7cPV^8dQhR\PPRR/#ryr)rqs"rsrtrtfs$))UXX%9%9)d)rvc p^RIHp^RIHpHpV!V4;pfR#VP P RR7EFspVPPR4'dK'VPPR4;pfKH\4p\V\P4'dOVPUu.uF7p\V\P\P34'gK5VNK9 p pM6\V\P\P34'dV.p M.p V F/p V\V!V P P"44,pK1 V!VR VVRR 7;p 'dWPR&V'gEKY\%R VP&: R V R 24h R#uupi)rr{)r}rNNrrrrFrzinput placeholder z has unbound unbacked symbols z1; their deferred runtime asserts would be droppedrw)rr|rr}rNrrrr rorrrshaperSymFloatr_exprrr) rr|r}rNrrrrddimsdimrs & rs_add_input_unbacked_bindingsrfsv: ,B// 8##}#5 99==, - - 99==' 'C 0 u c5<< ( (99$a 1u||U^^6T(U9 DellENN; < <5DDC s0@A AG @   !   .?II) * 7 $TYYM1O)LN 96s 92F30F3cVV^8dQhR\R\\\3,RR/#)ra signaturerenamedrKN)r[rrp)rqs"rsrtrts.))#) #s(^) )rvc.VPOVPOFQpVPp\V\4'gK'VP V9gK:WP ,VnKS R#)z?Apply a batch of old-name-to-new-name renames to the signature.N)rrargrrZr)rrr#rs&& rs_apply_renames_to_signaturersU B)''A)*@*@Ahh c< ( (SXX-@xx(CHBrvcHa]tRtRtoRtV3RlRltV3RlRltRtVtR#) _ExportSafeToReorderiaBarrier predicate for export canonicalization. Wraps ``_is_safe_to_reorder`` with an additional constraint: nodes from different ``nn_module_stack`` scopes are never reordered past each other, because ``unflatten`` expects nodes within the same module scope to be contiguous. c<V^8dQhRR/#)rarKNrw)rqrrs"rsrt!_ExportSafeToReorder.__annotate__s88$8rvc,^RIHpWnRVnR#)r)_is_safe_to_reorderN)torch.fx.passes.canonicalizer _prev_stack)selfrs& rs__init___ExportSafeToReorder.__init__sD#6 37rvcN<V^8dQhRS[PPRS[/#)rarrK)rrrkrn)rqrrs"rsrtrs#UXX]]trvc>VPV4'g;\VPPR/4P 44VnR#\VPPR/4P 44pW P 8wd W nR#R#)r-FT)rr rr keysr)rrrs&& rs__call___ExportSafeToReorder.__call__sw''--$TYY]]3Db%I%N%N%PQD diimm$5r:??AB $$ $$ rv)rrN) rxryrzr{r|rrrrrs@rsrrs88 rvrc\V^8dQhR\PPR\RR/#)rarrrKNrrrr[)rqs"rsrtrts5!@!@ !@#!@ !@rvc ja^RIHoHpVP4Fp\ V\ P P4'gK/\P!4pV3RV3RlllpV!VPV\4\R04RR7pW0JgKV'gK\W4K R#)aCanonicalize node order and names in an export graph and all subgraphs. Reorders nodes into a deterministic topological order and renames them to canonical names so that strict and non-strict export produce identical graphs. Updates ``signature`` to reflect the new node names. )_canonical_node_keycanonicalize_graphcV^8dQhR\PPR\\PP\3,R\ P R\/#)rar canonical_idx_ordrK)rrrkrr itertoolsrr)rqs"rsrt0_canonicalize_export_graph..__annotate__sT @ @hhmm @#EHHMM3$67 @ oo @  @rvcP<VPR8Xd^\V43#S!W4#)r)rr7)rrrrs&&&rs_key(_canonicalize_export_graph.._keys* 77m+tDz?**4??rvrT)skip_rename_opsgroup_getitemsN)rrrr6rrrrrrrr frozensetr)rrrmodplaceholder_ordrrrs&& @rs_canonicalize_export_graphrsUzz| c588// 0 0'oo/O )8 @ @) $& )=/ :# GyWW+I?+rv_prettify_placeholder_namescXV^8dQhR\PPR\/#)rarrK)rrrr)rqs"rsrtrts,ss ssrvc \P!WV34p \V4\W4wr\ V4\ VP 4\ VP4,\ VP4,p \W V 4\W0\V44p \W V4p V'd!^RI Hp ^RIHpV!W 4wr V !W 4wr VP#4Fp\%V\&P(P*4'gK/VP,P.FNpVP0R9gKVP2P5RR4VP2P5RR4KP K V f \7R4hV'd\9VV VVVVV 4\;W W|V 4\&P<P>P@'d \CW 4\EVV V VPFR7#) a This is a helper function that is shared between export_to_aten_ir and export_to_aten_ir_make_fx to produce the aten artifact. (export compatible graph module + signature) It does: 1. Applies runtime assertion pass 2. Recompute unbacked_bindings pass 3. Populate meta val when missing 4. Lift constants as placeholders 5. Replace raw autograd and autocast ops with HOPs 6. Prettify names for placeholders 7. Preserve requires_grad value on node meta val )replace_autocast_with_hop_pass)replace_set_grad_with_hop_passr-N stack_tracez'export_graph_signature must not be None)rr2)$r tree_leavesrr"rr parametersbuffers input_tokensset_missing_meta_valsrY_get_non_persistent_buffersr3torch._export.passes.replace_autocast_with_hop_passr3torch._export.passes.replace_set_grad_with_hop_passrr6rrrrrrrrrrr#ri_dynamor$canonicalize_output_graph_node_orderrrr)rrconstant_attrsrq pre_dispatchrrr[rr\total_non_user_inputsexport_graph_signaturerrr_modrs$$$$$$$$$ rs_produce_aten_artifactrs6''(@AN !$6rKB r" O & &' o%% & ' o** + , ".CD@8= 0 NI  &D & "&D & "  $ 4 455 JJ$$Dww33 /6 mT2%%FGG"  "      ! $7N }}@@@"2>  )22  rvc\V^8dQhR\PPR\RR/#)rarrqrKNr)rqs"rsrtrtQs0// /)/ /rvca VPPUu0uFq"PkK upo V 3Rlp\\P ,p\\P ,p/pVPFpVP\P 8XgK$VPPPV4'dKQVPPPV4'd0V!WWPP\V4R,4pM"V!WWPP,4pWVPP&WPnK VPFKpVPPV9gK WgPP,VPnKM VP4Fp \V \P P"4'gK/V PPF4pVPV9gKWbP,;VnVnK6 V P'4K R#uupi)zT For strict mode, rename constants nodes that were previously annotated as buffers. cr<VS9d^pV RV 2;pS9d V^, pKTpSPV4V#)rr,)add)rndup_name node_namess& rsrename_constant0_rename_constants_nodes..rename_constant[sF : A"&q},8;QDt rvN)rrrr$rVrrbrrrrrrr6rrrrr recompile) rrqrr buffer_prefix const_prefixbuffer_to_constantr#c_namerrs && @rs_rename_constants_nodesrQs)+7))7J))9)9:M' (A(ABL++ 99 11 1$((--:R:R ; ; xx}}'' 66( 88==]1C1E#FF) )EF06txx}} -"HHM, ,, 88==. ..xx}}=DHHM- zz|#uxx3344 IIOODyy..*rvcVPRR7UUu/uFwrV\V4PbK upp#uuppi)FrN) named_modulesr>rx)rrrs& rs_get_module_hierarchyrsD.1.?.?QV.?.W .W74d1g.W  s!;c V^8dQhR\R\R\\\3,R\\,R,R\\ ,/#)rarrmodule_call_signaturesforward_arg_namesNrK)rRrrprXr]rW)rqs"rsrtrtsS$$ $$!&9!9:$Cy4' $  / $rvc \Uu.uFp\WBPV4R7NK ppV^,PR8wd!\ RV^,P: 24h\ ..VVVR7V^,nVP4UUu.uFwrFV\9gK\WFR7NK ppp.VOVO#uupiuuppi))fqnrr/z+expected first fqn to be empty string, got routputsrrr)_EXPORT_MODULE_HIERARCHYrWr rrrXrr?)rrrrroriginalr additionals&&&& rs_make_module_call_graphrs,+C C+E+Ec+JK+ {"9(1+//9L M  0+ HQK5::<P,P@'dn^R I!H"pH#pV !4'd V!SSSR 7pM6\(P*P,P/R R 7!V!S44pV!V/VBpVPHR MSV 'd \KR4h\(P*PMSSSRRVVVV R7 !V/VBwppVVPHR&RRR4RRR4RRR4\S\(PZP\4'dT'd \_SX4X# +'giL`;i +'giLk;i \N\P3d)p\\PR\UT44hRp?i\Vd.p\\PXR\UT4 2RR7hRp?ii;i +'giL;i)z Traces either an nn.Module's forward function or just a callable with PyTorch operations inside and produce a torch.fx.GraphModule in torch IR. zexport.private_api_export_to_torch_ireventflagsAExpecting `args` to be a tuple of example positional inputs, got cVPe*VPP\P8Xd VP#T#r)dynamismr>r@STATICr)as&rs%_export_to_torch_ir..s7 :: L4G4G!G%% rvrkc$V^8dQhR\/#)rarK)rn)rqs"rsrt)_export_to_torch_ir..__annotate__ s  T rvcJ<\S;'gS;'g\S\PP4;'g[S;'gQ\P P P;'g%\PP P4#r) rnrrrrrr"fake_tensor_propagate_real_tensors_exportuse_legacy_dynamo_graph_capture) constraintsr r rsrsr<_export_to_torch_ir..use_legacy_dynamo_graph_capture s  D D D D!UXX112 D D. D D&&II  D D }}##CC   rv) _dynamo_graph_capture_for_exportdynamo_graph_capture_for_export)r r F)rlrzoShapesSpec is not supported on the legacy v1 `torch._dynamo.export` path (`use_new_tracer_experimental=False`).Tsymbolic)r r rg tracing_moderrkrrrNz5Consider annotating your code using torch._check*(). constrain_as_size_example) case_name)0r:rr rr INVALID_INPUTr>r tree_map_onlyrrArHrGrBr>r=rCr}replaceDEFAULT_EXPORT_DYNAMO_CONFIGrrrpatchasdictrrrrr&rruse_new_tracer_experimentaltorch._dynamo.functional_exportr"r#rNotImplementedErrorrrMrSCONSTRAINT_VIOLATIONrprO ANTI_PATTERNr<r=r)r rrr rrrkrrris_shapes_spec combined_args dynamo_cfgrrctxr"r#dynamo_graph_capturer@r,er sf&&fd$$$$$ @rsrrs5$31dS%a6 m^<-m^L  ''   LD$$$4_J       # #K$6$6z$B C CA ,. -Ca!5!566&57H-//==''CCC 788/O;~0,05}}/C/C/I/I050J09!<0>,&:4%J6%JN '++K8&1E ). (<(<'5$/15%/2KDo*;'5)= ) )! )%NA@QN''(;>AG G* **GAxP5  { D Cs%N*'AL8<L% ?L AL /A L :L% L8 L"L% % L5 0L84N*5L88N' #M,, N'9N':(N""N''N** N: _record_nn_module_stackc^RIHp^RIHp\ VVVVVVR7p V!V P V P 4wr\V \PP4'g\R\V 4 24hV!V V V PV P\P !W#34\#VP%44V P&V P(RRRR7 p W3#)r)aot_stage2_export)create_graph_signature)rdecompositionsr9z,expected gm to be torch.fx.GraphModule, got FN)user_args_flatparams_and_buffers_flat param_names buffer_names trace_jointnum_user_fw_outs loss_index),torch._functorch._aot_autograd.graph_compiler;4torch._functorch._aot_autograd.input_output_analysisr<r/ _aot_state_aot_graph_capturerrrrrr>rrrrr]r params_spec buffers_spec) rrrrr=r[r9r;r<joint_with_descriptorsr fw_metadatarqs &&&$$$$ rs"_aot_export_joint_with_descriptorsrM^sO?   % 7 ())11OB b%((.. / /KDQSH:VWW- &&''))4.9 $%8%?%?%A B*66+88 O  rv transformcV#rrwrs&rsrrrvr decomp_tablerc |V^8dQhR\PPR\R\R\R\ /#)rarrrrrK)rr<r=rrnr)rqs"rsrtrtsKYY Y $ Y"&Y"&YYrvc V 'd\M\p \4;_uu_4p V P\P P PPVVRRRR74V P\44V P\44V PV !44V P\P!44V!\4!V VVVVVRR7wrRRR4RpV!VX 4V'd V!V 4\'V VVXVVVVV R7 # +'giLA;i \\3d)p\\ P"\%T44hRp?ii;i)T tie_weightsstrict stack_weights)rr=r[r9Nc~\V\PP4'Ed\ VR4'd&VP P VP 4\VPP4R,p\VPP4R,pVPR8wgVPR8wd(\RVP: RVP: 24hRVP 9dVP RVP P VP 4R#R#)rr3z8expected both output nodes to have op='output', got old=z, new=descNr) rrrrhasattrrupdater]rrrr)old_gmnew_gmold_output_nodenew_output_nodes&& rs$_maybe_fixup_gm_and_output_node_meta@_export_to_aten_ir.._maybe_fixup_gm_and_output_node_metas fehh22 3 3vv&& ""6;;/"6<<#5#56r:O"6<<#5#56r:O!!X-1C1Cx1O$NOaOaNddjkzk}k}kAB---#((0  ' '(<(< = 4rv) rrrrqrrrr[r)rrr enter_contextrr<utils stateless_reparametrize_modulerrno_gradrMrMrSrrr1rpr)rrrr[rproduce_guards_callbackrNrrQrr#custom_triton_ops_decomposition_ctxrrrqr`r8s&&&&&&$$$$$ rs_export_to_aten_irris] '  ?(   HHNN $ $ : :# " ;   356 467 ?AB EMMO,'(JK   ' 3$(  2 >$)b1 H #B ' " %'!/$?  s l)/: HM>>AG G Hs$CD/E/ D? E;#E66E;c V^8dQhR\PPR\\R3,R\ \ \3,R,R\\ ,/#)rarr.rNrK)rr<r=r rrrpr])rqs"rsrtrtsQ  S/ cNT ! #Y rvc  \P!VP4pVP!V!Pp.pVP 4FwrgVP V,P\PP8Xd6TP\V4UU u.uF wrV RV 2NK up p4KtVPV4K V'd VPVP44V#uup pi)a Gets the argument names to forward that are used, for restoring the original signature when unlifting the exported program module. - Positional args: retain the original argument names, and enumerate *args as args_0, args_1, ... - Keyword args: retain the original kwarg names in the order specified by the user. This order seems to matter for the current state of export lifted modules. r,)r9rforward bind_partial argumentsr?rr_ParameterKindVAR_POSITIONALextendrrr) rrrr_argsnamesrrtrr,s &&& rs_get_forward_arg_namesrts   CKK (C   d # - -EE{{}  >>$  $ $(>(>(M(M M LLIe4DE4DDATF!A3-4DE F LL  % V[[]# LFs%C? cnV^8dQhR\PPR\\,/#r)rr<r=rorp)rqs"rsrtrt s&  UXX__ S rvca\4pVPRR7FPwopS'd(VPV3RlVP44K5VPVP4KR V#)zG Returns set of non-persistent buffers in a module and its submodules. FrNc32<"TF pS RV 2xK R#5i)rNrw).0brs& rs ._get_non_persistent_buffers..sO1NATF!A3-1Ns)rorr[_non_persistent_buffers_set)rresultrrs& @rsrr s\uF$$e$<a  MMO1N1NO O MM!77 8 = Mrvc V^8dQhR\\P,R\\\P3,R\P P R\R\\\3,RR/#)raorig_mod_statetraced_mod_staterrqrrKN) rorrrrprrr[rE)rqs"rsrtrtsp!9!9 %!93 ,-!9 !9* !9 C//0 !9  !9rvcVPPRR7Uu/uFqUPVbK ppVPEFpVP\ P \ P39gK5VPf\RVP R24hWP,pW9gKv\ PVnRVn \V\PP4'dVP!4pWVP&WgP"P,p\%WX4EK R#uupi)zm Dynamo can mark tensor attributes on modules as parameters or buffers. Rewrite them to be tensor constants. rrNz!spec.target must not be None for z kind)rrrrrrVrrrrrb persistentrrr< Parameterdetachrrc) rrrrqrrplaceholder_lookupr#rts &&&&& rs _rewrite_dynamo_tensor_constantsrs%'HH$7$7=$7$I$ID 4$I ++ 99,,i.>.>? ?{{"$7 {%H%[[1E*&55 "&eUXX%7%788!LLNE).$++&)((--8+D8%, sE cV^8dQhR\PPR\R\\ \ 3,RR/#)raorig_modrqrrKN)rr<r=r[rrprE)rqs"rsrtrt;sIFFhhooF)FC//0F FrvclVPFpVP\P8XgK$VP'dK8VP f \ R4hVP V9d\ RVP : R24hVPVP 4W#P &K R#)z3 Moves non-persistent buffers to tensor constants. Nz;spec.target must not be None for non-persistent BUFFER kindz spec.target z# should not already be in constants)rrrVrrrr get_buffer)rrqrr#s&&& rs0_move_non_persistent_buffers_to_tensor_constantsr;s ++ 99 (( ({{"$Q{{i'$"4;;/1TU&.%8%8%EIkk ",rvcPV^8dQhR\PPRR/#rarrKNr)rqs"rsrtrtPs$((%((*>*>(4(rvc B\V.\VP44,4EFowr\V\P P 4'gK2VPPEF"pVPR 9dV^8XdVPPRR4;pf\RV RVP R24h\;QJd*RVP44F 'dK RM RM!RVP444'g\RV RVP R V 24hKKVPR 9gKVPPRR4'gEK \RV RVP R 24h EKr R#) af Perform nn_module_stack checks on the graph. Current constraints: For the top level graph: - populated for 'call_function', 'get_attr' - None for 'placeholder', 'output' For submodule graphs: - None for 'placeholder', output' TODO(pianpwk): make this a consistent node-level check once nn_module_stack is populated for cond submodules. r-NNode of type z$ is missing nn_module_stack metadatac3"TFwr\V\4;'dc\V\4;'dK\V4^8H;'d5\;QJdRV4F 'dK RM RM !RV44xK R#5i)rac3B"TFp\V\4xK R#5ir)rrp)rxrs& rsrz4_verify_nn_module_stack...ms>Aq 1c 2 2AsFTN)rrpr rall)rxrrs& rsrz*_verify_nn_module_stack..is| %A>CCC>A>>?% rzPlaceholder node name z does not follow spec for z, name should have prefix: N)rrrrr6rrrrrrrr$rr%)rrr# name_to_kindrr node_kindprefixs&& rs_verify_placeholder_namesrs:=IHHMM499,LIzz|#uxx3344 IIOODww-'99L0(3 -i8yy++F33,0 ;UV_U``{}C|DE$Js)D cRV^8dQhR\R\\\3,/#)raeprK)rUrrpr)rqs"rsrtrts"44_4c3h4rvc^p\4pVPP4EFp\V\P P 4'gK0VPPFpVPR8wdKV^, p\VPR4'g\RVP R24h\VPR4'g\RVP R24hVPVPP RVPP 24K EK RVR V/#) rrryz node.target z must have __module__ attributerxz must have __name__ attributerop_countop_set)rorr6rrrrrrrrZrrrryrx)rrrrrs& rs get_ep_statsrs H UF __ $ $ &!UXX1122 GGMMDww/) MH4;; 55$"4;;-/NO4;; 33$"4;;-/LM JJ$++0014;;3G3G2HI J"' (F 33rvcFa\P!S4V3Rl4pV#)c <\P!4pS !V/VBp\P!4p\R RRRWB, R\/\V4BRsRsT# \dp\ T4pTP R,TP,p\T4pTe<\P\T44\RT\T4\R7M\RT\T4\R7\TR 4'd&\TP\ P"R 7ThRp?ii;i RsRsi;i) rz export.timemetricsrrNzexport.error.classified)rr>messagerzexport.error.unclassifiedpartial_fx_graph)filerw)timer: _EXPORT_FLAGSr Exceptionr>ryrzrlogerrorrrprZprintrsysstderrr) rrstartrendr8t error_typer'fns *, rswrapper$_log_export_wrapper..wrappers6' ,IIKET$V$B))+C  #   $ r"  D!M'+ $ ? QA+ann+CD99D>>EE) functoolswraps)rrsf rs_log_export_wrapperrs&__R++Z Nrvc\V\\\34'gV3pMO\V\4'd \V4pM-\V\P \34'dVfV3pVf/pW3#r)rr r]rrr)example_inputsexample_kwarg_inputss&&rs$_process_jit_trace_inputs_for_exportrsp nudD&9 : :(* ND ) )~. >ELL$#788 ((*#!  //rvczV^8dQhR\PPR\\\ 3,/#r)rr<r=rrpr)rqs"rsrtrt s*  %((// d38n rvc\VPRR74p\VPRR74pW,p\V4pVFpVP VR4K V#)FrNN)rrPrQrr)rrPrQoriginal_state_dictnon_persistent_buffersrs& rs_get_original_state_dictr skC00%0HI**E*BCM*:8= #4($ rvcV^8dQhR\PPR\\R3,R\ \ \3,R,R\\PP,\PP,R\\\R3,\ \ \3,\\\\.R3,3,/#)rarr.rNr rK)rr<r=r rrrpr rAdditionalInputsShapesCollectionrRrrU)rqs"rsrtrtsEXEX EX  EX f  $EX( ll##$ ll##$ EX  &#+f  o  $% 'EXrvc\V\4'g'\\PR\ V4 24hVeTM/p\ P!V4'd \V4p\ P!W34wrE\V\PP4'd VPpVPWV4pMBRp\V\PP4'dVPWV4pMTp\V\\ 34'g#\#\%\&R,V4WV4pWWWV3#)a Process and validate export inputs for the torch.export API. This function validates the input arguments, normalizes kwargs, computes input tree specs, and handles special dynamic shapes cases like AdditionalInputs and ShapesCollection. Args: mod: The PyTorch module to be exported. args: Tuple of example positional inputs for the module. kwargs: Optional dictionary of example keyword inputs. dynamic_shapes: Optional specification for dynamic shapes. Can be: - dict mapping argument names to dynamic shape specifications - tuple/list specifying dynamic shapes for each input in order - torch.export.AdditionalInputs object with verification callback - torch.export.ShapesCollection object Returns: A tuple containing: - args: Validated tuple of positional inputs - kwargs: Normalized dictionary of keyword inputs (empty dict if None was passed) - original_in_spec: TreeSpec representing the flattened input structure - dynamic_shapes: Processed dynamic shapes specification - verify_additional_inputs: Callback function for additional input verification Raises: UserError: If args is not a tuple. rNcR#rrwrs&rsr(_process_export_inputs..Ssdrv)rr rrr(r>ris_namedtuple_instance tree_flattenrrrverifyr rrHrGrBr _DimDynamicShapesSpec)rrrr r,original_in_specverify_additional_inputsout_dynamic_shapess&&&& rs_process_export_inputsrs(R dE " "  ' 'OPTUYPZ| \  )VrF $$T**T{ --tn=A.%,,"?"?@@#1#8#8 +::3fM#2 nell&C&C D D!/!>!>s&!Q !/  (:z*B C C6 &-/A BCv  )?W WWrvc V^8dQhR\R\\R3,R\R\\,R,R\\ P P\\,3,/#)raexport_artifactr.strict_mode_exportrNrK) rr rprnr]rrrrW)rqs"rsrtrtasd.!.!#.!$)#s(O.!.!Cy4' .!  588  o!6 67 .!rvc (VPPpVPPpVPpVPpVP p/p VP 4F:wrV'g \V 4MT p \..V R,V R,RR7W&K< \V4^8d@V'g \V4\W4!V4p V f \R4hV Pp\f \R4h\VVV V4pWN3#)zt In-place modify the graph module in export_artifact, remove _export_tracepoint nodes and return module_call_graph. rrNrz$CollectTracepointsPass returned Nonez)_EXPORT_MODULE_HIERARCHY must not be None)rrrrrrr?rrXrrrrrrr)rrrrrrrrrrrspecsmod_fqnresmodule_call_graphs&&&& rs_get_module_call_graphras /3366B3B3G3G3K3K))(//G(11H>@'--/ *<+c"#*=)$:&" + '0 )*Q.! $R ($%;TUWX ; !GH H   'HII/    rvcXV^8dQhR\PPR\/#)rarr)rr<r=r)rqs"rsrtrts$ #rvc"VPPpVPPpVPp\ R\ VP 44\VP 44p\WW44wr\VVV VV4p V #)c3l"TF*wrVP\P8XgK&VxK, R#5ir)rrVra)rxrss& rsrz)_get_range_constraints..s- Evv--- AEs#4 4) rrrrr7rrrr?r) rrrrr rrr num_liftedr4range_constraintss &&&&& rs_get_range_constraintsrs /3366B3B3G3G3K3K / 9 9I !"8"D"DE " . ./ J%> 6%!M)   rvc$V^8dQhR\/#)rarr7)rqs"rsrtrts~rvcVPf \R4hVPPP4UUu/uFwr\ V4'gKWbK upp#uuppi)Nz$fake_mode.shape_env must not be None)rrrr?rN)rrrs& rs_get_inline_constraintsrsd"CDD''44::<   --n=--n=s>B A&!B &!BB cV^8dQhR\PPR\\R3,R\ \ \3,R\R\\ R3,R\R\R \R \/ # rarr.rr r orig_in_specrk _to_aten_funcrK rr<r=r rrrpr rRrnrr)rqs"rsrtrtsrr r S/r cNr( r %*#s(O r  r26rrrrvc \VVVVVRVRR7p\WV4wp p p \W4p VPPFp V P R8XgKRV P 9gK)\WP4p\V\PP4'dKjV f \R4h\\V44'd\!W4V P R&KV P#VRR7V P R&K Rp\VPP$\P&PP(4'dVPP$P*P,;ppVPP$P*P.pVf \R 4hVP\0\239d\4P6!V.4pRp\9VVP:V4VPP$nM\VPP$\P<P>P@4'dBVPP$PBpR;ppR;qPP$n"M"\GR VPP$ 24hVPI4\KV\V44\MV4p\OV4p\QW4p\SV4pVPU4UUu/uF wppVVbK pppVUu0uFpVV9gK VV,kK upVn+\YV 4pT ;_uu_4\[V4;_uu_4\\P^PaV R R4;_uu_4V!V\cVW4/V V4pRRR4RRR4RRR4XPdpVPfpVPhp\kVVV4\m\o\qVPs4VPu444\w\qVPyRR 7VP{RR 744VVVR 7\}VV4\VVV4\VVV4\VV4Vf-VPpV'dVP4^,pMTp\VVVV VP R,R7#uuppiuupi +'giELT;i +'giEL`;i +'giELl;i)R _to_aten_func can either be `_export_to_aten_ir_make_fx` or `_export_to_aten_ir` F)rrrkrrrNzbCannot find dynamo_fake_mode. This could be due to the exported graph module have no placeholders.T) static_shapesout_spec must not be NonezUnknown codegen type: allow_non_fake_inputsrN)rrrrqrrrrrrr)Errrrrrrr rrrr<r=rr5r>r4 from_tensor_codegenr_PyTreeCodeGen pytree_infor orig_argsr]r rtreespec_tuplerQ_in_specrfunctional_export_DynamoBytecodeCodeGenr& wrap_tuple RuntimeErrorrrGrrrYrr?r|r2r1r r,rr)rrrr rrorrrrrPrQr$rrwrrchildrenr) rrrr rrrkrr@rrdynamo_fake_moder[rattrr r orig_out_specr&params_buffers_to_node_metarr"rtracedorigreverse_name_lookuprtxaten_export_artifactrrrs &&&&&&&& rs_strict_exportrs)  'E4_ N" ^6: 11AR $$** 77j U$))%;>;;7DdEHHOO44#+(|#4:..'89I'PDIIe$'7'C'CD(D(DIIe$+"J.&&//1N1NOO#1#7#7#@#@#L#L#U#UU='--66BBLL   !<= = ==u -,,hZ8HJ4?   # # 5 %%1 %% ''>>   (--66EE#''=@DD ))22=3N4H4H4Q4Q3RSTT~tCy9"@"P,C0N)B3)W 9=P@PBPDT T!3R 7p"T!PFT"n#RRR4K R p#XP2PIT#4RRR4TPJf \MR4h\)X4p\OT4p$\Q\1T4\1T4TT RT$\\ST^T T44\\STYT ,T44///TTPJR..R7p%TT%3# +'giELC;i +'giELO;i +'giEL[;i TeTP'4Rpii;iuupppi +'giEK;i +'giEL";i)FrNT)store_orig_modc"<\S!V!4#r)r )rflat_fns*rs wrapped_fnG_export_to_aten_ir_make_fx.._make_fx_helper..wrapped_fns$( (rvrNcV!W4pW9d\PP4'd\V\P4'd\P P 4pVFp\V\4'gKVPp\W4PpVPR\PPPPW3/4p \!WIRVR7K V#)z The idea here is that we override subclass getattr methods to proxy inner tensors and metadata. Because of infinite loop shenanigans, we have to manually construct the getattr proxy nodes without relying on torch function system. rN)rhtracer)rr_is_torch_function_mode_enabledrr overrides _get_current_function_mode_stackrKr$rIproxy create_proxyrraccess_subclass_inner_tensordefaultrL) rroriginal_getattrattrs_to_proxyouttorch_function_mode_stackmoder$r( inner_proxys &&$$ rscustom_getattributeP_export_to_aten_ir_make_fx.._make_fx_helper..custom_getattributes't2)xx??AA%c5<<88!& P P R6)B#-d4P#Q#Q-1[[F,:4,H,N,NE282E2E(7(- (8(8(U(U(](]). (* 3&K %6(+4PV%&)B rvc3p<"/pVFp\V4pVFpWA9gK \W4,4^8Xd\RV R24hW4,^,p\\ V44\\ \ P 44, pVPV3W&K K VP4F(wpwpp\P!S VVR7p WnK* RxVP4FwpwrWnK R# TP4FwpwrYnK i;i5i)z~ Context manager that temporarily monkey patches tensor.__getattribute__ so that we can intercept it at torch_function layer. zsubclass_types_to_instances[z] must not be empty)r,r-N) r+rrrodirrr__getattribute__r?r partialmethod) rtensor_type_to_old_getattributersubclass_types_to_instances subclass_typeinstancer-r old_getattrcustomr,r2s & rs$override_getattribute_for_subclassesa_export_to_aten_ir_make_fx.._make_fx_helper..override_getattribute_for_subclassessK0 C6c:0*E (O"#>#MNRSS&4&B=/Qd$e'"!"(C'QRS'TH-0X-?#c%,,FWBX-XN - > > .N;J*E  $99>>@#&!*!8!8/-8+9" .4* A/N/T/T/V++K-8*0W/N/T/T/V++K-8*0Ws$D6BD6+AD+$D6$D33D6c3"\P!4pRx\PPV4R# \PPT4i;i5i)z When pre-dispatch export accidentally change grad state, we restore it back. This can happen when we are calling torch._C._set_grad_enabled directly in the forward. N)ris_grad_enabledr_set_grad_enabled) old_states rs_maybe_restore_grad_stateV_export_to_aten_ir_make_fx.._make_fx_helper.._maybe_restore_grad_statesA"113 :HH..y9EHH..y9sA">!A"!AA")record_module_stackrr)rcVPR8XdVP\PPP P \PPPP \PPPP\PPPP \PPPP 39dR#R#)rFT)rrrrprofiler_record_function_enterr+_record_function_enter_new_record_function_exit_RecordFunctionrrrr*)rs&rs _is_impureG_export_to_aten_ir_make_fx.._make_fx_helper.._is_impureGs77o-$++ II&&==EEII&&AAIIII&&<<LLIINN))11II$$AAIIB3!rvzout_spec.spec is None!)rr user_inputs user_outputsinputs_to_parametersinputs_to_buffersbuffers_to_mutateparameters_to_mutateuser_inputs_to_mutaterrbackward_signaturer output_tokensr)*rrPrQrrr rr'rqr,rrr rr r.r-rrJremover(r_buffersr?r]rr _find_noderrrrrcopy_r+reliminate_dead_coder#rr)r*r)(rrrrrrPrQparams_and_buffersr?rI param_len buffer_len params_lenfunctional_callparams_buffers_argsr flat_argsrr!r6non_strict_rootassigned_buffershookr>rDr input_namesrrbufbuffer_input_names output_nodebuf_node name_noderrM output_namesrr2r s(&&&&, @@rs_make_fx_helper3_export_to_aten_ir_make_fx.._make_fx_helpers12 4 4e 4 LMS...FG B 0BMB/5/B/BCU/V,"'(?"@() ' +, 0 j *,""#:;""4(4 & $002E1NO 7  ! ) " )& ' '-C%c>4@O/1 D*2?C7#%5" H, 9, 9\ : : C8CC-// ",0%)! "B0D#KKMD*04 +4O4L4L4R4R4T*U&*U;D#5D+i!m44*U#& #288>>226 !1!7!7!9IC)".@.EFH *2t 4I22;??#%88#7#7+!IINN0088"*I!6$8$ )2 @?": & HH ( ( 4K(P ==  !9: :(, *2. ,-'#JK0%!%c+a *BDT&U!V"K ,BC]S!!#"$]]#' *3w_0//DCCCC#KKMD$ &@??U( ' 'sAQ1 P%;P O= O)/O= 7P ?P%A Q Q %Q :BQ> Q Q Q Q. TrTF)rBrrrNr)rrrrqrrrr[)rrbrr<rcrdrerrrrrrusersrrrrrZr[rMrSrrr1rpr) rrrr[rrgrNrnrrrqrr8s &&&&&&& rs_export_to_aten_ir_make_fxrqs`J   HHNN $ $ : :# " ;   356 467'8     HHNND?* Oq(*#' % # c588// 0 0WS&5I5I GGNN388 $I N H #B ' " %'/  [ T)/: HM>>AG G Hs7B6F F -F A4F F3 F0 3G,#G''G,c^pVPPFbpVPR8XgKW28d>WV, ,p\V\P 4'gWTP R&V^, pKd R#)rrrN)rrrrrrr)rrcnum_params_buffersindexruser_args&&& rsrrsa E 77m #*$-?%?@!(ELL99'/IIe$ QJE rvcV^8dQhR\PPR\R\PP/#)rarrrK)rrrrprk)rqs"rsrtrts8LL588''LsLuxx}}Lrvcha\\V3RlVPP444#)c3L<"TFqPS8XgKVxK R#5ir)r)rxrrs& rsrz_find_node..sJnd T8ITTns$ $)r7r8rr)rrs&frsrZrZs! JbhhnnJJ KKrvcV^8dQhR\PPR\\R3,R\ \ \3,R\R\\ R3,R\R\R \R \/ #rr)rqs"rsrtrts{{ { S/{ cN{( { %*#s(O {  {26{{{rvcaaaaaaaaRoRo/oVVVV3Rlp\PPP'd \ 4M \ 4p V ;_uu_4\ VVVSVR7wop p ooo\SV4p RRR4VVVV3Rlp \S4p\P!\4pRVR&S;_uu_4\4;_uu_4\V4;_uu_4\PPPV4;_uu_4\!VX X S4;_uu_4wppppp\#WS4;_uu_4\%4;_uu_4V!VVVX VV VR7pVP&P)4UUu/uF(wppT\+V\,4'd VV,MTbK* uppVnRRR4RRR4RRR4RRR4RRR4RRR4RRR4\/VXP0VP&4Sf \3R4hSf \3R 4h\5VSSSSR 7# +'giEL;iuuppi +'giL;i +'giL;i +'giL;i +'giL;i +'giL;i +'giL;i +'giL;i) rNc&<aRR/VVVVV3RllpV#)rNc<T;'g/p!VV3RlR\PP4pV!V4pSUu.uF pRV,NK pp\4p \ V\P P 4'g \WhS4p V ;_uu_4S!WV3RV/VBwrRRR4\PRX 4\P!\X P4V n \P!\V P4V n\P!\V P4V n\P!\V P 4V n\P!\V P"4V n\P!\V P$4V nV P&P(F}p RV P*9gKV P*R,p \P!\V 4P-4UUu/uFwr\/V4VbK uppV P*R&K W3#uupi +'giEL;iuuppi)cB<aa]tRtRtoV3RltVV3RltRtVtV;t#)]_non_strict_export.._tuplify_outputs.._aot_export_non_strict..Wrapperic0<\SV`4WnR#r)superrr)rrrs&&rsrf_non_strict_export.._tuplify_outputs.._aot_export_non_strict..Wrapper.__init__sG$&(+%rvcx<VPp\P!W34wpo\V\P P 4'd\VPP49d \W1V4\P PP4;_uu_4.VOVP4O5p\P PV4P!V!pRRR4MV!V/VBp\P!X4wpo\V4# +'giL4;ir)rrrrrrrr<_forward_pre_hooksr tracebackpreserve_node_meta Interpreterrunr ) rrrrr,tree_out flat_outsrrs &*, rsrle_non_strict_export.._tuplify_outputs.._aot_export_non_strict..Wrapper.forwards++C!'!4!4d^!DJAw!#uxx';';<<>"55<<>?>cP"XX//BBDD#._tuplify_outputs.._aot_export_non_stricts\\rF , ,%((// ,:"#,K.L--K!##-K *--Cc588#7#788&@Q$UVfVPUV II> C#__[#..ICN //+s{{CCK$*OOKAVAV$WC !'-S55(C $%+OOKAVAV$WC !'-S55(C $$ 1&*ii0A&BO)/')%')"4)"HC#3,)"4DII/0'7NC-$4sI"I'3I;' I8 rw)rrrrrrsf rs_tuplify_outputs,_non_strict_export.._tuplify_outputss D tD D L&%rvrc$<\SVSSSR7#))rrr equalities_inputsoriginal_signature)r)rr rrrs&rs_produce_guards_callback4_non_strict_export.._produce_guards_callbackA s3)/1   rvFrd)rgrNrzin_spec must not be Noner)rrr#detect_non_strict_fake_tensor_leaksrrrrr2r}r-r+rr1rr,rrrrr?rr3rrrr)rrrr rrrkrr _fakify_ctxrrr[rr dynamo_config patched_mod new_fake_argsnew_fake_kwargsnew_fake_constant_attrsmap_fake_to_realrrrrrrrrrs&&&ff&&& @@@@@@rs_non_strict_exportrs!%H#G?AG&G&` ==   C C C !" ]      8c        5YD! $    "B &&'CDM /0  &((  ""=11 #3 ; J JO' !)) D D ! # #$1#'(@*$ !5 > > D D F. FHCj>N.O.O%c*UXX F. * $ E K 2  ) B5 ! % %';'E'E899788  !+  _ B. $ # E D K J 21   )(  s $I KK 02J8 "J%9JI?'-I,.I&" I, I?JJ%#J8 +K 3K I# &I,, I'd \AV4h\BPD!V^R7K VP0PFp\IWV4p\KVPL4pVVP0PNPPR&\STTTTV'dRMT4p\UVVVV4wpp\WV4\YV4\[VV4\]VV4^RI/H0p\cVVPdVV VVW3VP0P2V.R 7 pV !V4V'Eg\P P"P$'Ed^RIHp^R I3H4pVP*p\kV4p.p\mV4^8EdNVEF p \oV 4V9dV\oV 4,p!V!PPPqR 4p"V!Prp#V"fGV!PtF6p$V$PPPqR 4p%V%fK$R V$Pr R V% 2p"M V"fRMT"p"RV Pv RV Px 2p&RV& RV# R V" 2p'VP{V'4KRV Pv RV Px 2p&RV& R2p'VP{V'4EK RP}V4p(\BPD!R\mV4 RV( R2^R7?V#)FN)fake_tensor_tlsrrrr rrrkrzWe found a fake tensor in the exported program constant's list. This typically means our tracing system encountered an op that we can't trace through. For the potential source, you can refer to following model attribute: z". Please file an issue on github. ) stacklevelinline_constraints)TrainingIRVerifier rBrrq state_dictrrrr verifiers)'_FAKE_TENSOR_ID_TO_PROXY_MAP_FOR_EXPORTrz Used by 'z': zzshape=z, dtype=z FakeTensor(z ) from node 'z): z z Detected z fake tensors that are still alive after export. This is likely result of torch.export.export not being able to track side effects that is happening outside of model scope. Leaked tensors: zU Alternatively, please file a bug report to PyTorch team for further debugging help.)?rrrrHrG ValueErrorrFrrrrr_guardsr0rrrrrtorch._subclasses.fake_tensorr%non_strict_export_fake_tensor_trackerclearrqrrr? _subclasses fake_tensor FakeTensorr error_on_lifted_constant_tensorsrwarningsr_rrtrrrrrrrrrr!torch._export.verifierrrUr"torch.fx.experimental.proxy_tensorrr;rrr rrprdtyperjoin))rrrr rVrrkr3rrrhas_ambient_modercr, export_funcrrconstr error_msgrrrrrrrexported_programr active_fakes legit_leak leak_sourcesfake_valrr node_nameuser user_stack shape_info leak_info leak_detailss)&&&&$$$ rs_export_for_trainingr sN 5S9Z0HINEEFF s&A   337 **D>:  ==99)DDP%+.0BK emm**NNNA==CCE!  %'E!4_0 O *)..88>>@JE3U&&22==&u--238978==''HHH&y11MM):A -1155.s&A01J1JK:LO  !56.  N 3& BBb"89C(9& hh.&++~!&&00%& -. 6emm**NNNA 'LL &El&S "$ z?Q &h<#JJB2h<PD"&))-- ">K $ I#*$(JJD)-})EJ)509$))D .U % %/'.5( $*(..)9(..AQ!RJ"-j\ykQUVaUb cI '' 2$*(..)9(..AQ!RJ"-j\9T UI '' 29'>";;|4L MMC O,-&'3^4fg    rvr) phase_namecV^8dQhR\PPR\\R3,R\ \ \3,R,R\R\R\\ R3,R \R \R \/ #) rarr.rNr rVrrrkrKr)rqs"rsrtrt9 shh h S/h cNT !h( h  h%*#s(Ohh26hhrvcaa^RIHp\V\\34p V 'dV'd\ \ 4h\V4s\4p T PV'dRMR4T PV'dRMR4V s \R\R7\RR R 7V'd3V!4'd&\VVVVVVVR 7o\R V3R lR 7S#\WW#4wppp pp \!V4p V'd\"M\$pV!VVVVVV V\&P(!\*VR7R7pVP,P.p\1WV4p\3VP44pVVP,P6P8R&\;TTTTV 'dRMT4p\=VVVV4wpp\?V4\AV4\CVV4\DPFPHPKV RR7^RI&H'p\QVV4\SVVPTVV VVW3VP,PVV.R7 o\R V3RlR 7V !S4S#)a Traces either an nn.Module's forward function or just a callable with PyTorch operations inside and produce a ExportedProgram. Args: mod: the `nn.Module` to trace. args: example positional inputs. kwargs: optional example keyword inputs. dynamic_shapes: An optional argument where the type should either be: 1) a dict from argument names of ``f`` to their dynamic shape specifications, 2) a tuple that specifies dynamic shape specifications for each input in original order. If you are specifying dynamism on keyword args, you will need to pass them in the order that is defined in the original function signature. The dynamic shape of a tensor argument can be specified as either (1) a dict from dynamic dimension indices to :func:`Dim` types, where it is not required to include static dimension indices in this dict, but when they are, they should be mapped to None; or (2) a tuple / list of :func:`Dim` types or None, where the :func:`Dim` types correspond to dynamic dimensions, and static dimensions are denoted by None. Arguments that are dicts or tuples / lists of tensors are recursively specified by using mappings or sequences of contained specifications. preserve_module_call_signature: A list of submodule paths for which the original calling conventions are preserved as metadata. prefer_deferred_runtime_asserts_over_guards: With the current dynamic shapes language for dims and derived dims, we can run into constraints that are not expressible with the language. For example, flattening a matrix and adding to a vector, both fully dynamic (i.e. x.reshape([-1]) + y) emits a guard s0 * s1 = s2, which is not expressible. By default, we either raise a constraint violation error or specialize to static values. If this flag is set to True, we avoid erroring out and instead allow complex constraints to exist as runtime assertions in the graph. The sympy interpreter (torch/utils/_sympy/interp.py) will produce the math ops required to compute and assert the value of the guard (e.g. sym_size_int, eq, _assert_scalar). Additionally, if TORCH_DYNAMO_DO_NOT_EMIT_RUNTIME_ASSERTS=1 is specified, we will allow complex constraints while not emitting runtime asserts, returning a cleaner graph with lesser guarantees around dynamic shapes. Returns: An ExportedProgram containing the traced module. ) export_training_ir_rollout_checkrV non_strictr aot_dispatchz export.enterrrcR#)zstart!rwrwrvrsr_export.. s8rv) payload_fn)rVrrkrc<\S4#rrrsrsrr s Rrv)rrrNT)in_place)Verifierrc<\S4#rr)rsrsrr s SAQ=Rrv),torch._utils_internalrrrHrGrrFrrrorrr:r6rrrrrrpartialrirrrtrrrrrrrrrrrrcremove_proxy_from_state_dictrrr!rUrr)rrrr rVrrrkrr3rrrrrrrrrrrrrrrs&&&&$$$$ @@rsrr6 sWtGZ0HINEEFF 5S9 EE II&hl3 II n.AM>?h+;<8:: !    +I8c  ,I  s&A   337%+.0BK!  %'E%4_'' %  O4C3G3G3K3K.s&A01J1JK:LO  !56.  N 3& BBb"89 MM445HSW4X/C(& hh.&++~!&&00* (5RS-. rvc V^8dQh/^\9d \;R&^\9d \;R&^\9d\\,R,;R&^\9d"\\\3,R,;R&#)rarr Nrr)__conditional_annotations__r rorpr)rqs"rsrtrtsoFPOyOGLXWYWM@.&%s3x$%A.B.76$sCx.4/6C.rvr)NNrw)rr}rr9rloggingr4rrrcollections.abcr contextlibrrrrtypingrr r r unittestr weakrefr torch._dynamotorch.fxtorch.utils._pytreerc_pytreertorch._dispatch.pythonr torch._dynamo.excrrtorch._export.db.loggingrrtorch._export.non_strict_utilsrrrrrrrr-torch._export.passes.collect_tracepoints_passr(torch._export.passes.lift_constants_passrrrrrrr r!r"r#r$rr%torch._export.wrappersr&5torch._functorch._aot_autograd.graph_capture_wrappersr'rFr(r)&torch._functorch._aot_autograd.schemasr*-torch._functorch._aot_autograd.subclass_utilsr+$torch._functorch._aot_autograd.utilsr,r-torch._functorch.aot_autogradr.r/ torch._guardsr0r1r2"torch._library.fake_class_registryr3r4torch._library.opaque_objectr5torch._loggingr6rr8rr9r:%torch.export._leakage_detection_utilsr;torch.export._unliftr<torch.export.dynamic_shapesr=r>r?r@rArBrCtorch.export.exported_programrDtorch.fx._symbolic_tracerE"torch.fx.experimental.dynamic_specrFrGrHrrIrJrKrLrrMrNrOrPtorch.fx.graphrQrRtorch.utils._sympy.value_rangesrSrrTrUrVrWrXrqrYrZr[ getLoggerrxrrrpr r]rr  dataclassr]rrr+criticalrr exceptioninfowarningrr_rcrrrrrrrrrr$r)rGrYrircrwrrrrrrrrrrrrrMrirtrrrrrrrrrrrrrrrrrrrrqrrZrrrrt)rs@rsrs $==66 $$;6   Q   63XBWDCR8,8QQB5;   '(;! $(S>E#s(O#Cd3i#OO"7!Cj!PSW!WW ,,,2     d#==$= 23  MM MM  LL KK OO  MM >: 9 9BBC( :.0*Q-h : 'T(V),X -<%?P)X)4!@Hs!%sl/dD $: 4 O 79 O',O9>OO#O OOd.!.bYYYY)-Y).YYx> !9HF*(V404,"& %266/d0$ EXP.!b@&&">>rv!dN "L{|j  j79j9>j jZ(3h  h79hh9>h4 hrv