+ j/JjaRutJ0tRt^RIt^RIt^RIHt^RIHt^RIt^RIH t ^RI H t H t ^RI Ht^RIHt^RIHt]P&t]P(tRvt]^kR s.s]^k]P0!4t]P4!4t]!4s]!]P<R 4'd]P<P>t MR R lt ]!]P<R 4'd]P<PBt"MRRlt"Rt#Rt$Rt%RRlt&RRlt'!RR](4t)RRlt*RRlt+RwRRllt,RR lt-R!R"lt.RwR#R$llt/RwR%R&llt0RxR'R(llt1R)R*lt2R+R,lt3RyR-R.llt4RwR/R0llt5R1R2lt6R3R4lt7R5R6lt8RwR7R8llt9!R9R:4t:!R;R<4t;R=tR?lt=RzR@RAllt>RBRClt?RzRDREllt@RFRGltARHRIltBRJRKltCRLRMltDRNROltERPRQltF^RRIG5^RRIH5.RSNRTNRUNRVNRWNRXNRYNRZNR[NR\NR]NR^NR_NR`NRaNRbNRcNRdNReNRfNRgNR:NRhNRiNRjNRkNRlNRmNRnNRoNRpNRqNRrNRsNRtNtIR#){zH This package enables an interface for accessing MTIA backend in python N)CallableAny)Tensor) is_fbcodeis_prod)_LazySeedTrackerDevice)_get_device_indexF_mtia_exchangeDevicec0V^8dQhR\R\/#devicereturnint)formats"T/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/mtia/__init__.py __annotate__r)sHHHHc*V^8dR#\R4hz)PyTorch was compiled without MTIA support RuntimeErrorrs&r_exchange_devicer) A:IFGGr_mtia_maybeExchangeDevicec0V^8dQhR\R\/#rr)rs"rrr3sHHsHsHrc*V^8dR#\R4hrrrs&r_maybe_exchange_devicer$3r rc\4R#N) _lazy_initrrinitr)9sLrc<\;'d\4'*#)z9Return whether PyTorch's MTIA state has been initialized.) _initialized_is_in_bad_forkr(rris_initializedr-=s  1 1 111rc \;_uu_4\4'dV!4uuRRR4#VPRR4'd+\P V\ P !44MlVPRR4'd+\PV\ P !44M*\PV\ P !434RRR4R# +'giR#;i)Nseed_allFseed) _initialization_lockr-get_lazy_seed_trackerqueue_seed_all traceback format_stack queue_seed _queued_callsappend)callablekwargss&,r _lazy_callr<Bs     :   zz*e,,"11(I\PP4#r&)torch_C_mtia_isInBadForkr(rrr,r,Ps 88 % % ''rcV^8dQhRR/#rrNr()rs"rrrTs;;D;rc \4'g\\R4'dR#\;_uu_4\4'd RRR4R#\ 4'd \ R4h\ 4'g \R4h\4'd(\4'd^RI H pVP4\PP!4R\n\$P'R\(P+444\$F wrV!4K \5\R4RsRRR4R# \dLi;i \,d2pR\/T4 RR P1T4 2p\3T4ThRp?ii;i \5\R4i;i +'giR#;i) is_initializingNzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia.dynamic_library` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!)cxx_resource_managerTc38"TFq'gK VxK R#5ir&r().0callss& r _lazy_init..sX0NuRWUU0Ns  z6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: )r-hasattr_tlsr1r,r _is_compiledAssertionErrorrrlibfb.py.cxx_resourcesrIinstallModuleNotFoundErrorrBrC _mtia_initrHr8extendr3 get_calls ExceptionstrjoinDeferredMtiaCallErrordelattrr+)rI queued_callorig_tracebackemsgs rr'r'Ts74):;;           I ~~ *  ;;799 G$,,.  $X0B0L0L0NXX -/<+ <M0= D+ , o  >'   !<PQTUVQWPXYCCE77>CZB[]04!; < D+ ,m   ssF0AF0*E AF0 F$E+F/F0 EF0EF0 F ',F F FF--F00 G c]tRt^tRtR#)r]r(N)__name__ __module__ __qualname____firstlineno____static_attributes__r(rrr]r]srr]c$V^8dQhR\/#r>r?)rs"rrrs$$d$rc>\PP4#)z*Return true if compiled with MTIA support.)rBrC _mtia_isBuiltr(rrrRrRs 88 ! ! ##rc$V^8dQhR\/#r>r?)rs"rrrsdrc@\4'gR#\4^8#)z'Return true if MTIA device is availableF)rR device_countr(rr is_availableros >> >A rc(V^8dQhR\RR/#rrrNr )rs"rrrs222$2rc\PPV4;_uu_4\PP 4uuRRR4# +'giR#;i)z?Waits for all jobs in all streams on a MTIA device to complete.N)rBmtiarrC_mtia_deviceSynchronizers&r synchronizerus6   6 " "xx//1 # " " "s A A" c$V^8dQhR\/#r>r)rs"rrrs++c+rc>\PP4#)z,Return the number of MTIA devices available.)rBrC_mtia_getDeviceCountr(rrrnrns 88 ( ( **rc$V^8dQhR\/#r>r)rs"rrrs&&&rc>\PP4#)z0Return the index of a currently selected device.)rBrC_mtia_getDevicer(rrcurrent_devicer|s 88 # # %%rc0V^8dQhR\R\/#rr Stream)rs"rrrs 7 76 7V 7rcZ\VRR7p\PPV4#)a;Return the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Toptional)r rBrC_mtia_getCurrentStream)r device_idxs& rcurrent_streamrs%#6D9J 88 * *: 66rc0V^8dQhR\R\/#rr~)rs"rrrs U U6 UV UrcV\PP\VRR74#)a%Return the default :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the default :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Tr)rBrC_mtia_getDefaultStreamr rs&rdefault_streamrs! 88 * *+)dictr[r)rs"rrrs++$sCx.+rc>\PP4#)z4Return a dictionary of MTIA memory allocator history)rBrC_mtia_memorySnapshotr(rrsnapshotrs 88 ( ( **rcbV^8dQhR\\\\\.R3,RR/#)robserverNr)rr)rs"rrrs/77S#s+T127 7rcD\PPV4R#)z9Attach an out-of-memory observer to MTIA memory allocatorN)rBrC_mtia_attachOutOfMemoryObserver)rs&rattach_out_of_memory_observerrs HH,,X6rc$V^8dQhR\/#)rincluding_emulationr?)rs"rrrs4rcR#)zLReturn a bool indicating if the current MTIA device supports dtype bfloat16.Tr()rs&ris_bf16_supportedrs rcRV^8dQhR\R\\\3,/#r)r tupler)rs"rrrs&XX&XE#s(OXrcV\PP\VRR74#)aReturn capability of a given device as a tuple of (major version, minor version). Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Tr)rBrC_mtia_getDeviceCapabilityr rs&rget_device_capabilityr" 88 - -.?QU.V WWrcV^8dQhRR/#rFr()rs"rrrs''T'rc>\PP4#)zEmpty the MTIA device cache.)rBrC_mtia_emptyCacher(rr empty_cachers 88 $ $ &&rc$V^8dQhR\/#)rstreamr)rs"rrrs , ,v ,rcPVfR#\PPV4R#)aSet the current stream. This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)rBrC_mtia_setCurrentStreamrs&r set_streamrs~ HH##F+rc(V^8dQhR\RR/#rqr )rs"rrrs ) )v )$ )rcl\V4pV^8d"\PPV4R#R#)zSet the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. N)r rBrC_mtia_setDevicers&r set_devicers,v &F {   (rcRV^8dQhR\R\\\3,/#r)r rr[r)rs"rrrs&XX&XDcNXrcV\PP\VRR74#)zReturn a dictionary of MTIA device properties Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Tr)rBrC_mtia_getDevicePropertiesr rs&rget_device_propertiesrrrcNa]tRtRtoRtV3RlRltRtV3RlRltRtVt R #) ri(zContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. c <V^8dQhRS[/#)rrr)r __classdict__s"rrdevice.__annotate__0ssrc8\VRR7VnRVnR#)TrNr)r idxprev_idx)selfrs&&r__init__device.__init__0s$Vd; rcb\PPVP4VnR#r&)rBrCr!rr)rs&r __enter__device.__enter__4s::488D rc,<V^8dQhRS[RS[RS[/#rtypevaluer5r)rrs"rrr8s"Srcb\PPVP4VnR#)F)rBrCr!rr)rrrr5s&&&&r__exit__device.__exit__8s8855dmmDr)rrN) rdrerfrg__doc__rrrrh__classdictcell__rs@rrr(s$ErrcZa]tRtRtoRtV3RlRltRtV3RlRltV3RltR t Vt R #) StreamContexti>aContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. c.<V^8dQhRS[R,/#)rrNr)rrs"rrStreamContext.__annotate__Ls   v}  rcRVnWn\RR4Vn\P P 4'gVPfRVn\P P 4'gRM\PPR4Vn \P P 4'g RVn R#\PPR4Vn R#)NTr) cur_streamrr rrBjit is_scriptingrsrsrc_prev_streamdst_prev_stream)rrs&&rrStreamContext.__init__Ls $T40yy%%''xx ..00Dejj6O6OPT6U  ..00D 6;jj6O6OPT6U rcVPpVeVPR8XdR#\PP R4VnVP P VP 8wdU\ VP 4;_uu_4\PP VP 4VnRRR4\PPV4R# +'giL1;iNr) rrrBrsrrrrr)rrs& rrStreamContext.__enter__[s[[  R $zz88>    & &**;*; ; ))**',zz'@'@ARAR'S$+ j)+*s /C"" C2 c,<V^8dQhRS[RS[RS[/#rr)rrs"rrrjs" 4 4S 4 4 4rc:VPpVeVPR8XdR#VPPVP8wd*\P P VP4\P P VP4R#r)rrrrrBrsrr)rrrr5rs&&&& rrStreamContext.__exit__jsj[[  R     & &**;*; ; JJ ! !$"6"6 7 d223rc4<V^8dQh/S[R,;R&#)rNrr)rrs"rrr>s r)rrrrrN) rdrerfrgrrrr__annotate_func__rhrrs@rrr>s+     * 4 4YrrcF\PPWV4R#)zset stream specified by the stream id, device index and device type Args: stream_id (int): stream id in stream pool device_index (int): device index in topo device_type (int): enum device type N)rBrC_mtia_setStream) stream_id device_index device_types&&&r_set_stream_by_idrxs HHYkBrc>V^8dQhR\R,R\/#)rrNr)rr)rs"rrrs!!6D=!]!rc\V4#)aWrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rrs&rrrs   rc0V^8dQhR\R\/#r)r r)rs"rrrs))&)f)rc\4\VRR7pVf \4p\V,pVP 4#)aCReturns the random number generator state of the specified MTIA device as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). .. warning:: This function eagerly initializes MTIA. Tr)r'r r|default_generators get_state)rrdefault_generators& r get_rng_staters<L FT 2C {*3/  & & ((rc:V^8dQhR\\,/#r>listr)rs"rrrs4<rcf\\44Uu.uFp\V4NK ppV#uupi)zRReturns a list of ByteTensor representing the random number states of all devices.)rangernr)iresultss rget_rng_state_allrs/).|~)>?)>A}Q)>G? N@s.c4V^8dQhR\R\RR/#)r new_staterrN)rr )rs"rrrs!VVrcHaa\4'gP\PP4;_uu_4SP \P R7oRRR4\ VRR7oSf \4oVV3Rlp\V4R# +'giL?;i)a$Sets the random number generator state of the specified MTIA device. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). ) memory_formatNTrcD<\S,pVPS4R#r&)r set_state)rrrs rcbset_rng_state..cbs.s3##I.r) r-rBrC_DisableFuncTorchclonecontiguous_formatr r|r<)rrrrsf& @r set_rng_statersp    XX ' ' ) )"e6M6MNI* FT 2C {/rN* )s !B B! c>V^8dQhR\\,RR/#)r new_statesrNr)rs"rrrs  $v, 4 rcD\V4Fwr\W!4K R#)zSets the random number generator state of all devices. Args: new_states (Iterable of torch.ByteTensor): The desired state for each device. N) enumerater)rrstates& rset_rng_state_allr s j)e*rc(V^8dQhR\RR/#rr0rNr)rs"rrrscdrcDa\S4oV3Rlp\VRR7R#)auSets the seed for generating random numbers for the current MTIA device. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. Args: seed (int): The desired seed. .. warning:: If you are working with a multi-GPU model, this function is insufficient to get determinism. To seed all GPUs, use :func:`manual_seed_all`. cX<\4p\V,pVPS4R#r&)r|r manual_seed)rrr0s rrmanual_seed..cbs$.s3%%d+rTr0Nrr<r0rsf rrrs t9D, rrc(V^8dQhR\RR/#r r)rs"rrrs""#"$"rcDa\S4oV3Rlp\VRR7R#)zSets the seed for generating random numbers on all MTIA devices. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. Args: seed (int): The desired seed. cx<\\44F!p\V,pVPS4K# R#r&)rrnrr)rrr0s rrmanual_seed_all..cbs-|~&A 21 5   ) )$ /'rTr/Nrrsf rmanual_seed_allrs t9D0 rD!rc$V^8dQhR\/#r>r)rs"rrrs%%c%rc"Rp\VRR7#)adSets the seed for generating random numbers to a random number for the current MTIA device. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. .. warning:: If you are working with a multi-GPU model, this function will only initialize the seed on one GPU. To initialize all GPUs, use :func:`seed_all`. cP\4p\V,pVP4#r&)r|rr0)rrs rrseed..cbs$.s3 %%''rTrr<rs rr0r0s( bt $$rc$V^8dQhR\/#r>r)rs"rrrs))#)rc"Rp\VRR7#)zSets the seed for generating random numbers to a random number on all MTIA devices. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. c^pRp\\44F=p\V,pV'gVP4pRpK,VP V4K? V#)rFT)rrnrr0r) random_seedseededrrs rrseed_all..cbsT |~&A 21 5 /446 !--k: 'rTrrrs rr/r/s  b4 ((rc$V^8dQhR\/#r>r)rs"rrrs22c2rc`\4\4p\V,P4#)zvReturns the current random seed of the current MTIA device. .. warning:: This function eagerly initializes MTIA. )r'r|r initial_seed)rs rr'r's% L  C c " / / 11r)*r)ror-rurnr|rr memory_statsmax_memory_allocatedmemory_allocatedreset_peak_memory_statsrrrrrrrrrrrr rrrr0r/r'r MTIAGraphgraphgraph_pool_handlec V^8dQh/^\9d+\\PPR3,;R&^\9d:\ \\ .R3,\ \,3,,;R&#)r.rNr8)__conditional_annotations__rrBrC Generatorrrr[)rs"rrrsg.87E%((,,c127/6t (2t8 d3i '(7rr(r&)allpythonr)T)rs)Kr1r threadingr5collections.abcrtypingrrBrtorch._environmentrr torch._utilsr torch.typesr _utilsr Eventrrr+r8localrQLockr1r3rPrCr rr!r$r)r-r<r,r'rZr]rRrorurnr|rrrrrrrrrrrrrrrrrrr rrr0r/r'memory mtia_graph__all__r)r1s@rrBs$ 1)%   687  ~~'%' 588+,,xx44H  588011"XX??H 2 K(;| I $ 2 + & 7 UE&+ 7 X' , )X,7474tC!)$ 2 *""%")*2$  $ $ $  $   $   $ $ $ $ $ $ $ $ $ $  !$ "$#$ $%$ &'$ ()$ * +$ , -$ ./$ 01$ 23$ 45$ 67$ 89$ : ;$ <=$ >?$ @A$ BC$ D E$ FG$ r