+ ji/^RIHt^RIHt^RIt^RIHtHt.ROtRRlt RRlt R R lt RR R llt RR Rllt RRRlltRRRlltRRRlltRRRlltRRRlltRRRlltRRRlltR#) ) OrderedDict)AnyN) _device_t_get_device_indexcV^8dQhRR/#returnN)formats"Y/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/accelerator/memory.py __annotate__rs ' 'T 'c\PP4'gR#\PP4R#)a Release all unoccupied cached memory currently held by the caching allocator so that those can be used in other application. .. note:: This function is a no-op if the memory allocator for the current :ref:`accelerator ` has not been initialized. N)torch_C#_accelerator_isAllocatorInitialized_accelerator_emptyCacher rr empty_cachers* 88 7 7 9 9 HH$$&rcV^8dQhRR/#rr )r s"r rr#s++$+rcB\PP4R#)aRelease all unoccupied cached host (pinned) memory currently held by the host caching allocator so that it can be used by other applications. .. note:: This function is a no-op if the memory allocator for the current :ref:`accelerator ` has not been initialized. N)rr_accelerator_emptyHostCacher rr empty_host_cacher#s HH((*rcxV^8dQhR\\\\3,,R\R\RR/#)r resultprefixvaluer N)listtuplestrr)r s"r rr-s5''4c3h0'#'c'd'rc\V\4'd9VP4F"wr4V'dV RV 2MTp\WV4K$ R#VP W34R#).N) isinstancedictitems_flatten_statsappend)rrrkey nested_value nested_prefixs&&& r r&r&-sP%!& C17vhau-SM 6, ?"/  vo&rcRV^8dQhR\R\\\3,/#r device_indexr )rrr r)r s"r rr6s'F#F#yF#{387LF#rc \PP4'g \4#\ VRR7p\PP V4p.p\ VRV4VP4\V4#)ar Return a dictionary of accelerator device memory allocator statistics for a given device index. The return value of this function is a dictionary of statistics, each of which is a non-negative integer. Core statistics: - ``"allocated.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: number of allocation requests received by the memory allocator. - ``"allocated_bytes.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: amount of allocated memory. - ``"segment.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: number of reserved segments from device memory allocation. - ``"reserved_bytes.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: amount of reserved memory. - ``"active.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: number of active memory blocks. - ``"active_bytes.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: amount of active memory. - ``"inactive_split.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: number of inactive, non-releasable memory blocks. - ``"inactive_split_bytes.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: amount of inactive, non-releasable memory. For these core statistics, values are broken down as follows. Pool type: - ``all``: combined statistics across all memory pools. - ``large_pool``: statistics for the large allocation pool (as of June 2025, for size >= 1MB allocations). - ``small_pool``: statistics for the small allocation pool (as of June 2025, for size < 1MB allocations). Metric type: - ``current``: current value of this metric. - ``peak``: maximum value of this metric. - ``allocated``: historical total increase in this metric. - ``freed``: historical total decrease in this metric. In addition to the core statistics, we also provide some simple event counters: - ``"num_alloc_retries"``: number of failed device memory allocation calls that result in a cache flush and retry. - ``"num_ooms"``: number of out-of-memory errors thrown. - ``"num_sync_all_streams"``: number of ``synchronize_and_free_events`` calls. - ``"num_device_alloc"``: number of device memory allocation calls. - ``"num_device_free"``: number of device memory free calls. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. Returns: OrderedDict[str, Any]: an ordered dictionary mapping statistic names to their values. Toptional)rrrrr_accelerator_getDeviceStatsr&sort)r-stats flat_statss" r memory_statsr66sfz 88 7 7 9 9}$\DAL HH 0 0 >EJ:r5)OO z ""rc0V^8dQhR\R\/#r,rint)r s"r rrs L L9 L3 Lrc8\V4PR^4#)a)Return the current :ref:`accelerator` device memory occupied by tensors in bytes for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. Returns: int: the current memory occupied by live tensors (in bytes) within the current process. zallocated_bytes.all.currentr6getr-s"r memory_allocatedr>s  % ) )*G KKrc0V^8dQhR\R\/#r,r8)r s"r rrsIIyIsIrc8\V4PR^4#)aReturn the current :ref:`accelerator` maximum device memory occupied by tensors in bytes for a given device index. By default, this returns the peak allocated memory since the beginning of this program. :func:`~torch.accelerator.reset_peak_memory_stats` can be used to reset the starting point in tracking this metric. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. Returns: int: the peak memory occupied by live tensors (in bytes) within the current process. zallocated_bytes.all.peakr;r=s"r max_memory_allocatedrAs"  % ) )*Da HHrc0V^8dQhR\R\/#r,r8)r s"r rrs K K) K# Krc8\V4PR^4#)a1Return the current :ref:`accelerator` device memory managed by the caching allocator in bytes for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. Returns: int: the current memory reserved by PyTorch (in bytes) within the current process. zreserved_bytes.all.currentr;r=s"r memory_reservedrDs  % ) )*F JJrc0V^8dQhR\R\/#r,r8)r s"r rrsHHiHcHrc8\V4PR^4#)aReturn the current :ref:`accelerator` maximum device memory managed by the caching allocator in bytes for a given device index. By default, this returns the peak cached memory since the beginning of this program. :func:`~torch.accelerator.reset_peak_memory_stats` can be used to reset the starting point in tracking this metric. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. Returns: int: the peak memory reserved by PyTorch (in bytes) within the current process. zreserved_bytes.all.peakr;r=s"r max_memory_reservedrGs"  % ) )*CQ GGrc(V^8dQhR\RR/#r r-r Nr)r s"r rrsEEEErc\PP4'gR#\VRR7p\PP V4#)adReset the "accumulated" (historical) stats tracked by the current :ref:`accelerator` memory allocator for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. .. note:: This function is a no-op if the memory allocator for the current :ref:`accelerator ` has not been initialized. NTr/)rrrr"_accelerator_resetAccumulatedStatsr=s"r reset_accumulated_memory_statsrMs; 88 7 7 9 9$\DAL 88 6 6| DDrc(V^8dQhR\RR/#rIrJ)r s"r rrs>>)>$>rc\PP4'gR#\VRR7p\PP V4#)aPReset the "peak" stats tracked by the current :ref:`accelerator` memory allocator for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. .. note:: This function is a no-op if the memory allocator for the current :ref:`accelerator ` has not been initialized. NTr/)rrrr_accelerator_resetPeakStatsr=s"r reset_peak_memory_statsrQs; 88 7 7 9 9$\DAL 88 / / ==rcRV^8dQhR\R\\\3,/#r,)rrr9)r s"r rrs"==)=%S/=rcZ\VRR7p\PPV4#)aReturn the current device memory information for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. Returns: tuple[int, int]: a tuple of two integers (free_memory, total_memory) in bytes. The first value is the free memory on the device (available across all processes and applications), The second value is the device's total hardware memory capacity. Tr/)rrr_accelerator_getMemoryInfor=s"r get_memory_inforUs%%\DAL 88 . .| <` memory allocator state. Requires :func:`_record_memory_history` on the appropriate device module (e.g., :func:`torch.cuda.memory._record_memory_history`) to have been called. Args: device: the device to snapshot. If not given, uses the current device. augment_with_fx_traces (bool, optional): if True, augment stack traces with FX graph information. Default: ``False``. Returns: dict: a dictionary containing memory allocator state information. xpu)rW)r acceleratorcurrent_acceleratortyperZmemory _snapshotcuda)devicerWaccs&& r r_r_st    / / 1C 388u,yy)) *   ::   & & ' r) rrrUrArGr>rDr6rMrQ)N)NF) collectionsrtypingrr_utilsrr__all__rrr&r6r>rArDrGrMrQrUr_r rr rgs`# 0  '+'F#R L I( K H(E&>&=&r