+ j^RIt^RIt^RIHtHt^RIHtHt^RI H t ^RI H t H t ^RIHtHt] !R4t!RR 4t!R R ]4t] RR R ll4t] RRRll4tRRRlltRRltR#)N)CallableIterable)EmptyQueue)overload) TypeVarTupleUnpack) DeviceContextget_device_context_TscVa]tRt^toV3RlRltV3RlRltV3RlRltRtVtR#) ClosureHandlerc<V^8dQhRR/#returnN)format __classdict__s"T/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/_lazy/closure.py __annotate__ClosureHandler.__annotate__s  $ cR#Nr)selfs&r__init__ClosureHandler.__init__s rc8<V^8dQhRS[.S[3,RR/#rclosurerNrobject)rrs"rrrs$8BJ/Drc V!4R#)z>Run closure function Args: closure: callable function to run Nr)rr!s&&rrunClosureHandler.runs  rcH<V^8dQhRS[S[.S[3,,RR/#)rclosuresrN)rrr#)rrs"rrrs)(2v:*>!?Drc:VFpVPV4K R#r)r%)rr(r!s&& r__call__ClosureHandler.__call__sG HHW  rrN) __name__ __module__ __qualname____firstlineno__rr%r*__static_attributes____classdictcell__)rs@rrrs#  rrcjaa]tRt^toRtR V3RlV3RllltV3RlRltV3RlRltRtVt V;t #) AsyncClosureHandleraMHandler for Asynchronous Step Closures Args: max_queue_size: The maximum length of the closure queue after which the training loop will block until closures are evaluated. By default, a reasonable limit of a maximum of 100 on the queue. This value can be set using the `XLA_MAX_ASYNC_QUEUE` environment variable. c$<V^8dQhRS[RR/#)rmax_queue_sizerN)int)rrs"rr AsyncClosureHandler.__annotate__)sAAsATArc&<\SV`4\\\P P RV444Vn\4Vn\P!4Vn \P!4Vn RVnR#)LTC_MAX_ASYNC_QUEUEN)superrrr6osenvironget_closure_queue_closure_exception threadingLock _closure_lockEvent_closure_event_loop_finished_closure_event_loop)rr5 __class__s&&rrAsyncClosureHandler.__init__)se ;@  4nE F< 5:G&^^-,5OO,=)<@ rc<V^8dQhRR/#rr)rrs"rrr73s--$-rc aSPfBRV3Rllp\P!VR7SnSPP4R#R#)z'Start closure event loop if not startedNcV^8dQhRR/#rr)rs"rr:AsyncClosureHandler.start_event_loop..__annotate__7s   rc<SPPR^R7pV!4SPP4KB \d~SP;_uu_4SPP 4'd'SP P4RRR4R#RRR4K +'giK;i\d'pSPPT4Rp?R#Rp?ii;i)T)blocktimeoutN) r>r= task_done EmptyQueuerBemptyrDset Exceptionr?put)r!ers r event_loop8AsyncClosureHandler.start_event_loop..event_loop7s "&"5"5"9"9a"9"P ++557%'!///#2288:: $ A A E E G &0/:0///%//33A6sA>AC;#rTrEis_aliver?r= RuntimeErrorrPr[)rr!rUs&& rr%AsyncClosureHandler.runJs        # #G4 # 8((0//88::,//33%3@A&\ ",/3D,))+,  s*A B<"(B"B96B<8B99B<< C )rErDr?rBr>)d) r,r-r.r/__doc__rr[r%r0r1 __classcell__)rFrs@@rr3r3s/AA--.,,,rr3chV^8dQhR\.\3,R\R,R\RR/#)rr!args run_asyncrNrrr#tuplebool)rs"rrr\s= b&j ! ) rcR#rrr!rfrgs&&&radd_step_closurerm[ rcV^8dQhR\\\,.\3,R\\\,,R\ RR/#)rr!rfrgrN)rr r r#rirj)rs"rrrbsI vc{mV+ , s  rcR#rrrls&&&rrmrmarnrctV^8dQhR\R\3,R\\R3,R\RR/#)rr!.rfrgrNrh)rs"rrrgsB!5!5 c6k "!5  !5!5 !5rca\4pV'dRMRp\W4R4pVf.p\W4V4VPV3V3Rll4R#)aAdds a closure to the list of the ones to be run at the end of the step. Many times during model training there is the need to print/report (print to console, post to tensorboard, etc...) information which require the content of intermediary tensors to be inspected. Inspecting different tensors content in different points of the model code requires many executions and typically causes performance issues. Adding a step closure will ensure that it will be run after the barrier, when all the live tensors will be already materialized to device data. Live tensors which will include the ones captured by the closure arguments. So using `add_step_closure()` will ensure a single execution will be performed, even when multiple closures are queued, requiring multiple tensors to be inspected. Step closures will be run sequentially in the order they have been queued. Note that even though using this API the execution will be optimized, it is advised to throttle the printing/reporting events once every N steps. Args: closure (callable): The function to be called. args (tuple): The arguments to be passed to the closure. run_async: If True, run the closure asynchronously. async_step_closures step_closuresNc<S!V!#rr)ar!s&r"add_step_closure..s  r)r getattrsetattrappend)r!rfrgdevctx closures_typertsf&& rrmrmgsN2 !F-6)OM7>t8M }5$34rc$V^8dQhR\/#)rr)r )rs"rrrs=rc\4p\VRR4pVe1.Vn\VRR4pVf\4pW nV!V4\VRR4pVe1.Vn\VRR4pVf\ 4pW@nV!V4V#)rsNasync_closure_handlerrtclosure_handler)r ryrsr3rrtrr)r|rsrrtrs rrun_step_closuresrs  !F!&*?F&%'" '0G N ($7$9 !+@ (12FOT:M !!&*;TB  ",.O%4 " & Mr)rF)F)r;r@collections.abcrrqueuerrPrtypingrtyping_extensionsrr torch._lazy.device_contextr r r rr3rmrrrrrsp .,2H5"9,.9,x      !5Hr