+ jw8PRt^RIHt^RIt^RIHt^RIHt^RIH t ^RI H t ^RI H t Ht] 'd ^RIHt^R IHt/t]]!RR 7!R R 444t!R R4t]!R4tRRRlltRRltRRRllt]P4!4tRRltRRR/RlltR#)z Contains the logic for automatic additional output capture with our forward decorators. This mostly describe the hooks used and the logic to make capture thread/context safe. ) annotationsN) ContextVar) dataclasswraps) TYPE_CHECKING)is_torchdynamo_compilingrequires)nnPreTrainedModel)backendsc^]tRt^'t$RtR]R&^tR]R&RtR]R&RtR]R &R t R ]R &R t R#)OutputRecorderar Configuration for recording outputs from a model via hooks. Attributes: target_class (Type): The class (e.g., nn.Module) to which the hook will be attached. index (Optional[int]): If the output is a tuple/list, optionally record only at a specific index. layer_name (Optional[str]): Name of the submodule to target (if needed), e.g., "transformer.layer.3.attn". class_name (Optional[str]): Name of the class to which the hook will be attached. Could be the suffix of class name in some cases. capture_initial_hidden_state (bool): Whether to prepend the first module's input as the initial hidden state. ztype[nn.Module] target_classintindexN str | None layer_name class_nameTboolcapture_initial_hidden_state) __name__ __module__ __qualname____firstlineno____doc____annotations__rrrr__static_attributes__rd/home/luca/screen-checking/.venv/lib/python3.14/site-packages/transformers/utils/output_capturing.pyrr's7 "!E3N!J !!J !)- $-r rc2]tRt^>>?? "##'') )r c v\4'dWnRVnR#VPP V4#)TN)rr'r(r&set)r)values&&r!r2CompileableContextVar.setPs1 # % %#O!DN##''. .r c VP'gVfRVnRVnR#VPPV4R#)NF)r(r'r&reset)r)tokens&&r!r6CompileableContextVar.resetXs1 >>>U]"DO"DN    " "5 )r )r(r&r'N) rrrrrr+r/r2r6rrr r!r#r#<s */*r r#output_collectorTc ,V^8dQhRRRRRRRRR R /#) module nn.ModulekeystrrrrrreturnNoner)formats"r! __annotate__rCds4&8&8 &8&8(+&8KO&8 &8r c>aaaVVV3RlpVPV4R#)zaInstall the forward hook needed to capture the output described by `key` and `index` in `module`.cL<\P4pVeSVP49dR#VPR4pS'dBSR8Xd;\VS,4^8Xd$Vf VS,P V^,4SR8Xd7Ve3\VS,4pWT9dVS,P R4R#\ V\ 4'gVS,P V4R#VS,e"VS,P VS,4R#R#)N_hidden_states_layers hidden_states)_active_collectorr/keyslenappend isinstancetuple) r<argsoutputcollected_outputshidden_states_layerscurrent_layer_idxrrr>s &&& r!output_capturing_hook;install_output_capuring_hook..output_capturing_hookis-113  $3D3I3I3K(K  1445LM )&%c*+q0$, c " ) )$q' 2 / !&:&F #$5c$: ;  <!#&--d3&%(( c " ) )& 1 E] & c " ) )&- 8'r N)register_forward_hook)r<r>rrrSs&fff r!install_output_capuring_hookrVds 9B   !67r c(V^8dQhRRRRRRRR/#) r; parent_moduler= module_namer? capture_tasksz list[tuple[str, OutputRecorder]]r@rAr)rBs"r!rCrCs2'n'n'n+.'n?_'n 'nr c~^RIHpVP4F:wrE\WS4'g\ WQ RV 2V4K)\ WQ RV 2R7K< VFwrgVP RJ;'d\WP 4pVPRJ;'dVPVP4p V'g V 'gKsVPeAVPPR4p RV ,R,p WR,9p V 'gK\WVPVP4K R#)a Recursively install all output capturing hooks on all submodules of `parent_module`. Note that we need to use this recursive approach instead of simply iterating over all modules, because we want to respect the `capture_tasks` of all individual submodels (`PreTrainedModel` instances) in the graph. That is, once we reach a submodel in the graph, its children should use this submodel's `capture_tasks`, but other parts of the graph should not. r .)prefixN)modeling_utilsr named_childrenrLrecursively_install_hooks"install_all_output_capturing_hooksrrendswithrstriprVrr) rXrYrZr r*r<r>specsmatch_target_classmatch_class_nametarget_layer_namematchess &&& r!r`r`s1&446 &22 %f Qtf.E} U /v Qtf>U V 7$ "//t;mm =ZlZl@m ++47bbK>o>z>]a>r c\P\VP44;'g/p.pVP 4FwrE\ V\ 4'gV.pVFwp\ V\4'gMRV9d^M^p\ V\4'gRMTp\ V\4'gTMRp \WVR7pVPWF34Ky K VeTMRp\WV4\VRR4R#)z Install the output recording hooks on all the modules in `model`. This will take care of correctly dispatching the `_can_record_outputs` property of each individual submodels in case of composite models. rGN)rrr!_output_capturing_hooks_installedT) _CAN_RECORD_REGISTRYr/r? __class__itemsrLlistrrKr`setattr) rjr] capture_flagsrZr> layer_specsrdrrrs && r!raras ),,S-ABHHbMM)//1+t,,&-K Ee^44,3)3E3)?)?TU ,6uc,B,Bu &LZde  # . !2)VrFe]; E6=r c V^8dQhRRRR/#)r;rjr r@rAr)rBs"r!rCrCs222T2r c\VRR4'dR#\;_uu_4\VRR4'd RRR4R#\V4RRR4R# +'giR#;i)z Check if the model already has output capturing hooks installed, and install them if it is not already the case. Note that this is thread-safe, in case 2 (or more) threads want to install them concurrently. rmFN)getattr_hook_installation_lockra)rjs&r!maybe_install_capturing_hooksrysSu95AA  5=u E E  ! +51 ! sA A A) tie_last_hidden_statesc,aV3RlpVe V!V4#V#)a Decorator to intercept specific layer outputs through hooks. The hooks are installed only once and lazily, the first time output capture is requested with the `output_xxx` kwargs/config. The implementation is fully context/thread safe, except when using `torch.compile`, as dynamo is unable to trace through `ContextVar` methods. Args: tie_last_hidden_states (`bool`, *optional*, defaults to `True`): Whether to overwrite `out.hidden_states[-1]` with the `out.last_hidden_state`. This is true for all language models and should be toggled off only if `out.hidden_states[-1]` has to be the hidden state before last layer norm, which is needed for some vision models (e.g. CLIP, SigLIP). c4<a\S4VV3Rl4pV#)c <VPR\VPRR44p\P \ VP 44;'g/pVUu/uF4pRV 2VP RV 2\VPRV 2R44bK6 ppRV9d+VP R\VPRR44VR&RV9d+VP R\VPRR44VR&VP4UUu/uF"wrWV'gKVPRR 4.bK$ pppR V9d>\VR ,\\\34'd\VR ,4VR &\V4^8d \V4\PV4p S !V.VO5/VBp \P!V 4VPR R 4p VFp V R 8XdS'dV eW,R,fM\#V R4'd0W,R RW&W,P%V P&4M@\#V R4'd/W,R RW&W,P%V P(4\W,4W&K VRJdV P+4p V #uupiuuppi \P!T 4i;i) return_dictToutput_Fcross_attentionsoutput_attentionsoutput_cross_attentionsmask_decoder_attentionsoutput_mask_decoder_attentionsrloutput_hidden_statesrFNrGvision_hidden_stateslast_hidden_state)poprwconfigrnr/r?rorpreplacerLrqrMr2rJryrHr6hasattrrKrrto_tuple)r)rNkwargsr~capturable_flagskrecordable_keysvrP output_tokenoutputsrQr>funcrzs&*, r!wrapper4capture_outputs..wrapped_fn..wrappers!**]GDKKX\4]^K 477DNN8KLRRPR *)A! vzzGA3-PWXYWZm]b9cdd)  "%55=CZZ'>QSX)Y> 9:),<QSX)YE @AKZJ_J_Ja gJa$!ef!=9b!92!=Ja  g&8Z 67$s9K>>>AQgAh=i!"9:$%)-d3,001BCL 6t5d5f5"'' 5#4#8#89PRV#W (/)1,8=N=STV=W=_ *@AA1B1G1L).).55g6R6RS *=>>1B1G1L).).55g6O6OP$%6%;< ) e#!**,Nq!h$"'' 5s:J= K!K0 KKr)rrrzsf r! wrapped_fn#capture_outputs..wrapped_fns! t>  > @r r)rrzrs&d r!capture_outputsrs#BH $ r )torch)Tr.)r __future__r threading contextvarsr dataclassesr functoolsrtypingr import_utilsrr rr r^r rnrr#rHrVr`raLockrxryrrr r!rs #"! <0  :.. .&!*!*J**<=&8R'nT>:$..*2&TTr