+ jR Rt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RI t ^RI t ^RI t ^RI t ^RI t ^RIHt^RIHt^RIHt^RIHt^RIHt^RIHt^RIHt^RIt^R IHt^R IHt]P@!]!4t"]PFPI4t%R R lt&ERR Rllt'RRlt(RRlt)RRlt*RRlt+0ERmt,],P[R04t.]P^PaRR4Pc4t2Rt3Rt4Rt5Rt6Rt7Rt8R t9R!t:R"t;R"tR%t?R&t@R'tAR(tB]]BR)R*l44tC]]BR+R,l44tD]]BERR-R.ll44tE]]BERR/R0ll44tF]]BR1R2l44tG]]BR3R4l44tH]]BR5R6l44tI]R7R8l4tJ]]BR9R:l44tK]R;R<l4tL]R=R>l4tM]]BERR?R@ll44tN]]BERRARBll44tO]]BERRCRDll44tP]]BRERFl44tQ]]BERRGRHll44tR]]BERRIRJll44tS]]BRKRLl44tT]]BERRMRNll44tU]]BERRORPll44tV]]BRQRRl44tW]RSRTl4tX]RURVl4tY]]BRWRXl44tZ]RYRZl4t[]]BR[R\l44t\]]BR]R^l44t]]]BR_R`l44t^]]B]?]@3RaRbll44t_]]BRcRdl44t`]]BReRfl44ta]]BRgRhl44tb]]B]33RiRjll44tc]]B]>3RkRlll44td]]BRmRnl44te]]B]93RoRpll44tf]]BRqRrl44tg]]BRsRtl44th]]BRuRvl44ti]RwRxl4tj]]BRyRzl44tk]]BR{R|l44tl]]BR}R~l44tm]]BRRl44tn]]BRRl44to]]B]53RRll44tp]]BRRl44tq]]BRRl44tr]]BRRl44ts]]BRRl44tt]]BRRl44tu]]BRRl44tv]]BRRl44tw]]BRRl44tx]]BRRl44ty]]BRRl44tz]]BRRl44t{]]BRRl44t|]]BRRl44t}]]BRRl44t~]]BR44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]ERRRll4t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BERRRll44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]B]:3RRll44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]B]43RRll44t]]BERRRll44t]]BERRRll44t]]BRRl44t]RRl4t]]BRRl44t]ERRRll4t]ERRRll4t]]BR44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]BRRl44t]]B]73RRll44t]]BRRl44t]]B]63RRll44t]]BRERl44t]]BERERl44t]]B]=3ERERll44t]]BER44t]]BERERl44t]]BER44t]]BER 44t]]B]<3ER ER ll44t]]BER ER l44t]]BERERl44t]]BERERl44t]]BERERl44t]]BERERl44t]]BERERl44t]]BERERl44t]]BERERl44t]]BERERl44t]]BERERl44t]]BER ER!l44t]]BER"ER#l44t]]BER$ER%l44t]]BER&ER'l44t]]BER(ER)l44t]]BER*ER+l44t]]BER,ER-l44t]]BER.ER/l44t]]BER0ER1l44t]]B];3ER2ER3ll44t]]BER4ER5l44t]]BER6ER7l44t]]BER8ER9l44t]]BER:ER;l44t]]BER<ER=l44t]]BER>ER?l44t]]BER@ERAl44t]]BERBERCl44t]]BERDEREl44t]]BERFERGl44t]]BERHERIl44t]]BERERJERKll44t]]BERLERMl44t]]BERNEROl44t]]BERPERQl44t]]B]A3ERRERSll44t]]BERTERUl44tERVERWltERXERYltERZER[lt]ER\ER]l4tER^ER_ltER`ERaltERbERcltERdEReltERftERgERhltERiERjltERERkERlllt]3ERmERnllt]]BERoERpl44t]ERqERrl4t]BERsERtl4t]BERuERvl4tERwERxltERytERztER{tER|tER}tER~tERtERtERtERtERtERtERtERtERtERtERtEREtEREtEREtEREtEREtEREtEREtEREtEREtEREt EREt EREt EREt EREt EREtEREtEREtEREtEREtEREtEREtEREtEREtEREtEREtEREtEREtEREtEREtEREtEREt]!.ER]]33NER]]33NER]`]33NER]]33NER]]33NER]]33NER]E]33NER]vE]33NER]]33NER]]33NER]E]33NER]E]33NER]E]33NER]|E]33NER]]33NER]rE]33NER]E]33NER]]33NER]qE]33NER]E]33NER]E]33NER]E]33NER]]33NER]]33NER]E]33NER]E]33NER]E]33NER]E] 33NER]E] 33NER]]33NER]C]33NER]h]33NER]]33NER]E] 33NER]E]33NER]cE]33NER]E]33NER]E]33NER]E]33NER]E]33NER]a]33NER]E]33NER]wE] 33NER]xE]33NER]yE]33NER]zE]33NER]E]33N4EtEREt !ERERE]!4Et"E]#E]$,Et%E]&E]%E]&E]$E]'E]$,3,3,Et(!ERER]4Et)!ERERE]*4Et+ERERERllEt,!ERER]4Et-]ERERl4Et.!ERER4Et/ERER/ERlEt0ERERERERERERERERERERERER/Et1ERERlEt2]ER4Et3EREt4]ERERERll4Et5ERERlEt6R#(zD Import utilities: Utilities related to imports and our lazy inits. N) OrderedDictCallable)Enum) lru_cache)chain) ModuleType)Anyversion)loggingcFV^8dQhR\R\\,/#)pkg_namereturn)strlist)formats"`/home/luca/screen-checking/.venv/lib/python3.14/site-packages/transformers/utils/import_utils.py __annotate__r2s++C+DI+caVPRR4p\PV.4o.V3RlW34OSOVNVNp\\P V44#)a~Distribution names to try for the import name `pkg_name`, most likely first. The distribution name may differ from the import name (`PIL` is imported, but `pillow` is distributed), and `packages_distributions()` maps one to the other -- but only for wheels shipping a `top_level.txt` on Python < 3.12, which `torch` >= 2.14 does not. So keep the import name itself as a candidate. _-c38<"TFqS9gK VxK R#5iN).0name distributionss& r 0_candidate_distribution_names..=s T:4m>S$$:s )replacePACKAGE_DISTRIBUTION_MAPPINGgetrdictfromkeys)rnormalized_pkg_name candidatesrs& @r_candidate_distribution_namesr)2st#**34044XrBM T/: T    J  j) **rc^V^8dQhR\R\R\\\3,/#)rrreturn_versionr)rbooltuple)rs"rrrEs-$$C$$%PTVYPYJZ$rc\PPV4pVRJpRpV'dV'd\V4F#p\PP V4pM= \P!V4p\VRR4pVR8Xd\VRR4fRp\PRV RV 24V'dW43#VR3# \PP dKi;i)z@Check if `pkg_name` exist, and optionally try to get its versionNN/A __version____file__Fz Detected z version: ) importlibutil find_specr)metadatar PackageNotFoundError import_modulegetattrloggerdebug)rr+specpackage_existspackage_versiondistribution_namepackages&& r_is_package_availabler@Es >> # #H -D%NO.!>x!H  "+"4"4"<"<=N"O"I --h7G%g}eDO%'GGZ,N,V!& y *_4EFG..t##!%%::  sC  C0/C0c<V^8dQhR\R\R\/#)rmessage raise_errorrrr,)rs"rrrbs!Tdrc,V'd \V4hR#)uYReport an unmet dependency precondition: raise `ImportError(message)` when `raise_error`, else return `False`. Lets an `is_*_available` / `is_*_loadable` check read as a flat `if unmet: return maybe_import_error(msg, ...)` — a bool for callers probing availability, the specific error for callers that want to fail loudly (`raise_error=True`).F) ImportError)rBrCs&$rmaybe_import_errorrGbs '"" rcnV^8dQhR\R,R\R\\,R,/#)rmoduleN chained_pathr)rrr)rs"rrrls2J$5SXXbMbeiMircV'gR#\WPR4R,R4;p'dV#TpVPR4Fp\W#R4pV'dKR# V#)a Check if a given `module` has an internal import path as defined by the `chained_path`. This can either be the full path (not exposed in `__init__`) OR the last part of the chain (exposed in `__init__`). This is an important helper function for kernels based modules to apply the import from the module itself, i.e. stay compatible with original libraries in certain cases. Example: Module: `mamba_ssm` Chained Path: `ops.triton.selective_state_update.selective_state_update` Resulting import attempt at: - `mamba_ssm.selective_state_update` - `mamba_ssm.ops.triton.selective_state_update.selective_state_update` N.)r8split)rIrJ final_modulepaths&& rresolve_internal_importrQlsh v'9'9#'>r'BDII|IL""3'|48 |( rc0V^8dQhR\R\/#r env_variablerrD)rs"rrrsWWsWtWrcR\P!VR4P4R9#)zMDetect whether `env_variable` has been set to a true value in the environmentfalse)true1yyesonosgetenvlowerrTs&ris_env_variable_trueras" 99\7 + 1 1 37V VVrc0V^8dQhR\R\/#rSrD)rs"rrrsWWWWrcR\P!VR4P4R9#)zNDetect whether `env_variable` has been set to a false value in the environmentrW)rV0nnooffr\r`s&ris_env_variable_falserhs" 99\6 * 0 0 26V VVrrXAUTO USE_TORCH_XLAz1.1.0z0.46.1z1.2.6z1.12.0z0.10.02.2.0z0.2.1z0.0.4z0.15.0z0.5.0z1.0.0z0.16.0z0.17.0z1.11.5c \VRR4V#)uMark `fn`'s result as a trace-time constant, so `torch.compile` inlines it instead of tracing it. This is `torch._dynamo.assume_constant_result`, spelled without importing torch: this module is what decides whether torch is installed, so it must never import it (and doing so would pull torch into `import transformers`, which is deliberately torch-free). Apply it *under* `@lru_cache`, not above: dynamo steps past the cache wrapper and only reads the marker on the function it actually traces. Only for helpers whose answer is fixed for the lifetime of the process — an install probe, a hardware capability, an environment variable. Never for a runtime query such as `is_cuda_stream_capturing`, where inlining a value that legitimately changes would silently bake a transient into the graph. _dynamo_marked_constantT)setattr)fns&r_make_compile_constantrps B)40 Irc$V^8dQhR\/#rrr,)rs"rrrsDrc~\RRR7wr\P!V4pV'd4V\P!R48d\P RV 24T;'d.\P!V4\P!R48# \ PP dR#i;i)torchTr+2.5.0z?Disabling PyTorch because PyTorch >= 2.5 is required but found F)r@r parser9 warning_once packagingInvalidVersion) is_available torch_versionparsed_versions ris_torch_availablers&;GTX&Y#  }5 NW]]7-CC   "aboap q rVV m < g@V VV    + +sA(B+-BB<;B<c$V^8dQhR\/#rrr)rs"rrrs3rc$\RRR7wrV#)ruTrvr@)rr}s rget_torch_versionrs-WTJA rc<V^8dQhR\R\R\/#rlibrary_version accept_devrrD)rs"rrrs' T Ts T TQU TrcF\4'gR#V'dT\P!\P!\44P4\P!V48#\P!\44\P!V48#) Accepts a library version and returns True if the current version of the library is greater than or equal to the given version. If `accept_dev` is True, it will also accept development versions (e.g. 2.7.0.dev20250320 matches 2.7.0). Frr rxr base_versionrrs&&ris_torch_greater_or_equalrh   }}W]]+<+>?LLMQXQ^Q^_nQooo}}.01W]]?5SSSrc<V^8dQhR\R\R\/#rrD)rs"rrrs& T TC TT Td TrcF\4'gR#V'dT\P!\P!\44P4\P!V48*#\P!\44\P!V48*#)z Accepts a library version and returns True if the current version of the library is less than or equal to the given version. If `accept_dev` is True, it will also accept development versions (e.g. 2.7.0.dev20250320 matches 2.7.0). Frrs&&ris_torch_less_or_equalrrrc$V^8dQhR\/#rrrs)rs"rrrsrcF\4'd^RIp\VR4#R#)N acceleratorF)rruhasattrrus ris_torch_accelerator_availablers um,, rc$V^8dQhR\/#rrrs)rs"rrrsrcb\4'd^RIpVPP4#R#rNF)rrucudar|rs ris_torch_cuda_availablers&zz&&(( rc$V^8dQhR\/#rrrs)rs"rrr s,,,rcb\4'gR#^RIpVPP4#FN)rru distributedr|rs ris_torch_distributed_availablers(       ) ) ++rc$V^8dQhR\/#rrrs)rs"rrr$rc^\4'd^RIp\VR4PRJ#R#rNr F)rrur8rrs ris_cuda_platformrs)ui(--T99 rcFV^8dQhR\\\3,/#rr)r-int)rs"rrrs"?"?%S/"?rc\P!R\^R7^RIpVP R4pTP4pTPTPT44TPR,TPR,^ ,3# \ dd\ 4'gRu#^RIp\TPRR4pTfRu#TPR4vrEp\T4\T43u#i;i) uDeprecated. Return the CUDA runtime version as (major, minor). Deprecated in favor of ``torch.version.cuda`` for the CUDA runtime version. Prefers a direct query of ``cudaRuntimeGetVersion`` via ``libcudart.so``. If that's not on the system loader path (common with pip-installed torch that bundles its own CUDA runtime), falls back to ``torch.version.cuda`` — which equals the bundled runtime's version for pip wheels. Returns ``(0, 0)`` for CPU-only torch. z}`get_cuda_runtime_version` is deprecated and will be removed in v5.16. Use `torch.version.cuda` for the CUDA runtime version.) stacklevelNz libcudart.sorrLi)rr)warningswarn FutureWarningctypesCDLLOSErrorrrur8r rNrc_intcudaRuntimeGetVersionbyrefvalue)rcudartru cuda_versionmajorminorrr s rget_cuda_runtime_versionrs MM A   &^,llnG   g!67 ==D 7==4#7B"> >>  &!##Ku}}fd;  K'--c2q5z3u:%% &sBC?0!C?)C?>C?c$V^8dQhR\/#rrrs)rs"rrrBrrc^\4'd^RIp\VR4PRJ#R#r)rrur8hiprs ris_rocm_platformrAs)ui(,,D88 rc$V^8dQhR\/#rrrs)rs"rrrKsJJ$Jrc\4'gR#^RIHuHuHpVP 4VP P8H#r)is_torch_hpu_available*habana_frameworks.torch.utils.experimentalruutils experimental_get_device_type synDeviceTypesynDeviceGaudi)htexps ris_habana_gaudi1rJs6 ! # #>>  ! ! #u':':'I'I IIrc>V^8dQhR\R,R\/#)r min_versionNrrD)rs"rrrWs  d d rc\\4'd^RIpVPPP 4;'d%VPPP 4pVeB\ P!\44\ P!V48pT;'dTpV#R#r) rrubackendsmpsr|is_builtr rxr)rrubackend_availableflags& ris_torch_mps_availablerUs!NN..;;=__%..BTBTB]B]B_  "==!2!45{9SSD 1 : :d   rc$V^8dQhR\/#rrrs)rs"rrres>>$>rc\4'd\R4^,'gR#^RIp^RIpV'dJ\ VR4'd5VP P 4pVP P4#R#\ VR4;'dVP P4# \dR#i;i)zQChecks if `torch_npu` is installed and potentially if a NPU is in the environment torch_npuFNnpu) rr@rurrr device_countr| RuntimeError) check_devicerurrs& ris_torch_npu_availablercs   '<['I!'L'L ue$$II**,yy--// 5% = =UYY%;%;%==  sAB22 CCc0V^8dQhR\R\/#rrrrs)rs"rrr{s>>>$>rc\4'gR#\P!\44pVP^8XdVP ^8dR#^RIpV'd6VPP4pVPP4#\VR4;'dVPP4# \dR#i;i)zs Checks if XPU acceleration is available via stock PyTorch (>=2.6) and potentially if a XPU is in the environment. FNxpu) rr rxrrrrurrr|rr)rr}rurs& ris_torch_xpu_availablerys   MM"3"56MaM$7$7!$;  &&(A99))+ + 5% = =UYY%;%;%==  s"3C CCc$V^8dQhR\/#rrrs)rs"rrrsrc<\4'd\R4^,'gR#^RIp^RIp\P P R4p\^4\P R&\VR4'dVPP4MRpV'dV\P R&V#\P PRR4V# T'dT\P R&i\P PRR4i;i)zv Checks if `mlu` is available via an `cndev-based` check which won't trigger the drivers and leave mlu uninitialized. torch_mluFNPYTORCH_CNDEV_BASED_MLU_CHECKmlu) rr@rurr]environr$rrrr|pop)rur,pytorch_cndev_based_mlu_check_previous_value availables ris_torch_mlu_availablers   '<['I!'L'L35::>>Ba3b0B69!f 2307u0E0EEII**,5 7:fBJJ6 7  JJNN:D A  8:fBJJ6 7 JJNN:D As A C>Dc$V^8dQhR\/#rrrs)rs"rrrs@@4@rc\4'd\R4^,'gR#^RIp^RIpRp\RRR7wrEV'd2\P !V4\P !V48dR#V'dJ\ VR4'd5VPP4pVPP4#R#\ VR4;'dVPP4# \dR#i;i) zSChecks if `torch_musa` is installed and potentially if a MUSA is in the environment torch_musaFNz0.33.0 accelerateTrvmusa) rr@rurr rxrrrr|r)rrurtorch_musa_min_versionaccelerate_availableaccelerate_versionrs& ris_torch_musa_availablers   '<\'J1'M'M%/D\bf/g, .@ AGMMRhDi i uf%%JJ++-zz..00 5& ! ? ?ejj&=&=&??  sAC<< D  D c$V^8dQhR\/#rrrs)rs"rrrsdrc2V'dV'dQR4h\\9;'d\R4^,pV'gR#^RIpV'dVPP 4R9#V'dVPP 4R8H#R#)z Check if `torch_xla` is available. To train a native pytorch job in an environment with torch xla installed, set the USE_TORCH_XLA to false. z6The check_is_tpu and check_is_gpu cannot both be true. torch_xlaFNTPUT)GPUCUDA)rjENV_VARS_TRUE_VALUESr@rruntime device_type) check_is_tpu check_is_gputorch_xla_availablers&& ris_torch_xla_availablers|h0hh .'+??iiDYZeDfghDi   ,,./AA   ,,.%77 rc$V^8dQhR\/#rrrs)rs"rrrs\\\rca a a a a a\4'd1\R4^,'d\R4^,'gR#Rp\RRR7wrV'd2\P!V4\P!V48dR#^RIo\ P PR R 4R 8Xd^RIp\SR 4'd!SPP4'gR#SPo V3R lV V3R llpVSn VSPn SPo RV3RlV V3RlllpVSnSPP o V V3RlpVSPnSP"o V3RlV 3RllpVSnVSPnSP$o V 3RlpVSnR#)zQChecks if `torch.hpu` is available and potentially if a HPU is in the environmenthabana_frameworkszhabana_frameworks.torchFz1.5.0rTrvNPT_HPU_LAZY_MODErXhpucn<V^8dQhRSPR\RSPRSP/#)rinputdimindexr)Tensorr LongTensor)rrus"rr,is_torch_hpu_available..__annotate__s:66ell66U=M=M6RWR^R^6rc<VPSP8XdWVPPR8Xd<S!VP SP 4W4P SP4#S!WV4#rdtypeint64devicetypetoint32)rrr original_gatherrus&&&rpatched_gather.is_torch_hpu_available..patched_gathersZ ;;%++ %%,,*;*;u*D"588EKK#8#EHHU U"5u5 5rc|<V^8dQhRSPRSPR\R,RSP/#)rrindicesrNr)r r r)rrus"rrr sG@@ell@U=M=M@TWZ^T^@jojvjv@rc<VPSP8XdWVPPR8Xd<S!VP SP 4W4P SP4#S!WV4#rr)rrroriginal_take_along_dimrus&&&rpatched_take_along_dim6is_torch_hpu_available..patched_take_along_dims] ;;%++ %%,,*;*;u*D*588EKK+@'ORRSXS^S^_ _*53? ?rc<S!V.VO5/VBpSPV4P4'dSRpSPVPR4VPVP R7V,pS!W,.VO5/VBpV#)g& .>rrrM)isnananyeyesizerr)Aargskwargsoutput jitter_value diag_jitteroriginal_choleskyrus&*, r safe_cholesky-is_torch_hpu_available..safe_choleskysy"16t6v6 ;;v  " " $ $L))AFF2Jaggahh)OR^^K&qHHHF rc <V^8dQhRSPR\RSPRSPRSP/#)rrrr srcr)r r)rrus"rrr  sLMM||M"%M.3llMAFM Mrc<VPPR8Xd!WJdS!WW#P4.VO5/VB#S!WW#.VO5/VB#r)rrclone)rrr r/r&r'original_scatters&&&&*,rpatched_scatter/is_torch_hpu_available..patched_scatter sO <<   %%,#Eyy{TTTVT T#ELTLVL Lrc<VPR4R9d.\PRVPR4 R24RVR&S!V/VB#)backend hpu_backendz#Calling torch.compile with backend=ze on a Gaudi device is not supported. We will override the backend with 'hpu_backend' to avoid errors.)r7eager)r$r9warning)r&r'original_compiles*,rhpu_backend_compile3is_torch_hpu_available..hpu_backend_compile1s[ ::i (@ @ NN5fjj6K5LMSS !.F9 000rr)rr@r rxrur]rr$habana_frameworks.torchrrr|gatherr take_along_dimlinalgcholeskyscattercompile) torch_hpu_min_accelerate_versionrrrrrr,r3r;r+r:rr2rrus @@@@@@rrrsb  $%89!<<$%>?BB'.$/D\bf/g, .@ AGMMRrDs s zz~~(#.#5& 5%  (>(>(@(@ llO66 "EL(ELL#22@@ 2E --*ELL}}MM$EM*ELL }}1(EM rc0V^8dQhR\R\/#rrs)rs"rrrBsDDDDTDrcz^RIp\PPR4fR#V'dN^RIp\ VR4'd5VP P4pVP P4#R#\ VR4;'dVP P4# \dR#i;i)rN torch_neuronxFneuron) rur2r3r4rGrrHrr|r)rrurGrs& ris_torch_neuron_availablerI@s~~08  uh''LL--/||0022 5( # C C (A(A(CC  sA B++ B:9B:c0V^8dQhR\R\/#rrs)rs"rrrYs>>>$>rc^RIp\PPR4fR#V'dW^RIp\ VR4'd>VP P4'dVP P4^8#R#\ VR4;'dVP P4# \dR#i;i)rN torch_tpuFtpu) rur2r3r4rLrrMr|rr)rrurLs& ris_torch_tpu_availablerNWs~~ ,4  ue$$)?)?)A)Ayy--/144 5% = =UYY%;%;%==  s5B4'B44 CCc$V^8dQhR\/#rrrs)rs"rrrnsTrc\4'gR#^RIpVPP4'dVPP 4#\ 4'dVP P 4#\4'dR#\4'd-\VR4'dVPP 4#\4'd'VPPP^^4#\4'd-\VR4'dVP P 4#\#4'd-\VR4'dVP$P 4#\'4'd-\VR4'dVP(P 4#\+4'dR#R#)FNTrrrrH)rrurr|is_bf16_supportedrrrrrrrrris_macos_or_newerrrrrrIrHrNrs ris_torch_bf16_gpu_availablerSls6    zz  zz++--yy**,,GE5$9$9yy**,,~~!!33B::  WUF%;%;zz++--GE5$9$9yy**,, ""wuh'?'?||--// rc0V^8dQhR\R\/#rrrrD)rs"rrrscdrc\4'gR#\4'd\4'dR#R#^RIpVP ^^VP VR7pW",p^^^repVP WEWaP VR7pVPPWaP VR7pV!V4pR# \dR#i;i)FTNr ) rrrruzerosfloat16randnnn LayerNorm Exception) rruxrbatchsentence_length embedding_dim embedding layer_norms & r!is_torch_fp16_available_on_devicercs        KK1EMM&K A E121a KK ]]ciKj XX'' ]]SY'Z y ! sA9B77 CCc0V^8dQhR\R\/#rUrD)rs"rrrscdrc\4'gR#^RIpVR8Xd \4#VR8XdR#VP^^VPVR7pW",pR# \ dR#i;i)FNrrTr )rrurSrWbfloat16r\)rrur]rs& r!is_torch_bf16_available_on_devicergsg    *,,  KK1ENN6K B E s'A A*)A*c$V^8dQhR\/#rrrs)rs"rrrsrc"\4'gR#^RIp\4'di\VR4'dWVPP VPP 44pVP VP 2R8dR#R#\VR4pVPP4'dVPfR#VPP VPP 44P^8dR#R#)FNr22Tr ) rrurrrget_device_propertiescurrent_devicerrr8rr|)ru device_infor}s ris_torch_tf32_availablerns     WUF%;%;jj66uzz7P7P7RS  !2!2 3 4 <E9-M :: " " $ $ (:(:(B zz'' (A(A(CDJJQN rc(V^8dQhR\RR/#)renablerNrs)rs"rrrs5555rc^RIp\P!\44pV\P!R48d=V'dRMRp\ VP R4'dW1P nR#R#\4'd;\ VP R4'dWP Pn R#R#WP PPn WP Pn R#)z Set TF32 mode using the appropriate PyTorch API. For PyTorch 2.9+, uses the new fp32_precision API. For older versions, uses the legacy allow_tf32 flags. Args: enable: Whether to enable TF32 mode N2.9.0tf32ieeefp32_precisionmudnn) rur rxrrrrurrv allow_tf32rmatmulcudnn)rprupytorch_versionprecision_modes& r enable_tf32r|smm$5$78O'--00#)v 5>>#3 4 4,:NN ) 5 # $ $u~~w//28$$/05;NN   & & 1.4NN +rc$V^8dQhR\/#rrrs)rs"rrrsaadarc\4;'d6\P!\44\P!R48#)rwrr rxrrrris_torch_flex_attn_availabler1   ` `GMM2C2E$F'--X_J`$``rc$V^8dQhR\/#rrrs)rs"rrrsaaarc\4;'d6\P!\44\P!R48#)rrrrrris_grouped_mm_availablerrrc$V^8dQhR\/#rrrs)rs"rrr--D-rc&\R4^,#)kenlmrrrris_kenlm_availabler ! )! ,,rc<V^8dQhR\R\R\/#)r MIN_VERSION MAX_VERSIONrrD)rs"rrrs"++c+c+lp+rc\RRR7wr#RpVR8wdc\P!V4\P!V48;'d.\P!V4\P!V48pT;'dT#)kernelsTrvFr/r@r rx)rrr|kernels_versionviable_versions&& ris_kernels_availablers{%:)TX$Y!LN% 77==;UU''ZaZgZg [ MM+ &['  * *N*rc$V^8dQhR\/#rrrs)rs"rrr ++$+rc&\R4^,#)cv2rrrris_cv2_availabler ! ' **rc$V^8dQhR\/#rrrs)rs"rrr..T.rc&\R4^,#)yt_dlprrrris_yt_dlp_availabler  ! *1 --rc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)libcstrrrris_libcst_availablerrrc0V^8dQhR\R\/#rrrrD)rs"rrrs\\\$\rc\4'gR#\RRR7wrT;'d.\P!V4\P!V48#)FrTrvrr@r rx)rr|rs& ris_accelerate_availablersF   '<\Z^'_$L  [ [GMM*<={A[[[rc0V^8dQhR\R\/#rrD)rs"rrr$sXXSX$Xrc\RRR7wrT;'d.\P!V4\P!V48#)tritonTrvr)rr|triton_versions& ris_triton_availabler"s9$9RV#W L  W WGMM.9W]];=WWWrc$V^8dQhR\/#rrrs)rs"rrr+s??t?rc&\R4^,#)fast_hadamard_transformrrrris_hadamard_availabler)s !!: ;A >>rc0V^8dQhR\R\/#rrD)rs"rrr1sUU#UDUrc\RRR7wrT;'d.\P!V4\P!V48#)hqqTrvr)rr| hqq_versions& ris_hqq_availabler/s8!6eD QL  T TGMM+6'-- :TTTrc$V^8dQhR\/#rrrs)rs"rrr800t0rc&\R4^,#)pygmentsrrrris_pygments_availabler6 ! ,Q //rc$V^8dQhR\/#rrrs)rs"rrr>sff$frcn\4;'d%\4;'d\R4^,#) torchvisionis_vision_availablerr@rrris_torchvision_availabler<s.  e e%7%9 e e>STa>bcd>eerc$V^8dQhR\/#rrrs)rs"rrrDs&&T&rc\4#r)rrrris_torchvision_v2_availablerBs  $ %%rc0V^8dQhR\R\/#rrrrD)rs"rrrIsPPSPTPrc\4'gR#\RRR7wr\P!V4\P!V48#)FrTrv)rr@r rx)rrtorchvision_versions& ris_torchvision_greater_or_equalrHs< # % %2=QUVA ==, -1O OOrc$V^8dQhR\/#rrrs)rs"rrrR4444rc&\R4^,#) galore_torchrrrris_galore_torch_availablerP ! 0 33rc$V^8dQhR\/#rrrs)rs"rrrXrrc&\R4^,#) apollo_torchrrrris_apollo_torch_availablerVrrc$V^8dQhR\/#rrrs)rs"rrr^s..4.rc&\R4^,#)optimirrrris_torch_optimi_availabler\rrc$V^8dQhR\/#rrrs)rs"rrrd2242rc&\R4^,#) lomo_optimrrrris_lomo_availablerb ! .q 11rc$V^8dQhR\/#rrrs)rs"rrrj111rc&\R4^,#) grokadamwrrrris_grokadamw_availablerh ! -a 00rc0V^8dQhR\R\/#rrD)rs"rrrp^^3^d^rc\RRR7wrT;'d.\P!V4\P!V48#) schedulefreeTrvr)rr|schedulefree_versions& ris_schedulefree_availablern;*?~^b)c&L  ] ]GMM*>?7==Q\C]]]rc$V^8dQhR\/#rrrs)rs"rrrw33$3rc&\R4^,#) pyctcdecoderrrris_pyctcdecode_availableru ! / 22rc$V^8dQhR\/#rrrs)rs"rrr}//d/rc&\R4^,#)librosarrrris_librosa_availabler{ ! +A ..rc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)nagisarrrris_nagisa_availablerrrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)soynlprrrris_soynlp_availablerrrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#) multipartrrrris_multipart_availablerrrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)essentiarrrris_essentia_availablerrrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)pydanticrrrris_pydantic_availabler rrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)fastapirrrris_fastapi_availablerrrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)uvicornrrrris_uvicorn_availablerrrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)openairrrris_openai_availablerrrc$V^8dQhR\/#rrrs)rs"rrrsssDsrc\4;'d/\4;'d\4;'d \4#r)r rrrrrris_serve_availablers1 ! " r r';'= r rBVBX r r]p]rrrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#) pretty_midirrrris_pretty_midi_availablerrrc$V^8dQhR\/#rrrs)rs"rrrsOOOrcJ\4;'d\R4^,#) mamba_ssmrr@rrris_mamba_ssm_availabler#s  # $ N N)>{)KA)NNrc$V^8dQhR\/#rrrs)rs"rrrsuu$urc\RRR7wr\4;'d8T;'d.\P!V4\P!R48#)r!Trvz2.0.4)r@rr rx)r|mamba_ssm_versions ris_mamba_2_ssm_availabler'sI' Z ZBXBZ A A  A A MM+ &'--*@ @rc$V^8dQhR\/#rrrs)rs"rrrsSSDSrcJ\4;'d\R4^,#) causal_conv1dr"rrris_causal_conv1d_availabler/s! # $ R R)>)OPQ)RRrc$V^8dQhR\/#rrrs)rs"rrrsFFDFrcJ\4;'d\R4^,#)xlstmrr@rrris_xlstm_availabler4s    E E$9'$B1$EErc$V^8dQhR\/#rrrs)rs"rrrsHHdHrcJ\4;'d\R4^,#)mambapyr3rrris_mambapy_availabler8s    G G$9)$DQ$GGrc$V^8dQhR\/#rrrs)rs"rrr,,4,rc&\R4^,#)peftrrrris_peft_availabler= ! ( ++rc<V^8dQhR\R\R\/#rrD)rs"rrrs'MMcMtMPTMrc4\RRR7wr#V'gR#V'dL\P!\P!V4P4\P!V48#\P!V4\P!V48#)r<TrvFr@r rxr)rrr| peft_versions&& ris_peft_greater_or_equalrCsd!6vd!SL }}W]]<8EEF'--XgJhhh}}\*gmmO.LLLrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)bs4rrrris_bs4_availablerGrrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#) coloredlogsrrrris_coloredlogs_availablerKrrc$V^8dQhR\/#rrrs)rs"rrrr:rc&\R4^,#)onnxrrrris_onnx_availablerOr>rc$V^8dQhR\/#rrrs)rs"rrr 222rc&\R4^,#) onnxscriptrrrris_onnxscript_availablerT rrc$V^8dQhR\/#rrrs)rs"rrrsbb$brcZ\R4^,;'g\R4^,#) onnxruntimezonnxruntime-gpurrrris_onnxruntime_availablerXs) ! / 2 a a6KL]6^_`6aarc$V^8dQhR\/#rrrs)rs"rrrrQrc&\R4^,#) executorchrrrris_executorch_availabler\rrc$V^8dQhR\/#rrrs)rs"rrrsSSDSrc\RRR7wrT;'d.\P!V4\P!R48#)fluteTrvz0.4.1r)r| flute_versions ris_flute_availableras9#8PT"UL  R RGMM-8GMM's   rc8^RIHpR# \dR#i;i)rMETA_ARCH_REGISTRYTF)detectron2.modelingrtr\rss ris_detectron2_availablerv<s : s  c$V^8dQhR\/#rrrs)rs"rrrLrrc&\R4^,#) diffusersrrrris_diffusers_availablerzJrrc$V^8dQhR\/#rrrs)rs"rrrRrrc&\R4^,#)rjiebarrrris_rjieba_availabler~Prrc$V^8dQhR\/#rrrs)rs"rrrXrrc&\R4^,#)psutilrrrris_psutil_availablerVrrc$V^8dQhR\/#rrrs)rs"rrr^rrc&\R4^,#)py3nvmlrrrris_py3nvml_availabler\rrc$V^8dQhR\/#rrrs)rs"rrrdrQrc&\R4^,#) sacremosesrrrris_sacremoses_availablerbrrc$V^8dQhR\/#rrrs)rs"rrrjr:rc&\R4^,#)apexrrrris_apex_availablerhr>rc$V^8dQhR\/#rrrs)rs"rrrpr:rc&\R4^,#)aqlmrrrris_aqlm_availablernr>rc0V^8dQhR\R\/#rrD)rs"rrrvVV3VdVrc\RRR7wrT;'d.\P!V4\P!V48#)vptqTrvr)rr| vptq_versions& ris_vptq_availablert8"7vd!SL  U UGMM,77==;UUUrc$V^8dQhR\/#rrrs)rs"rrr}s***rc&\R4^,#)avrrrris_av_availabler{s ! &q ))rc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)decordrrrris_decord_availablerrrc$V^8dQhR\/#rrrs)rs"rrrrQrc&\R4^,#) torchcodecrrrris_torchcodec_availablerrrc$V^8dQhR\/#rrrs)rs"rrrs  D rc\\P!RR.4R# \dR#i;i)z Code comes from *torch.utils.cpp_extension.is_ninja_available()*. Returns `True` if the [ninja](https://ninja-build.org/) build system is available on the system, `False` otherwise. ninjaz --versionTF) subprocess check_outputr\rrris_ninja_availablers3+ 67 s  ++c0V^8dQhR\R\/#rrD)rs"rrrrrc\RRR7wrT;'d.\P!V4\P!V48#) bitsandbytesTrvr)rr|bitsandbytes_versions& ris_bitsandbytes_availablerrrc0V^8dQhR\R\/#rkernels_fallback_okrrs)rs"rrrs4DrcX\RRR7wrT;'d9R\PR.4Uu.uFq3PRR4NK up9pV'dO\ 4'g\ 4'd/\ P!V4\ P!R48#V'd>\4'd.^RI H p^R I Hp^R IHpVR ,pV!Wu!V4R 7R#R#uupi \P PdR#i;i \"dR#i;i) flash_attnTrv flash-attnrrz2.3.3F get_kernelget_attn_kernel_versionFLASH_ATTN_KERNEL_FALLBACKflash_attention_2r )r@r#r$r"rrr rxrzr{rrr%transformers.integrations.hub_kernelsr+transformers.modeling_flash_attention_utilsrr\)rr|flash_attn_versionpkgrrrrepo_ids& ris_flash_attn_2_availablers (=\Z^'_$LL)E)I)I,XZ)[5)[# C)[5%L 0226L6N6N ==!34 g8NN N 355  * U ^01DEG w(?(H I 15  //      s)C/;,C4*D4DD D)(D)c0V^8dQhR\R\/#rrs)rs"rrrs4Drc\R4^,pT;'d9R\PR.4Uu.uFq"PRR4NK up9pV'd\ 4'dR#V'd>\ 4'd.^RIHp^RIH p^RI H pVR,pV!Wd!V4R 7R#R #uupi \dR #i;i) flash_attn_interfacez flash-attn-3rrTrrrflash_attention_3r F) r@r#r$r"rrrrrrrrr\)rr|rrrrrs& ris_flash_attn_3_availablers))?@CLN)E)I)IJ`bd)e7)e# C)e7%L/11355  * U ^01DEG w(?(H I '7"    sB6*B;; C  C c$V^8dQhR\/#rrrs)rs"rrrs 6 64 6rc\R4^,pT;'d9R\PR.4Uu.uFqPRR4NK up9pT;'d \ 4#uupi)rz flash-attn-4rr)r@r#r$r"r)r|rs ris_flash_attn_4_availablerss)6q9L N)E)I)I,XZ)[7)[# C)[7%L  5 5355 7sA)c0V^8dQhR\R\/#rrD)rs"rrrs  C D rcj\RRR7wrT;'d9R\PR.4Uu.uFq3PRR4NK up9pV'gR#\P !V4\P !V48#uupi \ PPdR#i;i)rTrvrrrF)r@r#r$r"r rxrzr{)rr|rrs& ris_flash_attn_greater_or_equalrs'<\Z^'_$LL)E)I)I,XZ)[5)[# C)[5%L }}/0GMM/4RRR5    + +sB ,BB21B2c$V^8dQhR\/#rrrs)rs"rrrs33T3rcN\P!R\4\R4#)z`is_flash_attn_greater_or_equal_2_10` is deprecated and will be removed in v5.8. Please use `is_flash_attn_greater_or_equal(library_version='2.1.0')` instead if needed.z2.1.0)rrrrrrr#is_flash_attn_greater_or_equal_2_10rs& MM b *' 22rc<V^8dQhR\R\R\/#rrD)rs"rrr s'LLL$L[_Lrc4\RRR7wr#V'gR#V'dL\P!\P!V4P4\P!V48#\P!V4\P!V48#)huggingface_hubTrvFrA)rrr| hub_versions&& r#is_huggingface_hub_greater_or_equalrsf 56GX\ ]L }}W]];7DDEWfIggg}}[)W]]?-KKKrc<V^8dQhR\R\R\/#rrD)rs"rrrs& N Ns N N NrcD\4'gR#\RRR7wr#V'dL\P!\P!V4P4\P!V48#\P!V4\P!V48#)rFoptimum.quantoTrv)is_optimum_quanto_availabler@r rxr)rrrquanto_versions&& ris_quanto_greaterrsm ' ( (-.>tTA}}W]]>:GGH7==YhKiii}}^,w}}_/MMMrc&\R4^,#) torchdistxrrrris_torchdistx_availabler%rrc$V^8dQhR\/#rrrs)rs"rrr-rrc&\R4^,#)faissrrrris_faiss_availabler+rrc$V^8dQhR\/#rrrs)rs"rrr3s00$0rc\R4#) fouroversixrrrris_fouroversix_availabler1s ! //rc$V^8dQhR\/#rrrs)rs"rrr9rrc&\R4^,#)scipyrrrris_scipy_availabler7rrc$V^8dQhR\/#rrrs)rs"rrr?rrc&\R4^,#)sklearnrrrris_sklearn_availabler=rrc$V^8dQhR\/#rrrs)rs"rrrEs55D5rc&\R4^,#) sentencepiecerrrris_sentencepiece_availablerCs ! 1! 44rc$V^8dQhR\/#rrrs)rs"rrrKrrc&\R4^,#)seqiorrrris_seqio_availablerIrrc0V^8dQhR\R\/#rrD)rs"rrrQrrc\RRR7wrT;'d.\P!V4\P!V48#)ggufTrvr)rr| gguf_versions& ris_gguf_availablerOrrc$V^8dQhR\/#rrrs)rs"rrrXs^^t^rcZ\R4^,;'d\R4^,#)googlezgoogle.protobufrrrris_protobuf_availablerVs) ! *1 - ] ]2GHY2Z[\2]]rc0V^8dQhR\R\/#rrD)rs"rrr^see3ederc\4;'d6\P!\44\P!V48#rr)rs&ris_fsdp_availabler\s1   d dGMM2C2E$F'--XcJd$ddrc$V^8dQhR\/#rrrs)rs"rrrdrrc&\R4^,#)optimumrrrris_optimum_availablerbrrc$V^8dQhR\/#rrrs)rs"rrrjs++d+rc&\R4^,#)awqrrrris_llm_awq_availabler hrrc0V^8dQhR\R\/#rrD)rs"rrrps\\\\rc\RRR7wrT;'d.\P!V4\P!V48#) auto_roundTrvr)rr|auto_round_versions& ris_auto_round_availablerns:(=\Z^'_$L  [ [GMM*<={A[[[rcJ\4;'d\R4^,#)rrr@rrrrru! ! P P&;TTTrc0V^8dQhR\R\/#rrD)rs"rrrsdddZ^drc\RRR7wrT;'d.\P!V4\P!V48#)compressed_tensorsTrvr)rr|compressed_tensors_versions& ris_compressed_tensors_availabler%s=0EEYjn/o,L  c cGMM*DEWbIcccrc$V^8dQhR\/#rrrs)rs"rrrs))4)rc\R4#)sinqrrrris_sinq_availabler)s ! ((rc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#) gptqmodelrrrris_gptqmodel_availabler-rrc$V^8dQhR\/#rrrs)rs"rrrrQrc&\R4^,#) fbgemm_gpurrrris_fbgemm_gpu_availabler1rrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#) Levenshteinrrrris_levenshtein_availabler5rrc$V^8dQhR\/#rrrs)rs"rrrsQQTQrcJ\4;'d\R4^,#)zoptimum.neuronrrrris_optimum_neuron_availabler8rrc$V^8dQhR\/#rrrs)rs"rrrrQrc&\R4^,# tokenizersrrrris_tokenizers_availabler=rrc$V^8dQhR\/#rrrs)rs"rrrsTrc4^RIpR# \dR#i;i)rNTF) PIL.ImagerF)PILs rrrs s  c$V^8dQhR\/#rrrs)rs"rrrsMM$MrcJ\R4^,;'d \4#) pytesseract)r@rrrris_pytesseract_availablerEs  ! / 2 L L7J7LLrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)pytestrrrris_pytest_availablerIrrc$V^8dQhR\/#rrrs)rs"rrrsNN4NrcJ\4;'d\R4^,#) pytest_order)rIr@rrris_pytest_order_availablerMs   M M%:>%J1%MMrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)spacyrrrris_spacy_availablerQrrc$V^8dQhR\/#rrrs)rs"rrrs<<4STZ>[\]>^^rc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)nattenrrrris_natten_availablererrc$V^8dQhR\/#rrrs)rs"rrrr:rc&\R4^,#)nltkrrrris_nltk_availablerir>rc$V^8dQhR\/#rrrs)rs"rrrsXXDXrc\R4^,pV'gR#\RRR7wrV'*;'g.\P!V4\P!R48#)numbaFnumpyTrvrkr)r|numpy_available numpy_versions ris_numba_availablerpsQ)1!4L %:7SW%X"O  W W'-- ">wAW"WWrc$V^8dQhR\/#rrrs)rs"rrrsKKKrcJ\4;'d\R4^,#) torchaudior3rrris_torchaudio_availablert s    J J$9,$G$JJrc0V^8dQhR\R\/#rrD)rs"rrrsYYcYDYrc\4'gR#\RRR7wrT;'d.\P!V4\P!V48#)FtorchaoTrvr)rr|torchao_versions& ris_torchao_availablerysE   $9)TX$Y!L  X XGMM/:gmmK>XXXrc$V^8dQhR\/#rrrs)rs"rrrs%%T%rc\4#r)rtrrris_speech_availabler|s  # $$rc$V^8dQhR\/#rrrs)rs"rrr%rrc&\R4^,#) spqr_quantrrrris_spqr_availabler#rrc$V^8dQhR\/#rrrs)rs"rrr+rQrc&\R4^,#) phonemizerrrrris_phonemizer_availabler)rrc$V^8dQhR\/#rrrs)rs"rrr1rrc&\R4^,#)uromanrrrris_uroman_availabler/rrc$V^8dQhR\/#rrrs)rs"rrr7s11d1rc&\R4^,#) sudachipyrrrris_sudachi_availabler5rrc$V^8dQhR\/#rrrs)rs"rrr=sWWWrc\RRR7wrT;'d.\P!V4\P!R48#)rTrvz0.6.8r)r|sudachipy_versions ris_sudachi_projection_availabler;s:'qA I ITIrc$V^8dQhR\/#rrrs)rs"rrrjsZZ4Zrc\RRR7wrT;'d.\P!V4\P!R48#) liger_kernelTrvz0.3.0r)r|liger_kernel_versions ris_liger_kernel_availablerhs;*?~^b)c&L  Y YGMM*>?7==QXCYYYrc$V^8dQhR\/#rrrs)rs"rrrqr:rc&\R4^,#)richrrrris_rich_availableror>rc$V^8dQhR\/#rrrs)rs"rrrwrQrc&\R4^,#) matplotlibrrrris_matplotlib_availablerurrc0V^8dQhR\R\/#rrD)rs"rrr}sSRVrc\RRR7wr\4;'d8T;'d.\P!V4\P!V48#)mistral_commonTrv)r@rr rx)rr|mistral_common_versions& ris_mistral_common_availabler{sM,AAQbf+g(Lvv,vv7==AW3X\c\i\iju\v3vrc$V^8dQhR\/#rrrs)rs"rrrrrc&\R4^,#)pynvmlrrrris_pynvml_availablerrrcV^8dQhRR/#rrNr)rs"rrrs  $ rc>\R4'g \R4hR#)z2.6aHDue to a serious vulnerability issue in `torch.load`, even with `weights_only=True`, we now require users to upgrade torch to at least v2.6 in order to use the function. This version restriction does not apply when loading files with safetensors. See the vulnerability report here https://nvd.nist.gov/vuln/detail/CVE-2025-32434N)r ValueErrorrrrcheck_torch_load_is_safers% $U + + b   ,rc0V^8dQhR\R\/#)rrorr)rs"rrrs(xrcaV3RlpV#)cJ<\4'g \R4hS!V/VB#)z7You need to install pytorch to use this method or class)rrF)r&r'ros*,rwrapper"torch_only_method..wrappers(!##WX Xt&v& &rr)rorsf rtorch_only_methodrs' Nrc$V^8dQhR\/#rrrs)rs"rrrs   rc`\4'd^RIpVP4^8XdR#R#R#)zz Check whether pytorch uses deterministic algorithms by looking if torch.set_deterministic_debug_mode() is set to 1 or 2" NFT)rruget_deterministic_debug_moders ris_torch_deterministicrs*  - - /1 4 rc$V^8dQhR\/#rrr)rs"rrrsGG3Grc\4pVR8XdR#\P!V4p\VP4R,\VP 4,#)r/rL)rr rxrrr)r}r~s r!get_torch_major_and_minor_versionrsI%'M]]=1N ~## $s *S1E1E-F FFrc$V^8dQhR\/#rrrs)rs"rrrs$rcd^RIpVPP4# \dR#i;ir)rucompiler is_compilingr\rs ris_torchdynamo_compilingrs/~~**,,   //c$V^8dQhR\/#rrrs)rs"rrr$rcd^RIpVPP4# \dR#i;ir)rur is_exportingr\rs ris_torchdynamo_exportingrs/~~**,, rc$V^8dQhR\/#rrrs)rs"rrrsDrcn^RIp\WPP4# \dR#i;ir)torch.fx isinstancefxProxyr\r]rus& ris_torch_fx_proxyrs/!XX^^,, s "% 44c$V^8dQhR\/#rrrs)rs"rrrsrcp^RIp\V\VR4P4# \dR#i;i)rN _subclassesF)rurr8 FakeTensorr\rs& ris_fake_tensorrs6!WUM:EEFF s #& 55c\VR4'gR#^RIp\VP4\VR4P4# \ dR#i;i)areturns True if we are inside of `jax.jit` context, False otherwise. When a torch model is being compiled with `jax.jit` using torchax, the tensor that goes through the model would be an instance of `torchax.tensor.Tensor`, which is a tensor subclass. This tensor has a `jax` method to return the inner Jax array (https://github.com/google/torchax/blob/13ce870a1d9adb2430333c27bb623469e3aea34e/torchax/tensor.py#L134). Here we use ducktyping to detect if the inner jax array is a jax Tracer then we are in tracing context. (See more at: https://github.com/jax-ml/jax/discussions/9241) Args: x: torch.Tensor Returns: bool: whether we are inside of jax jit tracing. jaxFNcore)rrrr8Tracerr\)r]rs& ris_jax_jittingrsN$ 1e  !%%'73#7#>#>?? s1A AAc$V^8dQhR\/#rrrs)rs"rrrsrcd^RIpVPP4# \dR#i;ir)rujit is_tracingr\rs ris_jit_tracingrs/yy##%% rc$V^8dQhR\/#rrrs)rs"rrrrrcd^RIpVPP4# \dR#i;ir)ruris_current_stream_capturingr\rs ris_cuda_stream_capturingrs/zz5577 rc$V^8dQhR\/#rrrs)rs"rrrs  t rc\4;'g\4;'g \4pVe7V\V4,pV\ V4,pV\ V4,pV#)zChecks whether we are tracing a graph with dynamo (compile or export), torch.jit, torch.fx, jax.jit (with torchax) or CUDA stream capturing or FakeTensor)rrrrrr)tensor _is_tracings& rrrs] +,^^0@^^D\D^K (00 ~f-- ~f-- rcV^8dQhR\R\\.\3,,R\\,RR/#)rcondmsg error_typerN)r rrrr\)rs"rrrs>0:0:0:3"c'1B+B0:PTU^P_0:qu0:rca\P!RR4R8XdR#^RIp\4'dB\ WP 4'dVP V4R#VPV4R#\S4'gV3RlpMSp\V4'dV!4p\ WP 4'dVPW V4R#VPW V4R#)a Combines the functionalities of `torch._check`, `torch._check_with` and `torch._check_tensor_all_with` to provide a unified way to perform checks that are compatible with TorchDynamo (torch.compile & torch.export). The advantage of using `torch._check(cond, msg, error_type)` over `if cond: raise error_type(msg)` is that the former works as a truthfulness hint for TorchDynamo, instead of failing with a data-dependent control flow error during compilation. All checks using this method can be disabled in production environments by setting `TRANSFORMERS_DISABLE_TORCH_CHECK=1`. Args: cond (`bool`, `torch.Tensor` or `Callable[[], bool | torch.Tensor]`): The condition to check. msg (`str` or `Callable[[], str]`): The error message to display if the condition is not met. error_type (`type[Exception]`, *optional*, defaults to `ValueError`): The type of error to raise if the condition is not met. Raises: error_type: If the condition is not met. TRANSFORMERS_DISABLE_TORCH_CHECKrdrXNc<S#rr)rsr msg_callable,torch_compilable_check..msg_callable@sJr) r]r^rurrr _check_tensor_all_checkcallable_check_tensor_all_with _check_with)rrrrurs&f& rtorch_compilable_checkrs$ yy3S9S@ || dLL ) )  # #D )  LL  C==  ~~v$ %% $$Z|D *L9rc$V^8dQhR\/#rrrs)rs"rrrRs;;d;rcD\PPR4RJ#)IPythonN)r2r3r4rrris_ipython_availablerPs >> # #I .d ::rc$V^8dQhR\/#rrrs)rs"rrrWsrcR\P9dR#\PR,PpRV!4P9d \ R4hR\ P 9d(\ P R,R8d \ R4h\PPR4RJ# \\\3dR #i;i) marimoTr IPKernelAppconsoleDATABRICKS_RUNTIME_VERSIONz11.0 databricksNF) sysmodules get_ipythonconfigrFr]rr2r3r4AttributeErrorKeyError)rs ris_in_notebookr Vs s{{ "kk),88  4 4 4i( ( '2:: 5"**Ea:bek:kl+ +~~'' 2$>> K 2sB8BB88CCc$V^8dQhR\/#rrrs)rs"rrrls 5 5 5rc\P!RR4p\P!V4pVP RR4'gR#\ R4^,# \P dR#i;i)SM_FRAMEWORK_PARAMS{}*sagemaker_distributed_dataparallel_enabledF smdistributed)r]r^jsonloadsr$JSONDecodeErrorr@)sagemaker_paramss ris_sagemaker_dp_enabledr+ksuyy!6=::&67##$PRWXXY ! 1! 44   s-AA54A5c$V^8dQhR\/#rrrs)rs"rrr{s555rc\P!RR4p\P!V4pRV9dR#\P!RR4p\P!T4pTP RR4'gR#\ R4^,# \PdR#i;i \PdR#i;i)SM_HP_MP_PARAMETERSr$ partitionsFr#sagemaker_mpi_enabledr&)r]r^r'r(r)r$r@) smp_options mpi_optionss ris_sagemaker_mp_enabledr3zs))148Kjj- { * + ))148Kjj- 6>>? ! 1! 44      s#B-B0B-,B-0C C c$V^8dQhR\/#rrrs)rs"rrrs..d.rc(R\P9#)SAGEMAKER_JOB_NAME)r]rrrris_training_run_on_sagemakerr7s 2:: --rz {0} requires the PyAv library but it was not found in your environment. You can install it with: ``` pip install av ``` Please note that you may need to restart your runtime after installation. z {0} requires the YT-DLP library but it was not found in your environment. You can install it with: ``` pip install yt-dlp ``` Please note that you may need to restart your runtime after installation. z {0} requires the PyAv library but it was not found in your environment. You can install it with: ``` pip install decord ``` Please note that you may need to restart your runtime after installation. z {0} requires the TorchCodec (https://github.com/pytorch/torchcodec) library, but it was not found in your environment. You can install it with: ``` pip install torchcodec ``` Please note that you may need to restart your runtime after installation. z {0} requires the OpenCV library but it was not found in your environment. You can install it with: ``` pip install opencv-python ``` Please note that you may need to restart your runtime after installation. ub {0} requires the 🤗 Datasets library but it was not found in your environment. You can install it with: ``` pip install datasets ``` In a notebook or a colab, you can install it by executing a cell with ``` !pip install datasets ``` then restarting your kernel. Note that if you have a local folder named `datasets` or a local python file named `datasets.py` in your current working directory, python may try to import this instead of the 🤗 Datasets library. You should rename this folder or that python file if that's the case. Please note that you may need to restart your runtime after installation. u< {0} requires the 🤗 Tokenizers library but it was not found in your environment. You can install it with: ``` pip install tokenizers ``` In a notebook or a colab, you can install it by executing a cell with ``` !pip install tokenizers ``` Please note that you may need to restart your runtime after installation. aC {0} requires the SentencePiece library but it was not found in your environment. Check out the instructions on the installation page of its repo: https://github.com/google/sentencepiece#installation and follow the ones that match your environment. Please note that you may need to restart your runtime after installation. aU {0} requires the protobuf library but it was not found in your environment. Check out the instructions on the installation page of its repo: https://github.com/protocolbuffers/protobuf/tree/master/python#installation and follow the ones that match your environment. Please note that you may need to restart your runtime after installation. aG {0} requires the faiss library but it was not found in your environment. Check out the instructions on the installation page of its repo: https://github.com/facebookresearch/faiss/blob/master/INSTALL.md and follow the ones that match your environment. Please note that you may need to restart your runtime after installation. a% {0} requires the PyTorch library but it was not found in your environment. Check out the instructions on the installation page: https://pytorch.org/get-started/locally/ and follow the ones that match your environment. Please note that you may need to restart your runtime after installation. a) {0} requires the Torchvision library but it was not found in your environment. Check out the instructions on the installation page: https://pytorch.org/get-started/locally/ and follow the ones that match your environment. Please note that you may need to restart your runtime after installation. z {0} requires the Beautiful Soup library but it was not found in your environment. You can install it with pip: `pip install beautifulsoup4`. Please note that you may need to restart your runtime after installation. aC {0} requires the scikit-learn library but it was not found in your environment. You can install it with: ``` pip install -U scikit-learn ``` In a notebook or a colab, you can install it by executing a cell with ``` !pip install -U scikit-learn ``` Please note that you may need to restart your runtime after installation. aE {0} requires the detectron2 library but it was not found in your environment. Check out the instructions on the installation page: https://github.com/facebookresearch/detectron2/blob/master/INSTALL.md and follow the ones that match your environment. Please note that you may need to restart your runtime after installation. z {0} requires the python-Levenshtein library but it was not found in your environment. You can install it with pip: `pip install python-Levenshtein`. Please note that you may need to restart your runtime after installation. z {0} requires the g2p-en library but it was not found in your environment. You can install it with pip: `pip install g2p-en`. Please note that you may need to restart your runtime after installation. a {0} requires the pytorch-quantization library but it was not found in your environment. You can install it with pip: `pip install pytorch-quantization --extra-index-url https://pypi.ngc.nvidia.com` Please note that you may need to restart your runtime after installation. z{ {0} requires the torchaudio library but it was not found in your environment. Please install it and restart your runtime. a {0} requires the pandas library but it was not found in your environment. You can install it with pip as explained here: https://pandas.pydata.org/pandas-docs/stable/getting_started/install.html. Please note that you may need to restart your runtime after installation. z {0} requires the phonemizer library but it was not found in your environment. You can install it with pip: `pip install phonemizer`. Please note that you may need to restart your runtime after installation. z {0} requires the uroman library but it was not found in your environment. You can install it with pip: `pip install uroman`. Please note that you may need to restart your runtime after installation. z {0} requires the sacremoses library but it was not found in your environment. You can install it with pip: `pip install sacremoses`. Please note that you may need to restart your runtime after installation. z {0} requires the scipy library but it was not found in your environment. You can install it with pip: `pip install scipy`. Please note that you may need to restart your runtime after installation. z {0} requires the torchaudio library but it was not found in your environment. You can install it with pip: `pip install torchaudio`. Please note that you may need to restart your runtime after installation. z {0} requires the timm library but it was not found in your environment. You can install it with pip: `pip install timm`. Please note that you may need to restart your runtime after installation. a" {0} requires the natten library but it was not found in your environment. You can install it by referring to: shi-labs.com/natten . You can also install it with pip (may take longer to build): `pip install natten`. Please note that you may need to restart your runtime after installation. z {0} requires the numexpr library but it was not found in your environment. You can install it by referring to: https://numexpr.readthedocs.io/en/latest/index.html. z {0} requires the NLTK library but it was not found in your environment. You can install it by referring to: https://www.nltk.org/install.html. Please note that you may need to restart your runtime after installation. z {0} requires the PIL library but it was not found in your environment. You can install it with pip: `pip install pillow`. Please note that you may need to restart your runtime after installation. z {0} requires the pydantic library but it was not found in your environment. You can install it with pip: `pip install pydantic`. Please note that you may need to restart your runtime after installation. z {0} requires the fastapi library but it was not found in your environment. You can install it with pip: `pip install fastapi`. Please note that you may need to restart your runtime after installation. z {0} requires the uvicorn library but it was not found in your environment. You can install it with pip: `pip install uvicorn`. Please note that you may need to restart your runtime after installation. z {0} requires the openai library but it was not found in your environment. You can install it with pip: `pip install openai`. Please note that you may need to restart your runtime after installation. z {0} requires the PyTesseract library but it was not found in your environment. You can install it with pip: `pip install pytesseract`. Please note that you may need to restart your runtime after installation. z {0} requires the pyctcdecode library but it was not found in your environment. You can install it with pip: `pip install pyctcdecode`. Please note that you may need to restart your runtime after installation. z {0} requires the accelerate library >= {ACCELERATE_MIN_VERSION} it was not found in your environment. You can install or update it with pip: `pip install --upgrade accelerate`. Please note that you may need to restart your runtime after installation. z {0} requires essentia library. But that was not found in your environment. You can install them with pip: `pip install essentia==2.1b6.dev1034` Please note that you may need to restart your runtime after installation. z {0} requires the librosa library. But that was not found in your environment. You can install them with pip: `pip install librosa` Please note that you may need to restart your runtime after installation. z {0} requires the diffusers library. But that was not found in your environment. You can install them with pip: `pip install diffusers` Please note that you may need to restart your runtime after installation. z {0} requires the soundfile library. But that was not found in your environment. You can install it with pip: `pip install soundfile` Please note that you may need to restart your runtime after installation. z {0} requires the pretty_midi library. But that was not found in your environment. You can install them with pip: `pip install pretty_midi` Please note that you may need to restart your runtime after installation. z {0} requires the Cython library but it was not found in your environment. You can install it with pip: `pip install Cython`. Please note that you may need to restart your runtime after installation. z {0} requires the rjieba library but it was not found in your environment. You can install it with pip: `pip install rjieba`. Please note that you may need to restart your runtime after installation. z {0} requires the peft library but it was not found in your environment. You can install it with pip: `pip install peft`. Please note that you may need to restart your runtime after installation. z {0} requires the jinja library but it was not found in your environment. You can install it with pip: `pip install jinja2`. Please note that you may need to restart your runtime after installation. z {0} requires the rich library but it was not found in your environment. You can install it with pip: `pip install rich`. Please note that you may need to restart your runtime after installation. z {0} requires the mistral-common library but it was not found in your environment. You can install it with pip: `pip install mistral-common`. Please note that you may need to restart your runtime after installation. rrFrror detectron2ryrrrdrXrrr levenshteinrr\protobufrrDrrTrrspeechr`rsrdrhr<rurrvisionrrcythonr}r<jinjarrr rrrzmistral-commonc\V\\,4'gV.p\VR4'd VPMVP Pp.pVFop\V\ 4'dVPVPreM\V,wrVV!4'dKOVPVPV44Kq V'd\RPV44hR#)a Method that automatically raises in case the specified backends are not available. It is often used during class initialization to ensure the required dependencies are installed: ```py requires_backends(self, ["torch"]) ``` The backends should be defined in the `BACKEND_MAPPING` defined in `transformers.utils.import_utils`. Args: obj: object to be checked backends: list or tuple of backends to check. __name__N)rrr-rr@ __class__Backend is_satisfied error_messageBACKENDS_MAPPINGappendrrFjoin)objrrfailedr6rrs&& rrequires_backendsrK' s hu - -:"3 333<<9O9OD F gw ' '$1173H3Hs-g6NI{{ MM#**T* +"''&/**rc:aa]tRtRtoRtRtV3RltRtVtV;t #) DummyObjectiI z Metaclass for the dummy objects. Any class inheriting from it will return the ImportError generated by `requires_backend` each time a user tries to access any method of that class. Tc<VPR4'dVR8wgVR8XgVR8XgVR8Xd\SV` V4#\WP4R#)r _from_configis_dummymrocallN) startswithsuper__getattribute__rK _backends)clskeyrBs&&rrUDummyObject.__getattribute__Q sN NN3  C>$9cZ>OSVZ_S_cfjpcp7+C0 0#}}-rr) r@ __module__ __qualname____firstlineno____doc__rPrU__static_attributes____classdictcell__ __classcell__rB __classdict__s@@rrMrMI s H..rrMc|aa]tRtRtoRtR V3RlV3RllltV3RltV3RlRltV3RlR ltR t R t Vt V;t #) _LazyModulei[ zm Module class that surfaces all objects but only performs associated imports when the objects are requested. c<V^8dQhRS[RS[RS[RS[PPR,RS[S[S[3,R,RS[S[S[S[,3,R,/#)rr module_fileimport_structure module_specN extra_objectsexplicit_import_shortcut)rIMPORT_STRUCTURE_Tr2 machinery ModuleSpecr%objectr)rrbs"rr_LazyModule.__annotate__b sa6a6a6a6- a6 ((33d: a6 CK(4/ a6#'sDI~"6"=a6rc(<a\SV`V4/VnV'dTM/Vn\;QJdRV4F 'gK RM RM !RV44'Ed\ 4Vn/Vn.Vn/pVP4EFwr.p \ \\V P44U U u.uFJp \V PR4^,4U u.uFqPRV 4^,NK up NKL up p !4p VFoS\ 9d\ S,wrMf\;QJdV3RlR4F 'gK RM RM!V3RlR44'd\#S4oSP$pM\'RS 24hV!4'gV P)S4KK VP P/V 4VnV P4FmwppV 'dWPV&VF*pVVPV&V 'gKWPV&K, VP1V.4P3V4Ko VPP3V \ \V P54!4,4EK W nW@n\:P<P?V4.Vn Vf/MTVn!Wn"Wpn#R#\ VP44Vn/VnVP4FwppVFpVVPV&K K \VP44\\VP54!4,VnW nW@n\:P<P?V4.Vn Vf/MTVn!Wn"W0n#R#uup iuup p i \*\,3dT P)S4EKi;i)c3B"TFp\V\4xK R#5irr frozenset)rrXs& rr '_LazyModule.__init__..p sF5Ecz#y))5ETFrLc3,<"TF qS9xK R#5irrrrXr6s& rr rt sI#g~FBackend should be defined in the BACKENDS_MAPPING. Offending backend: N=<>)$rT__init___object_missing_backend_explicit_import_shortcutr"set_modules_class_to_module__all__itemsrrkeysrangecountrsplitrFrCrDrrGModuleNotFoundErrorrunion setdefaultextendvaluesr1__spec__r]rPdirname__path___objects_name_import_structure)selfrrfrgrhrirjrrrImissing_backendski module_keysr rrXrrr6rBs&&&&&&& @rr~_LazyModule.__init__b s\ ')$E])Ace& 3F5EF333F5EF F FEDM$&D !DL " $4$:$:$< #% ""\`agalalan\op\oWX% q@P:QR:QQXXc1-a00:QR\opq  (G"22&6w&? !3II333IIII&-g&6G'.';';H","hiphq r#9'zz,33G< * ($!% 3 3K @ #)<<>KC'9(//889s0(O$*!O O$# O*0O*O$*"PPc<\\SV` 44pVPFpW!9gK VP V4K V#r)rrT__dir__rrG)rresultattrrBs& rr_LazyModule.__dir__ s=ego'(LLD! d#! rc&<V^8dQhRS[RS[/#)rrr)rr )rrbs"rrro sUUUUrc aWP9dVPV,#WP9EdVPV,oRS9dVPR4'dV R2pW P9dlW P9d\VP VPV,4p\ W24p\ PRV RV RV R24\WV4V#!V3R lR \R 7pWn WP9dR V 2pM/VPV,pVPR 4'gR V 2pWvnTpEMWP9d1VP VPV,4p \ W4pEMWP49dVP V4pEMVPR4'd^VR R$p WP9dIVP VPV ,4p \ W4p\W V4\WV4V#VPR4'dVR R$p WP9d\ PRV RV R24WP9dqVPV ,o!V3R lR \R 7pWn VPV ,pVPR 4'dTMR V 2Vn\WV4V#VP VPV ,4p \ W4p\W V4\WV4V#R pVPR4'gVPR4'EdVPR4'dVR R$MTp ^RIHpW9EdVW,pVPP)RR4pV R2pV.pVP+4F1wppVVJgKVV 8wgKVV9gK VP-V4K3 VFpVVP9d`VP VPV,4p\ VV4pTp\VVV4V V8wd \W V4\WV4Mo\6P8P;R!4pV'dD\=VV4'd0\ VV4pTpV V8wd \W V4\WV4MKK Vf?VP@P+4F wppVV9gKVP V4pM Vf\#R"VP R#V 24h\WV4V# \d'p\ PRT RT 24R p?ELR p?ii;i \\ \"3EdpTPR4'EdTR R$p YP9d/TP TPT ,4p \ Y4p M-TP TPT,4p \ Y4p \Y T 4T pR p?L \Ed?R pTEfTPR4'EdTR R$p ^RIHpY9EdY,pTPP)RR4pT R2pT.pTP+4F1wppTTJgKTT 8wgKTT9gK TP-T4K3 ^R IpTEFCpR pTPR4'dhTR R%P14pRT RT 2pTP2!T4p \ T T4pM, \d\ PT RT R24Mi;iTfpTTP9d_TPT,pTP T4p\ TT4pM, \d\ PX RT R24Mi;iTf\ PRT 24EKTp\TTT4T T8wd \Y T4\YT4M3 M0 \d#p\ PRT 24R p?MR p?ii;iTf\RT R24XhR p?EL>i;i\RT R24ThR p?ii;i \\ 3dp\RT R24ThR p?ii;i \d'p\ PRT RT 24R p?ELR p?ii;i \d'p\ PRT RT 24R p?ELR p?ii;i \dEK=i;i \dEKPi;i \>\"3dELi;i)&rImageProcessorPil`z9` requires torchvision (not installed); falling back to `zY` for backward compatibility. Install torchvision to use the default backend, or import `z#` directly to silence this warning.zCould not load PIL fallback z: Nc:<a]tRtRtoZtV3RltRtRtVtR#),_LazyModule.__getattr__..Placeholderi c <\VS4R#rrKrr&r'rs&*,rr~5_LazyModule.__getattr__..Placeholder.__init__ s%d,<=rcR#rrrr&r's&*,rrR1_LazyModule.__getattr__..Placeholder.call srrN r@rZr[r\rVr~rRr^r_rbrs@r Placeholderr s, >rr) metaclass transformers. TokenizerFast)SLOW_TO_FAST_CONVERTERS ConverterrA Tokenizerztransformers.models.z.tokenization_z does not have z defined.z definedzskipping candidate z"Could not create tokenizer alias: zCould not import module 'z4'. Are this object's requirements defined correctly?zCould not load fallback ImageProcessorFastzO` is deprecated. The `Fast` suffix for image processors has been removed; use `z ` instead.c:<a]tRtRtoZtV3RltRtRtVtR#)ri c <\VS4R#rrrs&*,rr~r s 1$8H IrcR#rrrs&*,rrRr s $rrNrrs@rrr s(8IJ%%r transformerszmodule z has no attribute i)!rrendswithr _get_moduler8r9ryrnr\r:rMr@rSrZrrrconvert_slow_tokenizerrr"rrGr2r_r7rrrr$rrFr) rrpil_name pil_module pil_valueer module_namerrI fallback_name fb_modulefallback_value lookup_namerconverter_classconverter_base_namepreferred_tokenizer_namecandidate_namestokenizer_nametokenizer_converterr2candidate_namebase_tokenizer_class model_name module_pathalias_module_name alias_moduletransformers_modulerXrrs && @r __getattr___LazyModule.__getattr__ s == ==& & // /#;;DA   00T]]CS5T5T"V3<444IeIe9e U%)%5%5d6K6KH6U%V $+J$A ++v%^_g^hi**23VX  I6((   $( 000 -dV4 "33D9 "--o>>$1+"?K%0 "E ** *[ ))$*?*?*EF-v]] " ((.}}_-- $Sb  $9$99V$($4$4T5J5J=5Y$Z ' AU;E2$ }}122 $Sb  $9$99''D6" -j:%(D(DD ,0+G+G +V(%K%0=,&*&;&;M&J +6+A+A/+R+RKZghsgtXu$. K8**V$($4$4T5J5J=5Y$Z ' AU;E2$ E}}[))T]]?-K-K+/==+I+Id3Bit 8P#=*A*N />.F.F.N.N{\^._+6I5J)3T0,D*DCZC`C`Cb?N,?2oE.\gJg#1#H$3$:$:>$JDc />N-1F1FF !-373C3CDDYDYZhDi3jL;B$) !-:=++//.:Y$7':wGZ\j?k?k?FGZ\j?k(<0D+6.+H,3Du,M(/E(B(-@l':-/>F}#'#A#A#G#G#IKCv~ $ 0 0 5$J }$wt}}o=OPTv%VWWE" }%U 'CH:RPQs%STTU8(~FX ==11$("IMM%(,A,AA(,(8(89N9N}9](^I-4Y-NN%)%5%5d6K6KD6Q%RF-4V-KN^D .$D%!% =T]]?-K-K*.s)K8W \#.#I6M6ZO:I:R:R:Z:Z[fhj:k$7BUAVV_?`$<7O6POOfOlOlOn(K8K+>/+QVdhsVs/=_/T0?0F0F~0VPo %5:I?C(<,:+B+B;+O+O9G9M9S9S9UJ`=?&_( %`='_( (A`=9b :`=<b = a*a% b %a**b bb  bb!$c 5cc  c>c99c> d2 d--d25 eeee eeeee0/e0c <V^8dQhRS[/#)rrr)rrbs"rrro ssrc~\P!RV,VP4# \dpThRp?ii;i)rLN)r2r7r@r\)rrrs&& rr_LazyModule._get_module s8 **3+> 1 1$^b]c 1 dD DKK3006 'T" .tfF8*E FFrca]tRtRto]P t]Pt]Pt ]Pt ]Pt]Pt]V3RlRl4tRtVtR#)VersionComparisoni c$<V^8dQhRS[RR/#)rversion_stringrrr)rrbs"rrVersionComparison.__annotate__ s 2 2C 2,? 2rcR\PR\PR\PR\PR\PR\P R\P /pW,#)r{z==z!=r}r|z>=z<=)rEQUAL NOT_EQUAL GREATER_THAN LESS_THANGREATER_THAN_OR_EQUALLESS_THAN_OR_EQUAL)rstring_to_operators& r from_stringVersionComparison.from_string sk "(( #)) #-- "// ",, #99 #66 "11rrN)r@rZr[r\operatoreqrnergtrltrgerler staticmethodrr^r_rbs@rrr sO KKE I;;L I$KK! 2 2rrcPV^8dQhR\\\\3,/#rr)r-r)rs"rrr! s!SS%S# 2FSrcRp\P!W4pV'd3VP^4VP^4VP^43#\RV 24h)z#([a-zA-Z0-9_-]+)([!<>=~]+)([0-9.]+)z Invalid package version string: )rematchgroupr)package_version_strpatternrs& rsplit_package_versionr  sR4G HHW 2E  A A A??;O>O`d(e% $*;*;)<"$"3"3!44EdF]F]E^_c_k_k^lmL M r)rr rN) r@rZr[r\r~rrDrpropertyrEr^r_rs@rrCrC* sC  qq  rrCrcaa\V\\34'g \R4h\V4p.oVFoS\9dSP S4K!\ ;QJdV3RlR4F 'gK RM RM!V3RlR44'dSP \S44K}\RS 24h V3RlpV#)z This decorator enables two things: - Attaching a `__backends` tuple to an object to see what are the necessary backends for it to execute correctly without instantiating it - The '@requires' string is used to dynamically import objects z#Backends should be a tuple or list.c3,<"TF qS9xK R#5irrrws& rr requires..[ s=_c'>_rxTFryc<a\S\4'd SSnS#\P!S4VV3Rl4pSVnV#)c,<\SS4S!V/VB#rr)r&r'applied_backendsfuns*,rr+requires..inner_fn..wrapperg s c#3 4'' 'r)rr __backends functoolswraps)r(rr'sf rinner_fnrequires..inner_fn` sH c4 .CNJ   (  (.rrz) rr-r TypeErrorrFrGr"rCr)rr-r'r6s$ @@rrequiresr0J s h . .=>>XH & &  # #G ,s=_=sss=_=== ''(89 #ijqir!stt  Orc RV9#) modeling_rrcontents&&rr5s s +-rc>RV9;'dVPR4#) tokenization__fast)rr3s&&rr5r5t s/T1LLdmmG6LLrc&RV9;'dRV9#)image_processing_TorchvisionBackendrr3s&&rr5r5u s-5YY:NRY:YYrc RV9#)r:rr3s&&rr5r5z -5rc RV9#)video_processing_rr3s&&rr5r5{ r=rc RV9#) generation_rr3s&&rr5r5} s -4/rc:V^8dQhR\\,/#rr)rr)rs"rrr s''$s)'rcRV9d.#RpVP4p\V4F wr4VPR4'gKTpK" Vf.#W!RpV^,PR4'g \R4hV^,P R4'd\V^,P R4^,P R4P R4Uu.uFqUP R4NK up#.p\^\V44FHpW',P 4R8XdVu#VPW',P R 44KJ V#uupi) z Returns the content of the __all__ variable in the file content. Returns None if not defined, otherwise returns a list of strings. rNz`fetch__all__ accepts a list of lines, with the first line being the __all__ variable declaration]r{z [],z"' z"', ) splitlines enumeraterSrrrNstriprlenrG) file_content start_indexlinesr linerI_all__all__line_indexs& r fetch__all__rP s@  $ K  # # %E '  ??9 % %K(  , E 8  y ) ) n   Qx-21X^^C-@-C-I-I%-P-V-VWZ-[\-[c &!-[\\!&q#e*!5 '--/36  E4::7CD "6  ]sEc  /p\PPV4'd \PPV4p.p\P!V4;_uu_4pVFpVP R8XdKVP 4'd$\VP4WP &KOVP PR4'dKrVPVP 4K RRR4RV9dVPR4/pVEFpVPR4'gK\\PPW4RR7;_uu_4pVP4pRRR4VRRpRp ^p Rp \P!4FwrV !VX4'gKT p M \#4pRX9EdVP%R 4p\'V4EFwppVPR4'dVPR4'gK7R pRV 9EdCR pR V 9dV P%R 4^,P%R4^,P%R 4^,p\-\/TP%R4Uu.uFpT'gK TP1R4NK up44pMR W^,,9d.pWVFpR V9dVP%R4^,pRV9gRV9dPRV9d)VP3RVP%R444M VPVP1R44VP14R 8XgKM \-V4pMRp\5VV ,4pVV9d/VV&WeV,9d\#4VV,V&VPR4'gVPR4'gRpMuVPR4'd^M^pVVRP%R4^,P1R4pVV,V,P7V4VP7V4V'dEKTp Tp EK RV9gEKr\9V4FcpVV9gK \5V 4pVV9d/VV&WeV,9d\#4VV,V&VV,V,P7V4Ke EK /VCVCpV# +'giEL;i +'giEL;i \(d\+RT RT 24hi;iuupi) a This method takes the path to a file/a folder and returns the import structure. If a file is given, it will return the import structure of the parent folder. Import structures are designed to be digestible by `_LazyModule` objects. They are created from the __all__ definitions in each files as well as the `@require` decorators above methods and objects. The import structure allows explicit display of the required backends for a given object. These backends are specified in two ways: 1. Through their `@require`, if they are exported with that decorator. This `@require` decorator accepts a `backend` tuple kwarg mentioning which backends are required to run this object. 2. If an object is defined in a file with "default" backends, it will have, at a minimum, this backend specified. The default backends are defined according to the filename: - If a file is named like `modeling_*.py`, it will have a `torch` backend - If a file is named like `tokenization_*_fast.py`, it will have a `tokenizers` backend - If a file is named like `image_processing*_fast.py`, it will have a `torchvision` + `torch` backend Backends serve the purpose of displaying a clear error message to the user in case the backends are not installed. Should an object be imported without its required backends being in the environment, any attempt to use the object will raise an error mentioning which backend(s) should be added to the environment in order to use that object. Here's an example of an input import structure at the src.transformers.models level: { 'albert': { frozenset(): { 'configuration_albert': {'AlbertConfig'} }, frozenset({'tokenizers'}): { 'tokenization_albert_fast': {'AlbertTokenizer'} }, }, 'align': { frozenset(): { 'configuration_align': {'AlignConfig', 'AlignTextConfig', 'AlignVisionConfig'}, 'processing_align': {'AlignProcessor'} }, }, 'altclip': { frozenset(): { 'configuration_altclip': {'AltCLIPConfig', 'AltCLIPTextConfig', 'AltCLIPVisionConfig'}, 'processing_altclip': {'AltCLIPProcessor'}, } } } __pycache__N __init__.pyz.pyzutf-8)encodingrAz @requires )Frz backends=(z8Couldn't parse backends for @requires decorator in file :z, z'",r{"'c3B"TFqPR4xK R#5i)()"', N)rH)rr6s& rr 4create_import_structure_from_path..A s3u\tQXMM)4L4L\trur\classdefTr)convert_modular_r)  @rV)r]rPisfilerscandirris_dir!create_import_structure_from_pathrSrGremoveropenrHreadBASE_FILE_REQUIREMENTSrrrNrG IndexErrorrr-sortedrHrrsaddrP)rrgadjacent_modulesentriesentrymodule_requirementsrfrJ previous_lineprevious_indexbase_requirementscheck requirementsexported_objectsrLr rM skip_linebackends_stringbr backend_linerK object_name _all_objects& rriri sj ww~~k""ggook2  K GEzz]*||~~/PQVQ[Q[/\ ,ZZ**+CDD '' 3  !(( .' ##E**  "'',,{87 K Kq668LL"#2&   #9#?#?#A E[,//$0!$B5 , & &&t,E(/ t??#899$//R]B^B^ " -/ %I"]2.;.A.A+.Nq.Q.W.WX[.\]^._.e.efi.jkl.mO $)/J_J_`dJe0kJeQijJe0k)l#m"$ua-?'@@#%,1,GL)\9/;/A/A#/Fq/I "l2c\6I#'<#7$,OO3u\h\n\nos\t3u$u$,OOL4F4Fy4Q$R ,113s: %-H$)?$&(4E)EFH'::8:+H5"h*GGEHU+H5kB??733DOOE&>s&CA&F&L&LS&Q +H5kBFF{S(,,[9 y$(M%*NW 0^  $+L9 &66():;H'::8:+H5"h*GGEHU+H5kB'1+>BB;O :Y(lC-B1AB O ! *L K KR *","Z[fZgghivhw x#1ls>'.TATT.T$;AT8 U+U T! $ T5 8UcaaV3RloRV3RlloTp\^4F pS!V4pK /pVP4P4F)wrE\V\4'dWKS!V4W4&K+ V#)a This method takes as input an unordered import structure and brings the required backends at the top-level, aggregating modules and objects under their required backends. Here's an example of an input import structure at the src.transformers.models level: { 'albert': { frozenset(): { 'configuration_albert': {'AlbertConfig'} }, frozenset({'tokenizers'}): { 'tokenization_albert_fast': {'AlbertTokenizer'} }, }, 'align': { frozenset(): { 'configuration_align': {'AlignConfig', 'AlignTextConfig', 'AlignVisionConfig'}, 'processing_align': {'AlignProcessor'} }, }, 'altclip': { frozenset(): { 'configuration_altclip': {'AltCLIPConfig', 'AltCLIPTextConfig', 'AltCLIPVisionConfig'}, 'processing_altclip': {'AltCLIPProcessor'}, } } } Here's an example of an output import structure at the src.transformers.models level: { frozenset({'tokenizers'}): { 'albert.tokenization_albert_fast': {'AlbertTokenizer'} }, frozenset(): { 'albert.configuration_albert': {'AlbertConfig'}, 'align.processing_align': {'AlignProcessor'}, 'align.configuration_align': {'AlignConfig', 'AlignTextConfig', 'AlignVisionConfig'}, 'altclip.configuration_altclip': {'AltCLIPConfig', 'AltCLIPTextConfig', 'AltCLIPVisionConfig'}, 'altclip.processing_altclip': {'AltCLIPProcessor'} } } cd</pVP4EFwr#\V\4'gW1V&K"\;QJdRV4F 'gK RM RM !RV44'Ed1VP4EFwrE\V\4'dCWA9d/W&W!V,9d /W,V&W,V,P V4K^S !WE/4pVP4Fwrx\V\4'dCWq9d/W&W!V,9d /W,V&W,V,P V4K]W!9d/W&WqV,9d /W,V&W,V,P V4K EK EKS !V4W&EK V#)c3B"TFp\V\4xK R#5irrr)rvs& rr Gspread_import_structure..propagate_frozenset.. s>v!Z9--vruTF)rrr%r"rsupdate) unordered_import_structure frozenset_first_import_structure_key_valuerrpropagated_frozensetr_kr_vpropagate_frozensets & rr4spread_import_structure..propagate_frozenset s+-(6<<>LDfd++9?6>v>>v>>>"LLNDA!!Y//DBD<?'JJHJ<?E8;DAHHK0CA6/J,(<(B(B(DHC)$ ::#&#NLN$D$I#'PS/T#TRT$D$I$$O!A Ed K R RSV W#'#OMO$D$J#&t.T#TRT$D$J3$O!A Fs K R RSV W!)E%+J:MV9T06W?Z0/rc<.pVP4Fawr4VeV RV 2MTp\V\4'd(VPS!WC4P44KOVP W434Kc \V4#)NrL)rrr%rrG)_dict previous_keyrrr flatten_dicts&& rr-spread_import_structure..flatten_dict sr!KKMLD/;/Gl^1TF+TD&$'' \&7==?@ d^, * E{rr)rcopyrrr)nested_import_structureordered_import_structurerflattened_import_structurerXrrrs& @@rspread_import_structurerq s^/0b 71X#67O#P "$.335;;=  c3  (-.:5.A & + > &%rcJV^8dQhR\R\R,R\/#)rrprefixNr)rrk)rs"rrr s&cDjL^rc\V4p\V4pVfV#VP4UUUUu/uF/wrEYEP4UUu/uF wrgV RV 2VbK uppbK1 pppppV#uuppiuuppppi)aq This method takes a module_path as input and creates an import structure digestible by a _LazyModule. Here's an example of an output import structure at the src.transformers.models level: { frozenset({'tokenizers'}): { 'albert.tokenization_albert_fast': {'AlbertTokenizer'} }, frozenset(): { 'albert.configuration_albert': {'AlbertConfig'}, 'align.processing_align': {'AlignProcessor'}, 'align.configuration_align': {'AlignConfig', 'AlignTextConfig', 'AlignVisionConfig'}, 'altclip.configuration_altclip': {'AltCLIPConfig', 'AltCLIPTextConfig', 'AltCLIPVisionConfig'}, 'altclip.processing_altclip': {'AltCLIPProcessor'} } } The import structure is a dict defined with frozensets as keys, and dicts of strings to sets of objects. If `prefix` is not None, it will add that prefix to all keys in the returned dict. rL)rirr)rrrg spread_dictrrkkvvs&& rdefine_import_structurer s09E)*:;K ~U`UfUfUhiUhTQqggiHiFBfXQrd+R/iHHUh iIisA4 A.A4 .A4 cV^8dQhRR/#rr)rs"rrr s&&D&rc\PUu.uFqPR4'gKVNK ppVFHp\PV,p\V\4'd/Vn\PVKJ R\P9dM\PR,p\V\4'd/Vn\ P!V4R#R#uupi)z Clear cached Transformers modules to allow reloading modified code. This is useful when actively developing/modifying Transformers code. rrN)rrrSrrdrr2reload)mod_nametransformers_modulesrI main_modules rclear_import_cacher s69[[i[DWDWXgDhHH[i)X& fk * * FO KK ! )$kk.1 k; / /#%K % %js C)C))F>rXONYESTRUEr)FF)T)rSrrr;)r<rur)r<(7r]r+importlib.machineryr2importlib.metadataimportlib.utilr'rr]rrrrr collectionsrcollections.abcrenumrr itertoolsrtypesrtypingr packaging.versionrzr rAr get_loggerr@r9r5packages_distributionsr#r)r@rGrQrarhrrENV_VARS_TRUE_AND_AUTO_VALUESrr$upperrjACCELERATE_MIN_VERSIONBITSANDBYTES_MIN_VERSIONSCHEDULEFREE_MIN_VERSIONFSDP_MIN_VERSIONGGUF_MIN_VERSIONXLA_FSDPV2_MIN_VERSIONHQQ_MIN_VERSIONVPTQ_MIN_VERSIONTORCHAO_MIN_VERSIONCOMPRESSED_TENSORS_MIN_VERSIONAUTOROUND_MIN_VERSIONTRITON_MIN_VERSIONKERNELS_MIN_VERSIONKERNELS_MAX_VERSIONMISTRAL_COMMON_MIN_VERSIONrprrrrrrrrrrrrrrrrrrrIrNrSrcrgrnr|rrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrr#r'r+r/r4r8r=rCrGrKrOrTrXr\rarerhrlrprvrzr~rrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrr r%r)r-r1r5r8r=rrErIrMrQrUrYr]rarerirprtryr|rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr r+r3r7AV_IMPORT_ERRORYT_DLP_IMPORT_ERRORDECORD_IMPORT_ERRORTORCHCODEC_IMPORT_ERRORCV2_IMPORT_ERRORDATASETS_IMPORT_ERRORTOKENIZERS_IMPORT_ERRORSENTENCEPIECE_IMPORT_ERRORPROTOBUF_IMPORT_ERRORFAISS_IMPORT_ERRORPYTORCH_IMPORT_ERRORTORCHVISION_IMPORT_ERRORBS4_IMPORT_ERRORSKLEARN_IMPORT_ERRORDETECTRON2_IMPORT_ERRORLEVENSHTEIN_IMPORT_ERRORG2P_EN_IMPORT_ERROR!PYTORCH_QUANTIZATION_IMPORT_ERRORTORCHAUDIO_IMPORT_ERRORPANDAS_IMPORT_ERRORPHONEMIZER_IMPORT_ERRORUROMAN_IMPORT_ERRORSACREMOSES_IMPORT_ERRORSCIPY_IMPORT_ERRORSPEECH_IMPORT_ERRORTIMM_IMPORT_ERRORNATTEN_IMPORT_ERRORNUMEXPR_IMPORT_ERRORNLTK_IMPORT_ERRORVISION_IMPORT_ERRORPYDANTIC_IMPORT_ERRORFASTAPI_IMPORT_ERRORUVICORN_IMPORT_ERROROPENAI_IMPORT_ERRORPYTESSERACT_IMPORT_ERRORPYCTCDECODE_IMPORT_ERRORACCELERATE_IMPORT_ERRORESSENTIA_IMPORT_ERRORLIBROSA_IMPORT_ERRORDIFFUSERS_IMPORT_ERRORSOUNDFILE_IMPORT_ERRORPRETTY_MIDI_IMPORT_ERRORCYTHON_IMPORT_ERRORRJIEBA_IMPORT_ERRORPEFT_IMPORT_ERRORJINJA_IMPORT_ERRORRICH_IMPORT_ERRORMISTRAL_COMMON_IMPORT_ERRORrFrKrrMrsr BACKENDS_Tr%rrkrd BaseExceptionrrrr rCr0rmrPrirrrrrrrs   #$   H % )11HHJ+&$$::W W 2 4 : :F8 D 4::<  #" !)%$       T  T  T  T     , ,   "? "?J   J J     > >( > >0  0 @ @2  * \ \~ D D* > >&  :  4  (  & 5 50 a a a a - - ,?Tg+ + + + . . . . /E\ \ +=X X  ? ? (7U U  0 0 f f & & P P 4 4 4 4 . . 2 2 1 1 1I^ ^  3 3 / / . . . . 1 1 0 0 0 0 / / / / . . s s 3 3 O O u u    S S F F H H , , M M + + 3 3 , , 2 2 b b 2 2 S S  . . R R h h 0 0     1 1 . . . . / / 2 2 , , , , )9V V  * * . . 2 2     1I^ ^   <  4  6  6     3 3 L L  N  N  2 2 - - 0 0 - - / / 5 5 - - )9V V  ^ ^ )9e e / / + + /D\\ \  Q Q R R  V V  U U  7Udd d  ) ) 1 1 2 2 3 3 Q Q 2 2   M M . . N N - - < < . . 1 1 _ _ . . , , X X K K ,?YY Y % %  2 2 2 2 . . 1 1 W W  V V 1 1 . . + + 1 1 JJ J  Z Z  , , 2 2 3M  . .   G G8  cm0:0:f ; ;  ( 5 5550. $    %!                    0 120 !#3450 !#3450 +-BCD 0 ')<=> 0 /1HIJ 0 -/EFG0 +-BCD0 %'9:;0 ')<=>0 ')<=>0 /1HIJ0 ')<=>0 13KLM0 13KLM0 )+?@A!0" -/EFG#0$ +-BCD%0& 13KLM'0( 13KLM)0* /1HIJ+0, "CEf!gh-0. 57QRS/00 )+?@A102 ')<=>304 #%678506 /1HIJ708 ')<=>90: #%678;0< /1HIJ=0> %';<=?0@ 13KLMA0B /1HIJC0D ')<=>E0F %'9:;G0H /1HIJI0J ')<=>K0L ')<=>M0N #%678O0P %'9:;Q0R ')<=>S0T #%678U0V +-BCDW0X )+?@AY0Z )+?@A[0\ ')<=>]0^ 79TUV_02j+D .$ .s^ *d3C=&99:RU*RUj [][GG*22. S S  @%%R.zLoY\ 6{57Y/ ''T B BJ{&|  B&&r