+ "ݳja0t$^RIHt^RIt^RIt^RIt^RIt^RIt^RIt^RI t ^RI t ^RI t ^RI t ^RI t ^RIt^RIt^RIHt^RIHt^RIHt^RIHtHtHt^RIt^RIt^RIHtHtH t H!t!^RI"H#t#^R I$H%t%^R I&H't']PP!])4t*] PV!4t,Rs-R ].R &R s/Rs0Rs1],t2R s3Rt4^dt5Rt6]Pn!R]PpPrR7t:]Pn!R]PpPrR7t;]Pn!R4t<]Pn!R4t=]Pn!R4t>]Pn!R4t?]Pn!R4t@]Pn!R4tA] PV!4tBRsCR].R&RtDRtERtF]G!R4tHRtIRtJRtKRtLR R!ltMR"R#ltNR$R%ltOR&R'ltPR(R)ltQR*R+ltRR,R-ltSR.R/ltTR0R1ltUR2R3ltVR4R5ltWR6R7ltXR8]5/R9R:lltYR;R<ltZR=R>lt[!R?R@4t\RARBlt]RCRDlt^]RERFl4t_RGRHlt`]!]a4P4P^,tdRIRJlte]!RRK7RLRMl4tfRNROltgRPRQlthRRRSltiRTRUltjRVRWltkRXR/RYRZlltl]Pn!R[4tmR\R]ltnR^R_ltoR`RaltpRbRcltqRdReltr]RfRg/RhRill4tsRjRklttRlRmltuRnRoltvRRqRrlltwRsRtltxRuRpRvR RwRg/RxRylltyRuRpRvR RwRgRzR R{RgR|R R}RgR~R RR RR/ RRlltz!RR4t{RRlt|RRlt}RRlt~RRltRRltRR /RRlltRR /RRlltR# ]dRtEL$i;i)) annotationsN)contextmanager) lru_cache)Path)CallableOptionalSequence) CUDA_HOME_get_build_directory_get_cuda_arch_flagsload)env_flag) get_jit_compile_baseline_seconds) setup_loggerzOptional[bool]_PACK_BLOCK_EXTENSIONF?z$^\s*#\s*include\s+([<"])([^">]+)[">])flagsz"^\s*#\s*include\s+[<"]([^">]+)[">]z^(?:cpu|cu\d+|rocm[\d.]+|xpu)$z//[^\n]*|/\*[\s\S]*?\*/z&\b(?:Py[A-Z]\w*|PYBIND11_\w+)\b|\bpy::z(?m)\bREGISTER_EXTENSION\s*\(z'\bSTABLE_TORCH_LIBRARY(?:_[A-Z]+)?\s*\(zrelease\s+(\d+)\.(\d+)tuple[int, int] | None_NVCC_VERSION_CACHE8GPTQMODEL_KERNEL_REBUILDGPTQMODEL_TORCH_EXTENSIONS_DIR GPTQMODEL_TORCH_OPS_LOCK_TIMEOUTg@g?cV^8dQhRR/#returnstr)formats"T/home/luca/screen-checking/.venv/lib/python3.14/site-packages/gptqmodel/utils/cpp.py __annotate__r"^s f f fc \P!R4pV'd \V4#R\PP R\PP \\RR4 2#)z2Return the interpreter's extension-module ABI tag.SOABIzcpython-.abiflags) sysconfigget_config_varrsys version_infomajorminorgetattr)soabis r!_python_abi_tagr1^s`  $ $W -E 5zc&&,,-Qs/?/?/E/E.FwsT^`bGcFd eer#cV^8dQhRR/#rr)r s"r!r"r"js#r#c\PpVPR4wrpV'd\P V4'dV#V#)zHReturn torch.__version__ with only accelerator-wheel local tags removed.+)torch __version__ partition$_TORCH_ACCELERATOR_LOCAL_TAG_PATTERNmatch)versionpublicseplocals r!_torch_cpu_cache_versionr>jsBG **3/F 399%@@ Nr#c$V^8dQhRRRRRR/#)rr-intr.rrr)r s"r!r"r"ts!>>#>c>c>r#c`\V4^8,\V4^0,,pRVR 2#)zLReturn the stable-ABI target define for a minimum torch major/minor version.z-DTORCH_TARGET_VERSION=0x016Xr@)r-r.encoded_versions&& r!torch_stable_abi_target_definerEts05zR'CJ",<=O &t&< ==r#c V^8dQhRRRR/#rr Sequence[str]r list[str]r)r s"r!r"r"{sm r#c.pRpVFLpV'dRpKV\9dRpKVP\4'dK;VPV4KN V#)zDDrop NVCC scheduling knobs that cannot change generated device code.FT)'_CUDA_BUILD_SCHEDULING_FLAGS_WITH_VALUE startswith$_CUDA_BUILD_SCHEDULING_FLAG_PREFIXESappend)rrelevant skip_valueflags& r!_cuda_cache_relevant_flagsrR{sZHJ J  : :J  ??? @ @  Or#c$V^8dQhRRRRRR/#)rreasonr target_pathz str | PathrNoner)r s"r!r"r"s!:$r#cRP\P!^ R74p\P RV\ P !4VV4R#)r()limitz8[jit-cache-clear] reason=%s pid=%s path=%s callstack: %sN)join traceback format_stacklogwarningosgetpid)rTrU stack_texts$$ r!_log_cache_clear_callsiteras<//b9:JKKD  r#cV^8dQhRR/#)rr Optional[str]r)r s"r!r"r"sMr#c@\'dM\PP\RR4p\PP V4'dV#\ P !R4pV'dV#RFvp\PPV4pV'gK,\PPVRR4p\PP V4'gKtVu# Rp\PP V4'dV#R#)binnvccz/usr/local/cuda/bin/nvccN)r CUDAHOME) r r^pathrYisfileshutilwhichenvironget) candidaterhenvhomes r! _nvcc_pathrqsyGGLLE6: 77>>) $ $  << D  (zz~~c" 4 T5&9Iww~~i((  ) +I ww~~i   r#c V^8dQhRRRR/#)rargsrrr)r s"r!r"r"sJJcJcJr#c\4pV'gR#\P!V.VORRRR7pTP;'gRR,TP ;'gR,P 4# \dR#i;i)r(TF)capture_outputtextcheck )rq subprocessrunOSErrorstdoutstderrstrip)rs nvcc_pathresults* r! _nvcc_textrs} I      ]] bD (FMM,?,?R @ G G II sA99 BBcV^8dQhRR/#)rrtuple[int, int]r)r s"r!r"r"s # # #r#cV\;_uu_4\e\uuRRR4#\R4p\P V4pV'd6\ VP ^44\ VP ^443sMRs\uuRRR4# +'giR#;i)Nz --versionrr)_NVCC_VERSION_LOCKrr_NVCC_RELEASE_PATTERNsearchr@group) version_textr9s r! _nvcc_versionrsw    *&  "+. %,,\: #&u{{1~#6EKKN8K"L "( "    sBA$B B( c$V^8dQhRRRRRR/#)rr-r@r.rboolr)r s"r!r"r"s!---S-T-r#c\4W38#N)r)r-r.s&&r!nvcc_version_at_leastrs ?un ,,r#cV^8dQhRR/#rrrr)r s"r!r"r"s((D(r#c\^ ^4#)z@Return whether nvcc is new enough for required JIT kernel flags.)rrr#r!is_nvcc_compatiblers !Q ''r#c V^8dQhRRRR/#)rsecondsfloatrrr)r s"r!r"r"s##e##r#cR\R\V44pVR8dVR R2#VR R2#)zDFormat one duration compactly for user-facing compile progress text.g$@z.1fs.0f)maxr)r seconds_values& r! _format_compile_duration_secondsrs<U7^,Mt$A&&C  ""r#c$V^8dQhRRRRRR/#)relapsed_secondsrbaseline_secondsrr)r s"r!r"r"s" 1 1U 1e 1PU 1r#cV\\V4R4p\\V4R4pVR8:gVR8:dR#W28:d\RW2, ,R4#W2, pR\P!V)\VR4, 4, p\RRV,,R4#)zMMap elapsed compile time onto a progress ratio that never reaches 100% early.rgffffff?rg{Gz?gGz?)rrminmathexp)rrbaselineelapsedoverrun tail_ratios&& r!_compile_progress_ratiors5)*C0H%(#.G3'S.47-.55 Gtxx3x+= =>>J ttj()4 00r# total_stepsc(V^8dQhRRRRRRRR/#)rrrrrr@rr)r s"r!r"r"s6 T T T T T  Tr#c V^8:d^#\W4p\^\V^, \\P !W2^, ,4444#)zFConvert one elapsed/baseline pair into a bounded manual progress step.)rrrr@rfloor)rrrratios&&$ r!_compile_progress_steprsFa #O FE q#kAos4::eQ6O+P'QR SSr#c$V^8dQhRRRRRR/#)rrrrrrr)r s"r!r"r"s"SVr#c \\V4R4p\\V4R4pVR8:dR\V4 2#W#8:dR\V4 R\V4 2#R\V4 R\V4 R\W#, 4 R2#)zFDescribe compile elapsed time against the recorded reference baseline.rzelapsed z / estimated ~z (+))rrr)rrrrs&& r!_compile_progress_subtitlers%(#.G5)*C0H3:7CDEE7@AB:8DE G 3G<=>6x@AB -g.@ A B! Er#c$V^8dQhRRRRRR/#)rrrrOptional[float]rrr)r s"r!r"r"s' G Gu G G\_ Gr#c\V4pVeV^8:dRV 2#\V4pW, p\\V44p\V4R8d RV RV R2#V^8dRMRpRV RV RV V R2#)zCFormat a concise compile-vs-baseline summary for durable log lines.zin 皙?z (estimated ~rr4-, )rabs)rrrrdelta delta_textsigns&& r!_compile_baseline_summaryrs/?G#3q#8WI/0@AH  .E1#e*=J 5zDWI]8*A661*3#D  xj4& A FFr#c^]tRtRtRtRRltRRltRRltR R ltR R /R Rllt Rt R #)_CompileProgressDisplayi"zCRender either a baseline-backed progress bar or a fallback spinner.c$V^8dQhRRRRRR/#)rtitlerrrrrVr)r s"r!r"$_CompileProgressDisplay.__annotate__%s*## # * #  #r#c 0WnW nVeV^8:dRM \V4Vn\P !4VnRVnRVnRVn RVn \P!4Vn RVnVPfVPV\ R7Vn R#VP#\%\&44P)4P+RR7pVP-V4VP/\1RVP44VP3RR7W@n \P4!4Vn\P6!VP8RV 2RR7VnVPP;4R#) NF)rinterval)show_left_stepsrTforcezjit-compile-progress-)targetnamedaemon)_logger_titler_baseline_secondstime perf_counter_started _stop_event_thread _progress_spinner threadingLock _render_lock_closedspinner"_COMPILE_PROGRESS_INTERVAL_SECONDSpbrange_COMPILE_PROGRESS_TOTAL_STEPSmanualsetrsubtitlerdrawEventThread _refresh_loopstart)selfloggerrrprogresss&$$$ r!__init__ _CompileProgressDisplay.__init__%sG  $,0@A0ED5QaKb ))+ 6:37  %NN,  ! ! )"NNAcNdDM 99U#@ABIIKOO`eOfu4S$:P:PQR D !!$??, ''%%(0  r#cV^8dQhRR/#rrrr)r s"r!r"rJs===r#c b\R\P!4VP, 4#)r)rrrrrs&r!r'_CompileProgressDisplay.elapsed_secondsJs!3))+dmm;<> !T%;%;%C  <<<     ||| **,G/EgOeOe/fDNN , NN # #$>wH^H^$_ ` NN  e  ,    sC-%A>C-- C> rNc$V^8dQhRRRRRR/#)r succeededrrrrrVr)r s"r!r"r_s",,$,,TX,r#c nVfVP4M\R\V44pVPeVPP 4R#VP eVP P 4VPeVPfR#RVn VP;_uu_4V'd\M\W0P4VPn VPP\W0P44VPP!RR7VPP 4RRR4VP"eAVP"P%4'dVP"P'RR7R#R#R# +'giL`;i)NrTrr)timeout)rrrrcloserrrrrrrrrrrrris_aliverY)rrrrs&$$ r!r_CompileProgressDisplay.close_s=,;,C$&&(SRWXgRhIi == $ MM   !     '    " >> !T%;%;%C     1:-@VW^`v`v@w NN , NN # #$>wH^H^$_ ` NN  d  + NN "  << # (=(=(?(? LL  d  +)@ # s 5BF$$ F4 ) rrrrrrrrrr) __name__ __module__ __qualname____firstlineno____doc__rrrrr__static_attributes__rr#r!rr"s+M#J=, -,4,,r#rc V^8dQhRRRR/#)rsubdirrrrr)r s"r!r"r"wsNNNNr#c\P!\4pV'd!\V4P 4V, #\P !4R, R, R, V, #)zCReturn the default on-disk cache root for torch.ops JIT extensions.z.cache gptqmodeltorch_extensions)r^getenv_TORCH_OPS_BUILD_ROOT_ENVr expanduserrp)r  override_roots& r!default_torch_ops_build_rootrwsPII78MM"--/&88 99; !K /2D Dv MMr#cV^8dQhRR/#rr)r s"r!r"r"s < >#c#&?? > GU]]U]]%BC    GU]]3  >>>#x/ <= >     GU]]3   sA1G4'E=(_system_include_roots..s0`I_AT!W'')111??I_68z1 f PRU`d eef d NPS^b ccd k UWZei jjk k UWZei jjks_#DAD7; E' F D4D//D47 E$EE$' F2FF G"GGc V^8dQhRRRR/#)r include_namerrrr)r s"r!r"r"s#$r#cf\4F"pW, P4'gK!R# R#)aReturn True if *include_name* names a system/dependency header. The check is conservative: only headers that actually exist under a known system include directory (torch, Python, CUDA, etc.) are skipped. This lets legitimate local angle-bracket headers (e.g. ```` under an extension-specific include root) still be hashed while preventing files dropped by unrelated kernels (e.g. ``gptqmodel_ext/torch/all.h``) from leaking into an extension's cache key. TF)rdis_file)rfrcs& r!_is_system_or_dependency_headerris+&'   ( ( * *( r#cV^8dQhRR/#rrrIr)r s"r!r"r"//9/r#c^RIp.p\TR.4Fp\T4p\ TP R44pTP TP R44\T4F5pTP4'gKTP\T44K7 K \T4# \d.u#i;i)zADiscover CUDA developer headers shipped via NVIDIA Python wheels.N__path__z cu*/includez */include) nvidiarZr/rlistglobrYsortedis_dirrNrr:)rorH base_text base_pathcandidate_pathsrns r!r^r^s "MVZ4 O y~~m<=y~~k:;0I!!$$S^41 5 ..  sB00 C?Cc(V^8dQhRRRRRRRR/#) rrfrincluding_pathrinclude_search_rootszSequence[Path]rOptional[Path]r)r s"r!r"r",s2)   r#cP\V4P4pVP4'd-VPRR7pVP 4'dV#R#VP .VOpVF5pWc, PRR7pVP 4'gK3Vu# R#)zUResolve one quoted local include against the current file and explicit include roots.Fr=N)rr is_absoluter?existsr")rfrxry include_pathresolved search_rootsrcrns&$$ r!_resolve_local_include_pathr,s %002L!!''u'5#??,,x6$6"))A,@AL(111?       r#cV^8dQhRR/#rkr)r s"r!r"r"Arlr#c.p\'dU\\4P4R, pVP4'dVP \ V44\ P!R4pV'dQ\V4P4R, pVP4'dVP \ V44\V4#)zCDiscover CUDA developer headers from the active local CUDA toolkit.rT CUDA_PATH) r rrrsrNrr^rr:)rHrn cuda_paths r!r]r]As "MyO..09<       Y 0 +&IO..09<       Y 0  ..r#c V^8dQhRRRR/#)rrequired_header_namesrHrrr)r s"r!r"r"Ts  ] W[ r#ca\4oS'gR#\;QJdV3RlV4F 'dK R# R#!V3RlV44#)zMReturn whether the detected local CUDA toolkit exposes every required header.Fc3<a"TF?o\;QJdV3RlS4F 'gK RM RM!V3RlS44xKA R#5i)c3d<"TF%p\V4S, P4xK' R#5ir)rrh)rMr~ header_names& r!rOF_detected_local_cuda_has_required_headers...[s) fMe\T, + - 6 6 8 8Mes-0TFN)any)rMrlocal_cuda_include_pathss&@r!rO<_detected_local_cuda_has_required_headers..Zs80K  fMe f fMe fff0sA A  A T)r]all)rrs&@r!)_detected_local_cuda_has_required_headersrTsP AB # 3033330 r#rc$V^8dQhRRRRRR/#)rrHrHrrrIr)r s"r!r"r"`s( 8 8  8) 8 8r#c\V4p\V4'gVP\44\V4#)zPAppend NVIDIA wheel headers when the local CUDA toolkit is absent or incomplete.)r:rrYr^)rHrresolved_include_pathss&$ r! cuda_include_paths_with_fallbackr`s92-@ 45J K K%%&G&IJ  6 77r#z*^(?P\d+)\.(?P\d+)(?:\+PTX)?$cV^8dQhRR/#)rrzlist[tuple[int, int]]r)r s"r!r"r"ps  $9 r#c\4p\\PRR4!4Fp\ V\ 4'dVP R4'gK2VPR^4^,PR4pVP4'd\V4^8dKVP\VRR4\VR,434K \V4#) get_arch_listc.#rrrr#r!,_supported_cuda_arch_pairs..rsRr#sm__afN)rr/r5cuda isinstancerrLsplitrstripisdigitlenr5r@rr)pairsarchsms r!_supported_cuda_arch_pairsrps"%%E OZ@B$$$DOOE,B,B  ZZQ  " ) )$ /zz||s2w{  3r#2w<RV-. C %=r#c V^8dQhRRRR/#)r capabilityrrr)r s"r!r"r"|s+++?+r#cT\4pV'gV#\\V4V4#r)rrr)r supporteds& r!_clamp_visible_cuda_capabilityr|s$*,I  s9~z **r#cV^8dQhRR/#rkr)r s"r!r"r"s  9 r#c|\PP4'g.#.p\4p\ \PP 44F^p\ \PPV44wr4V RV 2pWQ9gK<VPV4VPV4K` V#)r&) r5r is_availablerr device_countrget_device_capabilityr5rN)tokensr7 device_indexr-r.tokens r!_visible_cuda_arch_tokensrs :: " " $ $ FUDejj5578 5ejj6V6VWc6de '5'"   HHUO MM% 9 Mr#c V^8dQhRRRR/#)r raw_overriderrr)r s"r!r"r"s&&c&c&r#c  .p\4p\P!RVP44FpV'gK VP V4\ P V4pV'gK=VP\VPR44 R\VPR44 24K \4F-pW29gK VP V4VPV4K/ RPV4#)z[;\s,]+r-r&r.;) rpcrerr~rN_CUDA_ARCH_TOKEN_REr9r5r@rrrY)rrequested_tokensrequested_basesrr9s& r!+_merge_cuda_arch_override_with_visible_capsrs"$ #OJ (:(:(<= &#))%0 5   3u{{7';#<"=Qs5;;wCW?X>Y Z [ >+,  '  # #E *    &- 88$ %%r#c V^8dQhRRRR/#)rmerge_visible_capsrrrIr)r s"r!r"r"sdyr#cb\P!R4pV'dTV'dL\V4pW!8wd;V\PR&\ \ 44V\PR&#\ \ 44# T\PR&i;i \ d.u#i;i)CReturn the effective NVCC arch flags Torch will emit for this host.TORCH_CUDA_ARCH_LIST)r^rrrlrpr rZ)roverridemerged_overrides$ r!_effective_cuda_arch_flagsrsyy/0H  *I(SO*5D 12B 4 679ABJJ56(*++:BBJJ56  s9BB$B BB3BBB B.-B.enabledTcV^8dQhRR/#)rrrr)r s"r!r"r"s66T6r#c#"\P!R4pV'd V'gRxR#\V4pW!8XdRxR#V\PR&RxV\PR&R# T\PR&i;i5i)zITemporarily include the visible CUDA capability in manual arch overrides.rN)r^rrrl)rrrs$ r!$_temporary_merged_cuda_arch_overriderslyy/0H ( A(KO" )8BJJ%&6 -5 )*X )*s"&B 0B A3B 3BB cV^8dQhRR/#rkr)r s"r!r"r"s??)?r#c\RR7#)rTr)rrr#r!resolved_cuda_arch_flagsrs & >>r#cV^8dQhRR/#)rrr@r)r s"r!r"r"s??c?r#cJ\\\PR^44#)zIReturn the ABI mode local JIT extensions must match for this torch build._GLIBCXX_USE_CXX11_ABI)r@r/r5_Crr#r!torch_cxx11_abi_flagrs wuxx!91= >>r#cV^8dQhRR/#rr)r s"r!r"r"s@@@r#cR\4 2#)zFReturn the compiler define that keeps local extensions ABI-compatible.z-D_GLIBCXX_USE_CXX11_ABI=)rrr#r!torch_cxx11_abi_definers'';'=&> ??r#O3c V^8dQhRRRR/#)r opt_level str | Nonerr)r s"r!r"r"sjJr#c*\P!R4pVeTMTpVfR#\V4P4pV'gR#VP R4'd VR,pVP 4pVR9dR#VR9dV#\ R4h)zOResolve the effective JIT optimization level, honoring the global env override.GPTQMODEL_NVCC_COMPILE_LEVELNrNNzJGPTQMODEL_NVCC_COMPILE_LEVEL must be one of O0/O1/O2/O3 or NONE/NOOPT/OFF.>0OFFNONENOOPTNO_OPTDISABLE>O0O1O2r)r^rrr~rLupperr)rr raw_levelr9s& r!resolved_jit_opt_levelrsyy78H$0iIY%%'J S!!^ !!#JGG-- T r#cV^8dQhRR/#rr)r s"r!r"r"s  3 r#c^RIpVPR\P4p\ VP ^44V'd\ VP ^44MRr2W#3R8dR#R# \ dR#i;i)zBReturn the C++ standard required by the installed PyTorch headers.Nz (\d+)\.(\d+)zc++20zc++17r)r)rer9r5r6r@rrZ)rr9r-r.s r!_jit_cxx_standardrsk%*;*;<5;;q>*5C A,?fu .G3w@@ sA*A/-A// A>=A>r enable_bf16 include_abic(V^8dQhRRRRRRRR/#)rrrrrrrrIr)r s"r!r"r"s2   r#c\V4pR\4 2.pVeVP^RV 24V'dVPR4V'dVP\ 44V#)zBReturn the common C++ compiler flags for torch.ops JIT extensions.-std=rz -DENABLE_BF16)rrinsertrNr)rrrresolved_opt_levelrs$$$ r!default_jit_cflagsrsg0 :&() * +E% Q!./01 _% +-. Lr#include_lineinfoinclude_nvcc_threadsinclude_ptxas_optimizationsinclude_ptxas_verbosityinclude_fatbin_compressioninclude_diag_suppress nvcc_threadscDV^8dQhRRRRRRRRRRRRR RR RR RR R RR/ #)rrrrrrrrrrrrrzstr | int | NonerrIr)r s"r!r"r"sx**** *  *  *"&*"*!%* *#**r#c \V4p \V VVR7p V'dxV e \V 4M\P!R\ 4p V P RV .4V e7V PR4'd V R,MT p V PRV 24V'dYV'dR.M.pV eVPRV 24VPR 4V P R R PV4.4V'dV PR 4V'dV P R R.4V'dV PR4V #)z?Return the common NVCC flags for torch.ops JIT CUDA extensions.)rrr NVCC_THREADS --threadsOrz --optimize=z-vrz-dlcm=caz-Xptxas,z -lineinfoz-Xfatbinz -compress-allz-diag-suppress=179,39,177) rrrr^r_DEFAULT_NVCC_THREADSrYrLrNrY)rrrrrrrrrrrrresolved_nvcc_threadsoptimization_level ptxas_flagss$$$$$$$$$$ r!default_jit_cuda_cflagsr s,0 : $ E 5A5ML 1SUS\S\]knCTD k#89:  )*<*G*G*L*L"2&Rd  LL;'9&:; <" 7tfR  )   #5"67 8:& i+!678 [!! j/23 01 Lr#c]tRtRtRtRRRRRRRRRRR RR R R R RRRRRRRR/ RRllt]RRl4tRRltRRlt RRlt RRlt RRlt R R!lt R"R#ltR$R%ltR&R'ltR(R)ltR*R+ltR,R-ltR.R/ltR0R1ltR2R3ltR4R5ltR6R7ltR8R9ltR:R;ltR<R=ltR>R?ltR@RAltRBRCltRDREltRFRGlt RHRIlt!RJRKlt"RLRMlt#RNROlt$RPRQlt%RRRSlt&RTt'R#)UTorchOpsJitExtensioniCzHManage one torch.ops JIT extension with shared cache and rebuild policy. extra_cflagsNextra_cuda_cflagsextra_include_paths extra_ldflagsforce_rebuild_env verbose_env requires_cudaF merge_visible_cuda_arch_overrideT binary_namespython_abi_dependenttorch_stable_abi_targetprebuilt_library_envc(hV^8dQhRRRRRRRRRR R R R RR RRRRRRRRR RR RRRRRRRRRRRR RR/#) rrr namespace required_opsrHsourcesz+Sequence[str] | Callable[[], Sequence[str]]build_root_envrcdefault_build_root%Path | str | Callable[[], Path | str] display_namer5Optional[Sequence[str] | Callable[[], Sequence[str]]]rrrrrrrrrzOptional[Sequence[str]]rz bool | NonerrrrrVr)r s"r!r"!TorchOpsJitExtension.__annotate__Fs5-5-5- 5- $ 5- = 5-&5-B5-5-L5-Q5-S5-M5-)5-#5- !5-"+/#5-$.%5-&*'5-("8)5-*,+5-, -5-r#c (WnW n\V4VnW@nWPnW`nWpnWnWn Wn Wn Wn Wn \V4Vn\V4Vn\T;'gV34VnVVnV'd \V4MRVnVVn\+V4VnRVnRVnRVnRVnRVn/Vn/VnVP=4VnR#)NFr() rrr_rrrrr!rrrrrrrrrrrrrrcompile_baseline_seconds_load_attempted _load_result _last_error_loaded_prebuilt_library_namespace_cache _op_cache_source_abi_detection_cache_get_shared_lock_lock)rrrrrrrr!rrrrrrrrrrrrs&$$$$$$$$$$$$$$$$$$$r!rTorchOpsJitExtension.__init__Fs. "!,/ ,"4((!2#6 *!2&!-0045U0V-!,"9"94':$8!I`u-D'Efj$$8!(H(N%$!8<%26,.  (**, r#cV^8dQhRR/#)rrzthreading.Lockr)r s"r!r"r#~s###r#c \#)zrrr:r)rrHs& r!_resolved_extra_include_paths2TorchOpsJitExtension._resolved_extra_include_pathss<..t/G/GH !!!' 6 6/ >>r#c V^8dQhRRRR/#rGr)r s"r!r"r#s]yr#c \V4pVPe+\VP!pW29dVPV4V#r)rprrErN)rrr target_defines&& r!_with_stable_abi_target,TorchOpsJitExtension._with_stable_abi_targets>;  ' ' 3:Drrs&r!_resolved_extra_cflags+TorchOpsJitExtension._resolved_extra_cflagss$++D,B,B4CTCT,UVVr#cV^8dQhRR/#rkr)r s"r!r"r#s\\Y\r#c VVPVPVP44#r)rGr>rrs&r!_resolved_extra_cuda_cflags0TorchOpsJitExtension._resolved_extra_cuda_cflagss$++D,B,B4CYCY,Z[[r#cV^8dQhRR/#rrrr)r s"r!r"r#s;;;r#c VP'd!\P!VP4MRpV'd\V4P 4#VP VP 4#)zJReturn the user-visible cache root before applying the loader fingerprint.N)rr^rrrr9r)rrs& r!base_build_root$TorchOpsJitExtension.base_build_rootsR6:5H5H5H299T001d >,,. .!!$"9"9::r#cV^8dQhRR/#rr)r s"r!r"r#s Y YU Yr#c \P!\4e \4#VP;'gRp\ \ RV,4#)aResolve the cross-process build lock wait, honoring the env override. Without an explicit override the wait scales with this extension's recorded compile baseline so a waiter never gives up on a slower host while the builder is still legitimately compiling. rg@)r^rrrr%rr)rrs& r!_build_lock_timeout_seconds0TorchOpsJitExtension._build_lock_timeout_secondssE 995 6 B79 988??C?GWAWXXr#cV^8dQhRR/#rRr)r s"r!r"r#sGG$Gr#c bVP4pVPVP R2, #)zFReturn the flock path, kept outside the directory cache clears delete.z.lock)rTr"r)rrTs& r!_cross_process_lock_path-TorchOpsJitExtension._cross_process_lock_paths1..0%%?+?+?*@(FFFr#c V^8dQhRRRR/#)r build_rootrrrVr)r s"r!r"r#s$r#c VR, pVP4'gR#\PRVP\P !4V4VP 4R# \dR#i;i)aDrop a leftover torch FileBaton lock file so a dead build cannot hang new ones. torch's `_jit_compile` waits on `/lock` with no timeout and no owner check, so a lock file left behind by a killed process would otherwise block every later build in this directory forever. Only safe while holding the exclusive cross-process build lock, which proves no live process is compiling here. lockNzN%s: removing stale torch JIT build lock left by a dead process: pid=%s path=%s)r}r\r]r!r^r_unlinkFileNotFoundError)rr_ baton_paths&& r!_remove_stale_torch_build_lock3TorchOpsJitExtension._remove_stale_torch_build_locksg &(   ""  \    IIK            sA** A98A9c$V^8dQhRRRRRR/#)rsourcerrHrHrrIr)r s"r!r"r#s"777M7^g7r#c aaaa.o\4oVUu.uF,p\V4P4PRR7NK. upoRVVVV3RlloS!\V44S#uupi)z@Hash one source file plus recursively discovered local includes.Fr=c V^8dQhRRRR/#rrhrrrVr)r s"r!r"LTorchOpsJitExtension._source_cache_fingerprint_payload..__annotate__s- -- -- -- -r#cT<VP4PRR7pVS 9dR#S PV4S P\ V44VP 4'gS PR4R#VP 4pS P\P!T4P44TPRRR7p\PT4FywrVTR8Xd?\!TTSR 7pTf#S PR \ T4 R T 24K@S !T4KJ\#T4'dK]\!TTSR 7pTfKqS !T4K{ R# \d3pS PR\T4P 24Rp?R#Rp?ii;i) Fr=Nmissingz read_error=utf-8ignore)errors"rxryzmissing_include=:)rr?r5rNrDr} read_bytesr{typerhashlibsha256 hexdigestdecode_SOURCE_INCLUDE_PATTERNfindallrri) rhr9 source_bytesrb source_text delimiterrf included_pathrypayloadvisitvisiteds & r!rETorchOpsJitExtension._source_cache_fingerprint_payload..visits~*22%2@JW$ KK # NN0< =$$&&y) )446 NN7>>,7AAC D&--gh-GK+B+J+J;+W' #$?$'1-A%M %,)9:OPZ:[9\\]^j]k'lm -(7|DD $?$'1-A%M %0m,3,X T#Y-?-?,@AB sE** F'5'F""F'rrrr?)rrhrHrhryrrrs&&& @@@@r!!_source_cache_fingerprint_payload6TorchOpsJitExtension._source_cache_fingerprint_payloadsi  UZghZgRVT 5 5 7 ? ?u ? MZgh- -- -^ d6le i2A)c$V^8dQhRRRRRR/#)rrhrrHrHrzlist[tuple[Path, str]]r)r s"r!r"r#s"  C  J` r#c aaaa.o\4oVUu.uF,p\V4P4PRR7NK. upoRVVVV3RlloS!\V44S#uupi)z>Collect source text and recursively discovered local includes.Fr=c V^8dQhRRRR/#rkr)r s"r!r"8TorchOpsJitExtension._source_texts..__annotate__s ) ) ) )r#c<VP4PRR7pVS 9gVP4'gR#S PV4VP RRR7pSP Y34\PT4F;wr4TR8wd\T4'dK\TTSR7pTfK3S!T4K= R# \ dR#i;i)Fr=Nrorp)encodingrqrrrs) rr?r}r5 read_textr{rNr{r|rir) rhr9r~rrfrrytextsrrs & r!r1TorchOpsJitExtension._source_texts..visits*22%2@JW$J,=,=,?,? KK # (22GH2U  LL*2 3+B+J+J;+W' #(G (U(U ; #-)=! !,-(,X  sC CCr)rrhrHrhryrrrs&&& @@@@r! _source_texts"TorchOpsJitExtension._source_textssg)+ UZghZgRVT 5 5 7 ? ?u ? MZgh ) )0 d6l 7 irc$V^8dQhRRRRRR/#)rrrHrHrz"tuple[bool, bool, tuple[str, ...]]r)r s"r!r"r#3s(===%= , =r#c VUUu.uFpVPW24FpVNK K ppp\;QJd.RV4FNK 5M !RV44pV\V43pVPPV4pVeV#Rp Rp Rp \ 4p VEFrwr\ P RV4p\PV4'g\PV4'dRp \PV4'dRp \PV4FpVR8H;'gVPR4;'gVR 9pV'dRp VPR4;'g{VPR4;'gbVPR 4;'gIVPR 4;'d0VPR 4;'gVPR 4'*pV'gKRp V PV4K EKu T T ;'dT \\V 443pVVPV&V#uuppi)z6Detect ABI requirements and report non-stable headers.c3"TFEwr\V4\P!VPR44P 43xKG R#5i)roN)rDrwrxencodery)rMrhrvs& r!rO;TorchOpsJitExtension._source_abi_details..?s> * #4 ('..W9M*N*X*X*Z [*sA AFTr(zPython.hz pybind11/zATen/zc10/zcaffe2/ztorch/ztorch/csrc/stable/ztorch/headeronly/>torch/python.htorch/extension.h)rr_r,rmr_C_COMMENT_PATTERNsub_PYTHON_ABI_USAGE_PATTERNr_REGISTER_EXTENSION_PATTERN"_STABLE_TORCH_REGISTRATION_PATTERN_TORCH_INCLUDE_PATTERNr|rLr5rr)rrrHrhr= source_texts source_key cache_keycachedpython_dependentstable_registrationstable_torch_headersnon_stable_headersrr~ marker_textrfpython_include is_non_stabledetecteds&&& r!_source_abi_details(TorchOpsJitExtension._source_abi_details3sc" !**6A A !  U * UU *   }!56 1155i@  M ##'*u*NA,00[AK(// <<@[@b@bcn@o@o#' 188EE&*# 6 > >{ K  J.OO#..{;OO#'NN "'+$ ++G4  #..v6  #..y9  %//9(334HILL+667JK !=+0(&**<8-!L +>   8 8$8 &+, -  7?((3m s#Ic$V^8dQhRRRRRR/#rrrHrHrztuple[bool, bool]r)r s"r!r"r#rs"}Yjr#c 6VPW4pVR,#)zIDetect Python and torch ABI requirements from sources and local includes.NrN)r)rrrHrs&&& r!_source_abi_flags&TorchOpsJitExtension._source_abi_flagsrs++GC|r#c$V^8dQhRRRRRR/#rr)r s"r!r"r#xs"  =  [l r#c VPVV4wr4pVPe+V'd#\VP RV^,: 24hVPe VPMTVPRJ3#)NzE explicitly requests the Torch stable ABI but uses non-stable header )rr RuntimeErrorr!r)rrrHdetected_python_abi_dependentrrs&&& r!_resolved_abi_flags(TorchOpsJitExtension._resolved_abi_flagsxs?C?W?W  @ <%*<  ' ' 38J$$%%j%a(+-  ((4  % %.  ( ( 4   r#cV^8dQhRR/#rr)r s"r!r"r#sCr#c VPVP.VPOpVPVP4pVP 4pVP 4pVP4pVPW%4wrgV'dVPR\4 24MVPR4V'd'VPwrVPRV RV 24M@VP'd\PM \4p VPRV 24VP'd7TPR\P P";'gR 24VP%VP'44VF#p VP%VP)W44K% VP%V4VP%\+V44VP%RV44VP%VPVP,44\.P0!R P3V4P5R 44P74p V R ,#) zMHash the effective op surface and source metadata to avoid stale cache reuse.z python_abi=zpython_abi=agnosticztorch_abi=stable-r&ztorch=z torch_cuda=nonec3J"TFp\\V44xK R#5ir)rDr)rMr~s& r!rO:TorchOpsJitExtension._cache_fingerprint..s cUb\,T,-?@@Ubs!#ro:NN)rrrr>rrKrOrBrrNr1rrr5r6r>r:rrY_cuda_cache_fingerprint_payloadrrRrrwrxrYrry) rrrrrrHrtorch_stable_abir-r. torch_versionrhdigests & r!_cache_fingerprint'TorchOpsJitExtension._cache_fingerprints#iiL$:K:KL((6224  <<>::< 151I1I'1a.  NN[):(;< = NN0 1 77LE NN.ugQug> ?151C1C1CE--IaIcM NNVM?3 4     NN[););)E)Ev(FG Ht;;=>F NN4AA&X Y |$12CDEcUbcct--d.@.@AB ' 2 9 9' BCMMOc{r#cV^8dQhRR/#rkr)r s"r!r"r#s"""r#c bVP'gR.#R.p\P!R4pV'dXVPRV 24\ VP R7pV'd$VPRRP V4 24V#\PP4'gVPR4V#\4p\\PP44F:p\PPV4wrgVPV R V 24K< V'gVPR 4M,VPR RP \V44 24\!4pV'd$VPRRP V4 24V#) zPCapture the effective CUDA target set so cached binaries stay device-compatible.z cuda_ext=0z cuda_ext=1rz arch_list=rzresolved_arch_flags=rzcuda_available=0r&zvisible_caps=nonez visible_caps=)rr^rrNrrrYr5rrrrrrr5rrr)rrr arch_flags capabilitiesrr-r.s& r!r4TorchOpsJitExtension._cuda_cache_fingerprint_payloadsX!!! > !.9934  NNZz2 33#'#H#HJ!5chhz6J5KLMNzz&&(( NN- .N!$ !%**"9"9"; >%%%..>>r#cV^8dQhRR/#rr)r s"r!r"r#skkkr#c a\\PVPR4oSRJ;'dO\;QJd)V3RlVP 4F 'dK R# R#!V3RlVP 44#)Nc3<<"TFp\SV4xK R#5ir)hasattr)rMop_namers& r!rO6TorchOpsJitExtension._ops_available..s,jXiWWY-H-HXisFT)r/r5opsrrr)rrs&@r!_ops_available#TorchOpsJitExtension._ops_availables]EIIt~~t< $jj,jX\XiXi,jjj,jX\XiXi,j)jjr#cV^8dQhRR/#rr)r s"r!r"r#s   r#c x\\PVPR4pVfRVn/VnR#VP Uu.uFp\W4'dKVNK ppV'dRVn/VnR#WnVP Uu/uFq"\W4bK upVnR#uupiuupi)NFT)r/r5rrr*r+rr)rrrrns& r!_refresh_runtime_cache+TorchOpsJitExtension._refresh_runtime_cachesEIIt~~t<  $(D !DN*.*;*;_*;w79C^77*;_ $(D !DN )NRN_N_`N_779#>>N_`` asB2 B2B7c V^8dQhRRRR/#)rr_rrz list[Path]r)r s"r!r"r#s  $ : r#c  f\4p.pVPFp\FpW V 2, pWb9d#VPV4VP V4\ VP V RV 244F-pWr9gK VPV4VP V4K/ K K V#)*)rr_SHARED_LIBRARY_SUFFIXESr5rNrrrq)rr_r7 candidates binary_namesuffixexactr9s&& r!_candidate_binary_paths,TorchOpsJitExtension._candidate_binary_pathss%!# ,,K2"}VH%==$HHUO%%e,#JOO{m1VH4M$NOE("))%0P 3-r#cV^8dQhRR/#)rrrzr)r s"r!r"r#sCCnCr#c VP'gR#\P!VP4pV'gR#\V4P 4P RR7#)NFr=)rr^rrrr?)r configureds& r!_configured_prebuilt_library1TorchOpsJitExtension._configured_prebuilt_librarysM(((YYt889 J**,44E4BBr#c V^8dQhRRRR/#)r library_pathrrrr)r s"r!r"r#s66d6t6r#c  VPV8Xd+VP'dVP4'dR#VP4'g5VP RV RVP R2VnRVnRVnR#VP4'd\VPV8wdKVPeRVP R2MR pVP R V R V R 2VnRVnRVnR#\PP\V44TP4'gQTP RT RRPTP4 RTP R2TnRTnRTnR#RTnRTnYnR TnR# \dApTP RT R T RTP R2TnRTnRTnRp?R#Rp?ii;i)zGLoad an explicitly configured library without evaluating JIT callbacks.Tz: configured prebuilt library `z` does not exist. Unset `z:` to enable JIT compilation, or provide a compatible file.FNz from ``r(z+: required torch.ops are already registeredz2; cannot verify that configured prebuilt library `z` provides them. PyTorch cannot unload operator registrations in-process, so start a new process before selecting a different prebuilt library.z` is incompatible: z . Unset `z2` loaded but did not register required torch.ops (rz ). Unset `)r)r'rhr!rr(r&rr5r load_libraryrrZrrYr)rr loaded_detailrbs&& r!!_load_configured_prebuilt_library6TorchOpsJitExtension._load_configured_prebuilt_librarys6  ) )\ 9!!!$$&&##%%$$%%D\NS3344np  $(D %D     T%B%Bl%R00<$778:  $$%%PQ^P_`55ANCrr   $(D %D   II " "3|#4 5**,,$$%%D\NS''+yy1B1B'C&DJtOhOhNijHH   $(D %D # (4%+ $$%%D\NRefiejk3344np  $(D %D  s8(F## G..5G))G.c V^8dQhRRRR/#)rr_rrrr)r s"r!r"r#=s  T d r#c ^VPV4F]pVP4'gK\PP \ V44VP 4'dR#K_ R# \d-p\PRTPY#4Rp?KRp?ii;i)Tz2%s: failed to load cached torch.ops library %s: %sNF) rrhr5rrrrrZr\r[r!)rr_rrbs&& r!_try_load_prebuilt_library/TorchOpsJitExtension._try_load_prebuilt_library=s 88DL'')) v &&s<'89&&(() E v NPTPaPacouu vs>A55 B,!B''B,cV^8dQhRR/#rr)r s"r!r"r#Is B BT Br#c  VP;_uu_4RVnRVnRVnRVn/VnVP 4e RRR4R#VP4pVP4'dVP4p\VP4VR7;_uu_4pV'g5\PRVPV4RRR4RRR4R#\VP R2VR7\ P"!VRR 7RRR4RRR4R# +'giL;i +'giR#;i) zDBest-effort cache clear for the next process-local JIT load attempt.Fr(Nrz%s: skipping on-disk cache clear; timed out after %.0fs waiting for the cross-process JIT build lock (another process may be building here).z .clear_cacherTrUT ignore_errors)r.r&r'r(r*r+rrTr}rXr1r\r\r]r!rarjrmtree)rr_lock_timeout_secondsbuild_lock_acquireds& r! clear_cache TorchOpsJitExtension.clear_cacheIsZZZ#(D %D !D %)D !DN002>Z--/J  ""'+'G'G'I$.113EY(. c --0  Z2."&"3"3!4LA$.MM*DAZZZs;7E%E<3E/+D0 E,2D0 E0 E ;E E cV^8dQhRR/#rr)r s"r!r"r#ks  C r#c VP#)z3Return the most recent human-readable load failure.)r(rs&r!last_error_message'TorchOpsJitExtension.last_error_messageksr#cV^8dQhRR/#rr)r s"r!r"r#ps3r#c  LVPfR#\PPR4^,p\;QJd*.RVP R4R,4FNK 5M#!RVP R4R,44pY P8d:TPwr4TP RT RT R T RT R \P 2 #R# \ \3d8TPwr4TP RT RT R\P: 2u#i;i) Nr(r4c38"TFp\V4xK R#5irrC)rMparts& r!rOATorchOpsJitExtension._stable_abi_runtime_error..us%X= z; unrecognized torch version z: requires torch >= z (compiled against the torch z stable ABI); found torch ) rr5r6r7r_r TypeErrorrr!)r torch_publictorch_major_minorr-r.s& r!_stable_abi_runtime_error.TorchOpsJitExtension._stable_abi_runtime_errorps4  ' ' /((2237:   %%XL24RRR4RRR4R# +'giEL;i +'giELV;i \dEdLp\FPH!4T , pRTnRTnTP R"T 2R#T 2R$T 2R%\fPh!4 2R&\jPl!4 2R'\jPn!R(R4 2R)\jPn!R*R4 2.pTPqT4pT'd/TPsR+R,PuR-T44,4\wTPy44pR,PuR.TR/,44p\{T4^8dTR0\{T4^, R12, pTPsR2T R324M- \|d pTPsR4T R524Rp?MRp?ii;iR6PuT4Tn\,PR TPRR77TP3TP R8\TTPD4 R924Rp?\FPH!4T , pT PT TR:7RRR4RRR4R#Rp?ii;i \FPH!4T , pT PT TR:7i;i +'giM;iRRR4R# +'giR#;i)@z=Load the extension from cache or JIT-compile it on first use.TFNr(z: CUDA is not available.rz: timed out after rz0s waiting for the cross-process JIT build lock `zE`; another process may be stuck building this extension. Adjust via `z`.z%sz5: JIT build lock wait timed out; using fallback path.z$: clearing cached JIT extension at `z.force_rebuildrrrz(: compiling torch.ops JIT extension in `zCompiling extension: z...)rrrrrbuild_directoryis_python_moduleverboserrrrr)rz+: failed to build torch.ops JIT extension: z build_root=zbase_build_root=zpython=zpid=zTORCH_EXTENSIONS_DIR=TORCH_EXTENSIONS_DIRzGPTQMODEL_TORCH_EXTENSIONS_DIR=rzcandidate_binaries=rc3^"TF#q RVP4'dRMR 2xK% R#5i)rtr}rnN)r})rMrhs& r!rO,TorchOpsJitExtension.load..s*'yixae&dkkmm(QZ1[(\ixs+-c38"TFqPxK R#5irr)rMentrys& r!rOr s+QL5JJLr:NNz, ... (+z more)zbuild_root_entries=[]z!build_root_entries=z | rRz#: torch.ops JIT compilation failed z; using fallback path.)rrz : torch.ops JIT extension ready r&z=: build completed but required torch.ops were not registered.z@: torch.ops JIT build finished without registering required ops.r)Brr&r'r(rr.rrr*rrrr5rrr!r_rTrXr1r\rr\r]rinfor}rarjrr#rrerr%rrr>rrBrrrrrKrOrrrr rZplatformpython_versionr^r_rrrNrYrriterdirrr{r[rr)rstable_abi_errorconfigured_prebuilt force_rebuildr_rTrrrprogress_displaystartedbuild_invocation_succeededresolved_sourcesrkwargsrrrrbrdiagnostic_linesrventriespreview snapshot_excreadys& r!r TorchOpsJitExtension.loads 99; #'D %D /  #??A  *==>QR    D$5$5$5d>X>X>Z>Z  ,T5O5O5Q5Q#'D $D !D      ' ' )#'D $D !D     ejj&=&=&?&?#'D %D "&"3"3!44LMD  ZZZ 668M###(9(9(9-Z$$0'+$$(!#% Z""$$++-'+$$(!#% Z###M((!Z"*J"224O#'#C#C#E *--/AU$*+/D((-D%,,--?@TUX?YZ99=9V9V9X8YZMMmLnnpr$ KKd&6&67 N''4+<+<*==r(st +ZH!_%;%;%=%= N''4+<+<*==abqarrt(uv-"&"3"3!4NC$3MM/F   =$)H)H)T)T+/D((,D%')D$;+Zh33J?% t0011YZdYeeghi#:!1$2C2C1DCH%)%B%B$ ++--2*>j'+'='=dll'K$*.*L*L*N' !#3)3z?*E!PTP`P`P`8D,<,#>#@L#1=~.(,(H(H(J%(6G23*8K45$($:$:4;M;M$NM$2?/= $ E Ev26.H#//1G;G$**5Oah*i++-7335dd9X9XYc9d'+$$)!//1')D$KK,,--M4Wd>[>[\]]^` k+ZX'+&7&7%88u#v  t0011qrss+Z3Z !!!"//1G;G+/D((-D%,,--XY\X]^%j\2*?*;<!("9"9";!<=ryy{m,/ :PRT0U/VW9"))Ddfh:i9jk($'+&B&B:&NO&(//1"ii'yix'yyze"(););)=">"&))+QGCL+Q"Qw<",##g,2C1DF'KKG(//2Fwiq0QR"e(//2ST`Saab0cdde',zz2B'CD$IIdD$4$4tIDKK,,--P4Wd>[>[\]]su!"//1G;G$**5Oah*iQ+Zr!!F#//1G;G$**5Oah*iQ+ZZZsZ\ 4g  g g g 3g g )&g g +g 3 g  Ag Bg *g <g g A5g g 'g =g A9g B \4\40 \4=&\4$#\4 \  \4A!g 'g (A g 5g 3g :g  \ \1+ \44 f C+f ,A:b' &f ' c 2c f c A0f f/g 4g f f1f? ?g  g g  g1 cV^8dQhRR/#)rrobjectr)r s"r!r"r#<s t t& tr#c PVPe VP#VP4'g1\VP4;'gVP R24hVP 4'd VP#\VP RVP R24h)zCReturn the cached torch.ops namespace after loading this extension.z: runtime unavailable.z : required torch.ops namespace `` is unavailable.)r*r rr r!rrrs&r!namespace_object%TorchOpsJitExtension.namespace_object<s  ,(( (yy{{t668hht?P?P>QQgrBrGrKrOrTrXr\rerrrrrrrr_rrrrrrrrr rr r=rBrrr#r!r r CsQR5-OS5-TX5-VZ5-PT5-,05-&*5- $!5-"26#5-$15%5-&-1'5-(;?)5-*/3+5-n##+0?W\; YG 07r D=~  "@"HB ?k  C6p  BD (vp t  r#r c \;_uu_4\'gT;'g \WR7p\PP V4'dE\ RVR7\P!V4V'd\PRV 24\PP V4'g7V'd\PRV4\P!VRR 7\R R VR V/VBRsRRR4R# \d#p\PRT 24Rp?LRp?ii;i +'giR#;i) a A safe wrapper for torch.utils.cpp_extension.load() that removed old cached kernel on first load. Pytorch has a bug where it does not check previous cached kernel for current pytorch compatibility as it only does it a naive name check based on pytorch/cuda version but same pytorch version can have multiple variants (cpu, cuda, etc) which are not cross compatible resulting in hidden errors. )rz$safe_load_cpp_ext.first_init_cleanuprz7[safe_cpp_extension_load] Removed old build directory: z<[safe_cpp_extension_load] Failed to remove build directory: Nz"Creating extension directory %s...T)r rrr) _cpp_ext_lock_cpp_ext_initializedr r^rhr}rarjrr\r[rZerrormakedirsr )rrrr2es&&&, r!safe_load_cpp_extrKUs ##-\\1Ed1\Oww~~o.. b-E$3MM/2 $[\k[l"mn77>>/22IIBOT Od;    /   $( ? !bII \]^\_`aab sHE1EAD$EEAE D?D:5E:D??E E cV^8dQhRR/#rRr)r s"r!r"r"sAAAr#c\\4P4P^,pVR, pVP 4'dV#VR, R, #)zNResolve the pack_block custom-op source file from source or editable installs.zpack_block_cpu.cpp gptqmodel_extr__file__r?rr} project_root source_paths r!_pack_block_source_pathrTsR>))+33A6L!55K / ),@ @@r#cV^8dQhRR/#rRr)r s"r!r"r"s===r#c\\4P4P^,pVR, pVP 4'dV#VR, R, #)zNResolve the floatx CPU custom-op source file from source or editable installs.zfloatx_cpu.cpprNrOrQs r!_floatx_cpu_source_pathrWsR>))+33A6L!11K / ),< <.S!8!:;+!,<0U)5):)<(=!>?/!& + ' +*r#cV^8dQhRR/#rYr)r s"r!r"r"rZr#cj\f'\RRR RRRRRR\4 2..R R R R 7 s\#) z:Build the shared floatx CPU torch.ops loader on first use.gptqmodel_floatx_cpugptqmodel_floatxc*\\44.#r)rrWrr#r!r'_floatx_cpu_extension..r`r#rac\R4#) floatx_cpurdrr#r!rros 'CL'Qr#rqrerrfFrg)dequantize_fp8_cpudequantize_fp4_cpu)_FLOATX_CPU_TORCH_OPS_EXTENSIONr rrr#r!_floatx_cpu_extensionrusR'.*>'(E<0Q%5):)<(=!>?/!& + ' +*r#rc V^8dQhRRRR/#rrrrzOptional[object]r)r s"r!r"r"s'!'!$'!;K'!r#c\\PPR4'd RsRs\ #\'d\ 'd\ #\ 4pVP4'g\PRV4RsRsR#^RIH p\PPR4pV'dR\PR&VPRR7R,sV'd9Vf"\PPRR4MV\PR&\PR V4Rs\ # T'd:Tf"\PPRR4iT\PR&ii;i \ d*p\PR T4RsRp?Rs\ #Rp?ii;i) z8Ensure the pack_block CPU extension is built and loaded.r]Tz/pack_block_cpu extension source not found at %sN extensionrf1r"z'pack_block_cpu extension loaded from %sz)pack_block_cpu extension build failed: %s)rr5rr !_PACK_BLOCK_EXTENSION_INITIALISEDrrTr}r\r[rzr^rlrmr poprZ)rrS extension_apiprevious_verboserbs$ r!load_pack_block_extensionrsr uyy""$455,0) $$$((-B-B$$)+K      C[Q $,0)%8::>>*AB 25BJJ. / K$1$6$6>*AB 25BJJ. / K%** *=lKI#+JJNN#:DA:JBJJ67 7E #+JJNN#:DA:JBJJ67  @ 93?? @s8?,E7,E7D1AE71AE44E77 F#FF#)z.soz.pydz.dylibz.dll)rz--split-compile)z --threads=z--split-compile=r)r)NF)__conditional_annotations__ __future__rrwloggingrr^r(rjryr+r)rrrZr! ImportError contextlibr functoolsrpathlibrtypingrrr rr5rXr r r r rorjit_compile_baselinesrrr getLoggerrr\rr2r__annotations__r|rhrtrFrGrrrcompileFlag MULTILINEr{rr8rrrrrrrrrr frozensetrKrMrrr,r1r>rErRrarqrrrrrrrrrrrrr1r:rPr?rrArDrdrir^rr]rrrrrrrrrrrrrrrr r rKrTrWrirurr)rs@r!rs #"    &// aaC !  nn&(,~,$)!"&"&# < #%(",,+ ))  ) ))  (,||4U'V$\\"<= LL)RS"ll+KL%)\\2\%]" %>?^^%.2+27<*34T*U''I$$F /4,$'! f>$*J$ # -( # 1 T5 T& G R,R,jN <))X $N**,44Q7" 4%%P"/&*/&  8,. 8ll#PQ + &&$6D66(? ? @ 0   &* ** * # * "& *).*%)*(-*#(*&**ZO O d+\A=+,+,'!'!Tk6 EsM M%$M%