+ "ݳjz^RIHt^RIHtHt^RIt^RIHt^RIHt^RI H t H t Rt Rt R R ltR R R lltR#)) annotations)OptionalUnionN)Device)nn)CPUCUDA_0cj\\4pVP4R, R, R, #i)rr memory_usedsmis W/home/luca/screen-checking/.venv/lib/python3.14/site-packages/gptqmodel/utils/device.pyget_gpu_usage_memoryrs' .C ?? t #d *T 11cj\\4pVP4R, R, R, #r )rrr r s rget_cpu_usage_memoryrs' +C ?? t #d *T 11rc V^8dQhRRRR/#)objtorch.Tensor | nn.Modulereturn torch.device)formats"r __annotate__rs  ,  rcV\V\P4'd VP#\ VP 44p\ VP 44p\V4^8dV^,P#\V4^8dV^,P#\#)r) isinstancetorchTensordevicelist parametersbufferslenr)rparamsr$s& r get_devicer'sz#u||$$zz #.." #F3;;=!G 6{Qay W qz    rc 0V^8dQhRRRRRRRRRRR R /#) rrr recursivebool assert_modeexpected"Optional[Union[str, torch.device]] check_indexrrr)rs"rrr'sLZZ !ZZZ1 Z  Z  Zrc >aRRlp\V\P4'dVP.pM\V\P 4'd\ VPVR74p\ VPVR74p.pV'dVPRV44V'dVPRV44V'g\.pM\R\V4 24hV^,p V'EdV!V4wrRV3Rllp V eVU u.uF3p V PV 8wgS'gKV PV 8wgK1V NK5 pp V'dvR PVR ,U u0uFqP R V P 2kK up 4pT S'dR V 2MR ,p\R V RV R\!V4 R24hV #VU u0uF q!V 4kK pp \!V4^8dR P\#RV444pR PVR,U u0uFqP R V P 2kK up 4pRV RV R2pS'g VR, p\V4hV #uup iuup iuup iuup i)a Return a representative device for a Tensor/Module and optionally assert uniformity. Args: obj: Tensor or nn.Module. recursive: If obj is an nn.Module, traverse submodules (parameters/buffers) recursively (like module.parameters(recurse=True)). assert_mode: If True, perform assertions about device placement: - If `expected` is provided: assert that ALL params/buffers live on a device whose .type matches `expected`'s .type (and, if check_index, the same index). - If `expected` is None: assert that ALL params/buffers share a single uniform device type (and, if check_index, the same index). expected: A target device or device string (e.g., "cpu", "cuda", "cuda:1"). check_index: If True, also require the same device index (e.g., all on cuda:0). Returns: torch.device: A representative device. Priority order: - Tensor: its own device - Module: the first parameter device, else first buffer device, else CPU cV^8dQhRR/#)rexpr-r)rs"rr$get_device_new..__annotate__Cs##!C#rcVfR#\V\4'd\P!V4MTpVPVP 3#)N)NN)rstrrr!typeindex)r1devs& r_normalize_expected+get_device_new.._normalize_expectedCs< ; #-c3#7#7ell3Sxx""r)recursec38"TFqPxK R#5iNr!).0ps& r !get_device_new..Rs4V88Vc38"TFqPxK R#5ir<r=)r>bs& rr@rATs3U88UrBz.get_device() expects Tensor or nn.Module, got cV^8dQhRR/#)rdrr)rs"rrr2as > >L >rcJ<VPS'dVP3#R3#r<)r5r6)rFr.s&r_keyget_device_new.._keyas FF{AGG= == =rz, :NN:z1Device assertion failed: expected all tensors on z, but found mismatches (e.g., z). Total tensors checked: .c34"TFwrV RV 2xK R#5i)rKNr)r>tis& rr@rAws*KF&1aS!:Fs:NNzADevice assertion failed: tensors are on multiple devices. Found {z }. Examples: z? (Tip: set check_index=True to also require same device index.))rrr r!rModuler"r#r$extendr TypeErrorr5r6joinAssertionErrorr%sorted)rr)r+r,r.r8devicesr&buffs rep_deviceexp_type exp_indexrHrF mismatchessampletargetuniquesummarydetailmsgs&&&&f rget_device_newrd'sz8##u||$$::, C # #cnnYn78S[[[34  NN4V4 4  NN3U3 3eGHc TUUJ{1(; > >  #"a66X%+:;''Y:N7 :b>#R>avvhay$9>#RS$:[Ai[/bQ$GxP339(:TUXY`UaTbbce . )011tAwF16{Q))F*KF*K$KL72;#O;avvhay$9;#OP&i~fXQ@#\\C$S)) 7 $S2$Ps$"J J J ;#J!J:#J)FFNF) __future__rtypingrrr device_smirr models._constrr rrr'rdrrrris4 #" '2 2 ZZr