+ j@^RIt^RIt^RIHt^RIt^RIHt^RIH t H t ^RI H t Ht.ROt]P !RRR.4tR tR t]P(!R/R 7s]\*n\*P.'d ]\*nR tR t] P4] P63RltRtRt] P>RR3Rlt Rt!Rt"RRlt#Rt$Rt%Rt&Rt'Rt(]!R] ](4R#)N)cast)api constants)_group_membership_management_update_group_membership BackendValue BackendType%construct_rpc_backend_options_handlerinit_backend_handlerc(RVP,#)z BackendType.)name)selfs&g/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/distributed/rpc/backend_registry.py_backend_type_reprrs DII %%z An enum class of available backends. PyTorch ships with a builtin ``BackendType.TENSORPIPE`` backend. Additional ones can be registered using the :func:`~torch.distributed.rpc.backend_registry.register_backend` function. valuenamesc(V\P9#)z Checks if backend_name is registered as an RPC backend. Args: backend_name (str): string to identify the RPC backend. Returns: True if the backend has been registered with ``register_backend``, else False. )r __members__) backend_names&rbackend_registeredr3s ;22 22rc\V4'd\RV R24h\Uu/uFq3PVPbK pp\ V\ VVR7/3/VBp\P!RVR7s\\n \P'd\\n \V,#uupi)aRegisters a new RPC backend. Args: backend_name (str): backend string to identify the handler. construct_rpc_backend_options_handler (function): Handler that is invoked when ``rpc_backend.construct_rpc_backend_options(**dict)`` is called. init_backend_handler (function): Handler that is invoked when the `_init_rpc_backend()` function is called with a backend. This returns the agent. z RPC backend z: already registered)r r r r) r RuntimeErrorr r rdictrenumEnumr__repr____doc___backend_type_doc)rr r memberexisting_enum_dictextended_enum_dicts&&& rregister_backendr$@s,''\,7KLMMBMN+++v||3+N ,6[%9  ))-7IJK-K/  | $$#OsB<c <VPP!W3/VB#N)rr )backend rpc_timeout init_methodkwargss&&&,rconstruct_rpc_backend_optionsr+fs& == > > $* rc:VPP!V/VB#r&)rr )r'argsr*s&*,r init_backendr.qs == - -t >v >>rcZ\Pp\P!WW#4pVf \ R4hVR8wd4WP 48wd \ RV RVP 4 24hVR8wd4W$P48wd \ RV RVP4 24hV#)Nz*Failed to initialize default ProcessGroup.zrank argument z doesn't match pg rank zworld_size argument z doesn't match pg size ) rpc_constantsDEFAULT_PROCESS_GROUP_TIMEOUTdistProcessGroupGlooAssertionErrorrankrsize)storer6 world_sizeprocess_group_timeoutgroups&&& r_init_process_groupr<us)GG  ! !%z QE }IJJ  -^D61HWXXbzZZ\9":,.Eejjl^ T   Lrc (^RIHpV!VVVVVR7#))TensorPipeRpcBackendOptions)r(r)num_worker_threads _transports _channels)r?)r(r)r@rArBr*r?s&&&&&, r1_tensorpipe_construct_rpc_backend_options_handlerrDs#. &-  rcaa\PP4;p'd VPMRo\;QJd VV3RlV4F 'dK R# R#!VV3RlV44#)cpuc3<"TFSpVPR8H;'g8VPS8H;'d!^VPu;8*;'dS8MuxKU R#5i)rFN)typeindex).0d device_count device_types& r /_tensorpipe_validate_devices..sMA %RRAFFk1QQa1776Q6Q\6QRsAAAAFT)torch acceleratorcurrent_acceleratorrHall)devicesrLaccrMs&f @r_tensorpipe_validate_devicesrVsg!--AACCSC% 33333 rc \VP44Uu.uF pR^/.3NK upp\P!W`WV3V4VUUu.uF wpqWNK pppVUU Uu/uF wryqWV bK p p ppVUUU u/uFwrurW{bK p ppp VUUU u/uF wpr]W}bK pppp \ WW4\ WV 4p\ W2V4pW3#uupiuuppiuupp piuup ppiuup ppi)rC)ranger7r3all_gather_object_validate_device_maps_create_reverse_mapping_create_device_list)my_namemy_device_countmy_device_maps my_devicesr;_gatheredr all_namescountall_device_countsmap_all_device_mapsrT all_devicesreverse_device_mapss&&&&& r._tensorpipe_exchange_and_check_all_device_mapsrjs #( "56"5Q"aR"56  OZH%,448-$1a8I4>FGh):auhG:BC(&6dttz(OCC"C)c PVFppW5,p\\V44\V48wd\RV RV 24h\WaV,4'dKX\RV RV RW, 24h VEF(pV'd]\W',P 44P V4'g)\RV RW',P 4 RV 24hW',P 4EFwr\\V P444\V 48wd\RV RV RV 24hW7,'dS\V P 44P W7,4'g\RV RV RV R W7, 24hMC\V P 4W,4'g\RV R V RV RW, 24hVPV.4'dU\V P44P W8,4'g\RV R V RV R W8, 24hEKYW9gEKb\V P4W,4'dEK\RV R V RV RW, 24h EK+ R #)zNode z" has duplicated devices devices = z, has devices with invalid indices devices = z device count = z@ has invalid target node names in its device maps device maps = z node names = z5 has duplicated target devices in its device map for z device map = z5 has unexpected source devices in its device map for z devices = z? has source devices with invalid indices in its device map for z5 has unexpected target devices in its device map for z? has target devices with invalid indices in its device map for N) lenset ValueErrorrVkeysissubsetitemsvaluesget) rcrergrhis_static_groupnoderT source_node target_noderfs &&&&& rrZrZs# s7| G ,uTF*MgYWX X+Gt5LMMv$I&""3"9!:<  ! 3'C'H'H'J#K#T#T $ $  }%!!0!=!B!B!D EF ){,  "1!=!C!C!E K3t{{}%&#d)3 K=)--8M:$$(6+ ''499;'001IJJ$ }-11< >((,v.%%0%=$>@K2 .;!K=)--8M:$$(6*&&7&D%EG {B//4;;=)22;3KLL$ }-11< >((,v.%%0%=$>@M1:V 0=;;!K=)--8M:$$(6*&&7&D%EGG"F!rc~V'g\4pVP4F"pVPVP44K$ VP4F"pVPVP44K$ VP \ P !R44\V4p\VRR7pV#)rFcVP#r&)rI)rKs&r%_create_device_list.. s!''r)key) rmrrupdaterodiscardrPdevicelistsorted)r`r_ri devices_setrfs&&& rr\r\s ), "))+D   tyy{ +,'..0D   tyy{ +1ELL/0+&  (9:J rc/pVFEpWV,9gKW$,V,P4UUu/uFwrVWebK uppW4&KG V#uuppir&)rq)r]rcrgrirukvs&&& rr[r[s]GI d+ +!0!6w!?!E!E!G)!G!G)  % )s Ac^RIHp\V\P!44pVP 4p\ PP4p\ PP4'dUVP'dC\ P!\ PP44pVP4W2PVP3#)r>TensorPipeAgent)rCrrr_get_current_rpc_agent_get_backend_optionsrPrQrL is_availablerTget_device_modulerRinit device_maps)ragentoptsrLmods r_get_device_infosrs! #"<"<"> ?E  % % 'D$$113L %%''DLLL%%e&7&7&K&K&MN  ))4<< 77rc ^RIHp\W4pVP4pVPpVP 4p///.3wrVrxVFp V Pp W8wd \ P!V \4wrp MEVP4p\PP4VPVPrp WV &WV &WV &VPV 4K \!VVVVRR7\#W8V4pVFEp \%Wz,Wj,V4Wz&\ P!V \&W'V ,VR3R7KG R#)r>rF)rtT)r-N)rCrrget_worker_infor get_worker_infosrrpc_syncrrrPrQrLrrTappendrZr[r\r)rrmy_worker_infor]all_worker_infosrergrhrc worker_info worker_namerL device_maprTrris& r#_set_devices_and_reverse_device_mapr$sU!  (E**,N!!G--/ACRR> ' !&&  !03 .1 -Lg--/D!!..0   '.L *6+&'1 $#*K %#(& 2'oV! #6  $o&BDW$    $ k":)rr?z`store` must be a c10d::Store. z?`rpc_backend_options` must be a `TensorPipeRpcBackendOptions`. N)timeoutT)rCrr? isinstancer3Store TypeErrorrPrQrLboolr<rjrrTrrrRrr_init_rpc_states _all_gatherr(barrierwaitrr Exceptionshutdown)r8r r6r9rpc_backend_optionsrr?rLrtr;rirTrrs&&&&& r _tensorpipe_init_backend_handlerrXs? eTZZ ( (9%ABB ) G GMNaMb c  $$113L:&O$E<'U    + +  ' '  ( $    ) ) + + ))%*;*;*O*O*QRC HHJ         U# &9&E&EF   *%t < <$#E   ' 4E:+= <$   %= < rs  -J %%<>TU &iim26 ) +K 3#%P5511?.%?? &+,@F  81 hVr5$r