+ jI^RIt^RIt^RIHtHt^RIHt^RIHt^RI H t ^RI H t ^RI Ht^RIHtHtHtHt] 'd^R IHtR R .t!R R ]4t!RR ]4t!RR ]4tR#)N) GeneratorSequence)contextmanager)Path) TYPE_CHECKING) url_to_fs)StreamTransformExtension)FileSystemBaseFileSystemReaderFileSystemWriterSerializationFormat)AbstractFileSystem FsspecWriter FsspecReaderca]tRt^ toV3RlRlt]V3RlRl4tV3RlRltV3RlRltV3R lR lt V3R lR lt ] V3R lRl4t V3RlRlt V3RlRltV3RlRltRtVtR#) FileSystemc<V^8dQhRR/#)returnN)format __classdict__s"p/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/distributed/checkpoint/_fsspec_filesystem.py __annotate__FileSystem.__annotate__!s22$2cRVnR#Nfs)selfs&r__init__FileSystem.__init__!s -1rc z<V^8dQhRS[S[P,RS[RS[S[P RR3,/#)rpathmoderN)strosPathLikerioIOBase)rrs"rrr%s>"++%-0 299dD( )rc#a"VPf \R4h\P!V4pVPP VS4;_uu_4pVxRRR4R# \ ;QJdT3RlR4F 'gK RM RM!T3RlR44'dTP T4h h;ih;i +'giR#;i5i)Nzfs should not be Nonec3,<"TF qS9xK R#5irr).0chr&s& r +FileSystem.create_stream..3s2EbTzEszw+aTF)r AssertionErrorr(fspathopenanyrm_file)r!r%r&streams&&f r create_streamFileSystem.create_stream$s 77? !89 9yy WW\\$ % %  & % 32E23332E222 T*& % %sNACCA( C(!C C+B=<C=C ?CC C  Cct<V^8dQhRS[S[P,RS[RS[S[P,/#)rr%suffixrr'r(r))rrs"rrr:s4**bkk 1*3*3CT*rc@\PPW4#r)r(r%join)r!r%r;s&&&r concat_pathFileSystem.concat_path:sww||D))rcn<V^8dQhRS[S[P,RS[S[P,/#rr%rr<)rrs"rrr=s-cBKK/cBKK>Orc .\V3/VBwVnpV#r)rr )r!r%kwargs_s&&, r init_pathFileSystem.init_path=st.v.  rcr<V^8dQhRS[S[P,RS[S[P,RR/#)rr%new_pathrNr<)rrs"rrrAs4''3,'bkk8I'd'rc<VPPW4R#r)r rename)r!r%rIs&&&rrKFileSystem.renameAs t&rcH<V^8dQhRS[S[P,RR/#rr%rNr<)rrs"rrrDs$..# +..rc@VPPVRR7R#)T)exist_okN)r makedirsr!r%s&&rmkdirFileSystem.mkdirDs -rcJ<V^8dQhRS[S[P,RS[/#r checkpoint_idrr'r(r)bool)rrs"rrrHs$  33D  rcr\V\4'dR#\V4R# \dR#i;i)FT) isinstancerr ValueErrorclsrWs&&rvalidate_checkpoint_id!FileSystem.validate_checkpoint_idGs8 mT * *  m $  s ' 66cJ<V^8dQhRS[S[P,RS[/#rBrX)rrs"rrrSs$$$3,$$rc8VPPV4#r)r existsrRs&&rrcFileSystem.existsSsww~~d##rcH<V^8dQhRS[S[P,RR/#rNr<)rrs"rrrVs$C"++-$rc<VPPV4R#r)r rmrRs&&rr6FileSystem.rm_fileVs  4rcZ<V^8dQhRS[S[P,RS[S[,/#rB)r'r(r)list)rrs"rrrYs(..sR[[(.T#Y.rc<VPPVRR7#)F)detail)r lsrRs&&rrm FileSystem.lsYswwzz$uz--rrN)__name__ __module__ __qualname____firstlineno__r"rr8r?rFrKrS classmethodr_rcr6rm__static_attributes____classdictcell__)rs@rrr s}22***''..  $$..rrcaa]tRt^`toRtRR^RRR]P 3V3RlV3Rlllt]V3RlRl4t R t Vt V;t #) raD Basic implementation of StorageWriter using fsspec. This implementation makes the following assumptions and simplifications: * The checkpoint path is an empty or non-existing directory. * File creation is atomic The checkpoint consist of one file per write request plus a `.metadata` file with the serialized metadata. TiNc<V^8dQhRS[S[P,RS[RS[RS[RS[RS[RS[S[,R,R S[R R/ #) rr%single_file_per_rank sync_files thread_countper_thread_copy_ahead overwrite _extensionsNserialization_formatr)r'r(r)rYintrr r )rrs"rrFsspecWriter.__annotate__nsy%6%6BKK%6#%6 %6  %6 # %6%667$>%62%6 %6rc <\S V`VVVVVVVVR7\4VnVPP!V3/V BVnR#)a Initialize the writer pointing to `path`. Args: path: directory where the checkpoint will be written to. single_file_per_rank: Produce one file per rank instead of one file per tensor/blob. Default to True. sync_files : force files to be synced to permanent storage. Default to True. thread_count: Number of IO threads to use to write. Default to 1. per_thread_copy_ahead: How many bytes to copy from the GPU ahead of saving them. Default 10Mb. overwrite: Whether to allow overwriting existing checkpoints. Defaults to True. _extensions: Extensions to apply to output streams (EXPERIMENTAL) N. B. If sync_files is disabled, there's no guarantee that the checkpoint will be consistent in the case of a failure. )r|r}r~Nsuperr"rr rFr%) r!r%rxryrzr{r|r}r~rD __class__s &&&&&&&&&,rr"FsspecWriter.__init__nsU4     !#!5  ,GG%%d5f5 rcJ<V^8dQhRS[S[P,RS[/#rVrX)rrs"rrr(@@33D@@rc,\PV4#rrr_r]s&&rr_#FsspecWriter.validate_checkpoint_id00??rr r%) rorprqrr__doc__r TORCH_SAVEr"rsr_rtru __classcell__rrs@@rrr`sN  &*%/AE4G4R4R%6%6N@@@rcZaa]tRt^toV3RlV3Rllt]V3RlRl4tRtVtV;t #)rcH<V^8dQhRS[S[P,RR/#rNr<)rrs"rrFsspecReader.__annotate__s$66S2;;.6T6rc <\SV`V4\4VnVPP!V3/VBVnR#rr)r!r%rDrs&&,rr"FsspecReader.__init__s4 ,GG%%d5f5 rcJ<V^8dQhRS[S[P,RS[/#rVrX)rrs"rrrrrc,\PV4#rrr]s&&rr_#FsspecReader.validate_checkpoint_idrrr) rorprqrrr"rsr_rtrurrs@@rrrs+66 @@@r)r*r(collections.abcrr contextlibrpathlibrtypingr fsspec.corer'torch.distributed.checkpoint._extensionr 'torch.distributed.checkpoint.filesystemr r r r fsspecr__all__rrrrrrrsl /% !L)  <.<.@7@#7@t@#@r