+ j^(^RIt^RIt^RIt^RIHt^RIt^RIHt^RIH t H t ^RI H t ^RI HtHt^RIHtHt^RIHt^R IHt^R IHt^R IHtHtHt]P:!]P<R 7]!4t!R R]P@PB4t"Rt#Rt$Rt%Rt&Rt'Rt(Rt)Rt*Rt+],R8XEd]#!4wt-t.t/]/P`^8d]!R4t1]1Pe4'g]1PgRRR7]$!]/]-4t-]/Pi4]Pj!4]!].]/]-]14]/Pi4](!]-]14])!]-]14]*!]-]14]+!]-]14]/Pn'd]Pp!]14]/Pi4]/Ps4R#R#R# ]6dhi;i ]/Pn'd]Pp!]14]/Pi4]/Ps4i;i)N)Path) load_file)ShardingStrategy StateDictType) DataLoader) AcceleratorFullyShardedDataParallelPlugin) merge_commandmerge_command_parser)AcceleratorState) torch_device)RegressionDataset)merge_fsdp_weightspatch_environmentsave_fsdp_model)levelc8aa]tRt^&toV3RltRtRtVtV;t#) TinyModelcD<\SV`4\PP ^^4Vn\PP 4Vn\PP ^^4Vn\PP4Vn R#)N) super__init__torchnnLinearlinear1ReLU activationlinear2Softmaxsoftmax)self __class__s&q/home/luca/screen-checking/.venv/lib/python3.14/site-packages/accelerate/test_utils/scripts/test_merge_weights.pyrTinyModel.__init__'s_ xxr2. ((--/xxr2. xx'') c`VPVPVPV444#)N)rrr)r"xs&&r$forwardTinyModel.forward.s"||DOODLLO<==r&)rrrr!) __name__ __module__ __qualname____firstlineno__rr)__static_attributes____classdictcell__ __classcell__)r# __classdict__s@@r$rr&s*>>r&rc\P/8wd\4P4\\P \ PR7p\4p\RR7;_uu_4VPV4RRR4\VR7pVPV4pWV3# +'giL1;i))sharding_strategystate_dict_typeSIZE_BASED_WRAP)fsdp_auto_wrap_policyN) fsdp_plugin) r _shared_state _reset_stater r FULL_SHARDrSHARDED_STATE_DICTrrset_auto_wrap_policyrprepare)pluginmodel accelerators r$setuprB2s%%+'') +*55}GgGgF KE 1B C C##E* D&1K    &E + %% D Cs 5B00 C c\^^*R7p\V^RR7p\PP VP 4RR7pVP W1V4wr1p\^4F|pVFspVP4V!VR,4p\PPPWvR,4pVPV4VP4Ku K~ V#))lengthseedF) batch_sizeshuffleg?)lrr(y)rrroptimSGD parametersr>range zero_gradr functionalmse_lossbackwardstep) rAr@ train_settrain_dl optimizer_batchoutputlosss && r$ mock_trainingr[@s!26I)EBH  0 0 2s;I!,!4!4Xi!PHY 1XE OO 5:&F88&&//c CD   & NN   Lr&c\VP4VP44FJwr4VR8Xd!\P!W44'gQhK,\P!W44'gKJQh R#)sameN)zipvaluesrallclose) operationstate_1state_2weight_1weight_2s&&& r$ check_weightsrfPsW!'.."2GNN4DE  >>(55 55~~h99 99 Fr&c*\VR, 4p\4P\4p\ RVP 4VP 44VP V4\ RVP 4VP 44R#)zmodel.safetensorsdiffr]N)rrtor rf state_dictload_state_dict)pathr@safe_state_dictsafe_loaded_models&& r$check_safetensors_weightsroXso': :;O! |4&%**,.?.J.J.LM%%o6&%**,.?.J.J.LMr&cD\P!VR, RR7p\4P\4p\ RVP 4VP 44VPV4\ RVP 4VP 44R#)zpytorch_model.binT) weights_onlyrhr]N)rloadrrir rfrjrk)rlr@nonsafe_state_dictnonsafe_loaded_models&& r$check_pytorch_weightsru`swD+>$>TR$;>>,7&%**,.B.M.M.OP(();<&%**,.B.M.M.OPr&cF\VR, VRR7\W4R#)pytorch_model_fsdp_0Tsafe_serializationN)rror@rls&&r$test_merge_weights_safetensorsr{hst44dtTd*r&c\P\VR, 4\V4.4p\V4\ W4R#)rwN)parser parse_argsstrr ror@rlargss&& r$&test_merge_weights_command_safetensorsrns6   c$)?"?@#d)L MD$d*r&cF\VR, VRR7\W4R#)rwFrxN)rrurzs&&r$test_merge_weights_pytorchrtst44duU$&r&c\P\VR, 4\V4R.4p\V4\ W4R#)rwz--unsafe_serializationN)r}r~rr rurs&& r$"test_merge_weights_command_pytorchrzs9   c$)?"?@#d)Mef gD$$&r&__main__test_merge_weights_fsdp_weightsT)parentsexist_ok):gcloggingshutilpathlibrrsafetensors.torchr2torch.distributed.fsdp.fully_sharded_data_parallelrrtorch.utils.datar acceleraterr accelerate.commands.merger r accelerate.stater accelerate.test_utilsr accelerate.test_utils.trainingraccelerate.utilsrrr basicConfigINFOr}rModulerrBr[rfrorur{rrrr+r@r?rA num_processesout_pathexistsmkdirwait_for_everyonecollect Exceptionis_main_processrmtree end_trainingr&r$rs   '^'BI-.<SS',,'   > > &  :NQ+ + ' '  z!&E6;  1$ '=>H??$$td;"+u5E  ) ) + JJL FK A  ) ) + +5( ; 25( C &uh 7 .uh ? *** h'  ) ) +  $ $ &7%.   *** h'  ) ) +  $ $ &sBF?? GG AH