+ jAaRqtG0t^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RI t ^RI H t H t H t ^RIHt^RIHtHt^RI Ht^RIHtHtHtHtHtHt^RIt^RIHt^RIHtH t ^R I!H"t"^R I#H$t$H%t%^R I&H't']PP!])4t*R R lt+RRlt,RRlt-!RR]4t.!RR] 4t/]!R4t0!RR4t1RRlt2]2!4'dRR.t3MR.t3!RR]4t4R]3R R!R"R#R$R#/R%R&R'/R(R&R#/R)R&R#/R*/R+//R)/R%/R,/R-/R.R/R#//.R0R1R#R2R#/R1R#R2R'/R1R'R2R#/R1R'R2R'/.R3R1R#R2R#/R1R#R2R'/R1R'R2R#/R1R'R2R'/.R4]'!4.R5]'!4./t5]^k] ]6]7],].]3,t8!R6R7]4t9!R8R94t:]:!4t;]<]6R:3,t=!R;R<4t>]?]6]3,t@] .]A3,tB] .]B3,tCR=/R>R#bR?];bR@];bRA];bRB];bRC];bRD];bRE];bRF];bRG];bRH];bRI];bRJ];bRK];bRL];bRM];bRN];b/RO];bRP];bRQ];bRR];bRS];bRT];bRU];bRV];bRW];bRX];bRY];bRZ];bR[];bR\];bR]];bR^];bR_];bCR`];Ra];Rb];Rc];Rd];Re];Rf];Rg];/CRhR4];R5];Ri];Rj];Rk];RlR'//tD]^k!RmRn4tERrRoRplltFR#)sN)CallableKeysViewSequence)Enum)partialwraps) FrameType)Anyget_args get_originLiteralTypeVarUnion#min_cut_rematerialization_partition)CustomGraphPassCustomPartitionerFn)BaseSchedulerNode) _ConfigEntry ConfigModule) OrderedSetc$V^8dQhR\/#returnbool)formats"W/home/luca/screen-checking/.venv/lib/python3.14/site-packages/torch/_inductor/fuzzer.py __annotate__r sHHTHc2WJ;'g\V4VJ#)a: Determines if type_hint is comp_type. There are some type annotations that this doesn't work for. I think it's because some Type annotations are Type Objects and some are Special Forms, but not sure. There's definite room for improvement to make this more general for someone who deeply understands Python types. )r ) type_hint comp_types&&ris_typer%s  ! G GZ %:i%GGr!c$V^8dQhR\/#rr)rs"rr r %s  4 r!cb\V4pV\Jd\V4p\R4V9#R#)z Special case of is_type. NF)r rr type)r#originargss& ris_optional_typer+%s1 "F  "DzT!! r!c$V^8dQhR\/#rr)rs"rr r 2s,,4,r!c VPR8H#)z Special Case of is_type. r)__name__)r#s&ris_callable_typer/2s    ++r!cHa]tRt^9toRtV3RlRltV3RlRltRtVtR#) DummyPassz) A Dummy pass to be used by ConfigFuzzer c`<V^8dQhRS[PPPRR/#)rgraphrN)torchfxr3Graph)r __classdict__s"rr DummyPass.__annotate__>s)ehhnn22tr!cR#N)selfr3s&&r__call__DummyPass.__call__>r!c.<V^8dQhRS[R,/#rrNr )rr7s"rr r8AcDjr!cR#r:r;r<s&ruuidDummyPass.uuidAr?r!r;N r. __module__ __qualname____firstlineno____doc__r=rF__static_attributes____classdictcell__r7s@rr1r19sr!r1cHa]tRt^EtoRtV3RlRltV3RlRltRtVtR#)DummyPartitionerFnz9 A Dummy partitioner function to be used by ConfigFuzzer c <V^8dQhRS[PPRS[S[,RS[RS[S[PPS[PP3,/#)rgm joint_inputskwargsr)r4r5 GraphModulerobjectr tuple)rr7s"rr DummyPartitionerFn.__annotate__Js`OO((&&O6>v6FORUO uxx##UXX%9%99 :Or!c \W3/VB#r:r)r<rSrTrUs&&&,rr=DummyPartitionerFn.__call__Js32NvNNr!c.<V^8dQhRS[R,/#rArB)rr7s"rr rYOrCr!cR#r:r;rEs&rrFDummyPartitionerFn.uuidOr?r!r;NrHrOs@rrQrQEs OO r!rQTc la]tRt^VtoRt]P]!4]P]!4] PPPP] PPP4] P] !R4/t]V3RlRl4t]V3RlRl4tV3RltRtVtR#) TypeExemplarsz> This class returns examples of a Type, given its class name. NcD<V^8dQhRS[S[,RS[R,/#)rtrN)r(r_)rr7s"rr TypeExemplars.__annotate__cs'BB47Bq4xBr!c V\PPVPR4#)z Return an example of a class. N)raTYPE_EXEMPLARSgetr.rcs&rexampleTypeExemplars.examplebs! ++// DAAr!c6<V^8dQhRS[S[,RS[/#)rrcr)r(r_r)rr7s"rr rdks::DG::r!c<VP\P9#r:)r.rarfrhs&rcontainsTypeExemplars.containsjszz]9999r!c<<V^8dQh/S[S[S[3,;R&#)rrf)dictstrr )rr7s"rr rdVs cN r!r;)r.rIrJrKrLrr1rrQr4r5r3r6rrf staticmethodrirm__annotate_func__rMrNrOs@rraraVs   )+$$&8&: %%uxx~~';';'=""$5d$; &NBB::+r!rac$V^8dQhR\/#rr)rs"rr r osTr!cX\P!R4R# \dR#i;i)z"checks if we have halide availablehalideTF) importlib import_moduleModuleNotFoundErrorr;r!rcheck_halide_importrzos*) s  ))tritonrvcNa]tRt^~toRtRtRtRtRtRt Rt V3RlR lt R t Vt R #) Statusz0 The Status return value enum for Config Fuzzer skippedpassedfailed_compilefailed_run_compile_exceptionfailed_run_eager_exceptionfailed_run_returnc <V^8dQhRS[/#rr)rr7s"rr Status.__annotate__s     r!c V\P8H;'gJV\P8H;'g/V\P8H;'gV\P8H#)zE Convenience method to check whether these status represent failure. )r}FAILED_COMPILEFAILED_RUN_EAGER_EXCEPTIONFAILED_RUN_COMPILE_EXCEPTIONFAILED_RUN_RETURNrEs&rfailingStatus.failingsa F)) ) 0 0v888 0 0v::: 0 0v///  r!r;N)r.rIrJrKrLSKIPPEDPASSEDrrrrrrMrNrOs@rr}r}~s9 G F%N#A !=,   r!r} cuda_backendpost_grad_fusion_optionsbatch_linear_post_gradshape_broadcast_batch_linearTfuse_nodes_with_same_usersbatch_aten_mulfuse_nodes_with_same_parentFbatch_aten_sigmoidbatch_aten_addnormalization_aten_passunbind_stack_aten_passbatch_aten_subbatch_aten_div group_linearrequire_fbgemmautoheuristic_collectpad_mmmixed_mmautoheuristic_usetraceable_tensor_subclassesnontraceable_tensor_subclassescda]tRt^toRtRtRt]V3RlRl4t]V3RlRl4t Rt Vt R #) SamplingMethoda  This class handles the process of assigning concrete values to type annotations. So a type annotation of ```python foo: Optional[int] = None ``` Will be assigned an int if the dispatch function gets TOGGLE, or a 50/50 split between an int and None if it gets RANDOM. TOGGLERANDOMc H<V^8dQhRS[RS[RS[S[,RS[RS[/#)r random_sample field_namer#defaultr)rrqr(r )rr7s"rr SamplingMethod.__annotate__sGgTgTgT),gT9=cgTMPgT gTr!c  aaaaS\9d"\P!\S,4#V\Jd(S'd\P!RR.4#V'*#V\Jd\P !^R4#V\ Jd\P!^R4#V\Jdt\P\P,\P,oRPV3Rl\\P !^^4444#\V\ 4'd\#V4;'g9V'd%\%V4'd\'V^,4.M \'R4.^,pV'd\%V4^8d V^,MRp\\P !^^44Uu.uFp\(P+SSWE4NK up#\V\,4'd\!V4p\#V4;'g9V'd%\%V4'd\'V^,4.M \'R4.^,pV'd\%V4^8d V^,MRp\\P !^^44Uu0uFp\(P+SSWE4kK up#\V\.4'd\!V4p\#V4;'g9V'd%\%V4'd\'V^,4.M \'R4.^,pV'd\%V4^8d V^,MRp\/\\P !^^44Uu.uFp\(P+SSWE4NK up4#\V\04'Ed\#V4;'geVeK\%V4'd:\3\5\&\7\9VP;44444M\'R4\'R43wrVeD\%VP;44^8d&\7\9VP;444wrMRRr\\P !^^44Uu/uF0p\(P+SSW4\(P+SSW4bK2 up#\V\<4'g!\V\>P@4'd\#V4p \%V 4^8:d \CR4hS'd\P!V 4p M6\P!V Uu.uFq\'V4JgKVNK up4p V !4p\(P+SSW4#\V\24'dR\#V4;'g\3\5\&V44p\GW4p\3\5VV3RlV44#\V\H4'dv\#V4pV'g \CR 4hS'd\P!V4#VUu.uF qV8wgK VNK ppV'd\P!V4#V#\KV4'd{\#V4pV'g \CR 4hV^,pS'd.\P!R\(P+SSWC4.4#Vf\(P+SSVR4#R#V\'R4JdR#\MV4'dA\#V4pV'g \CR 4hVR,o\OR 4VVV3R l4pV#V\PPRPT8Xd/\PPVPXPZP\#\^PaV4'd\^PcV4#V\d8Xd V^8wd^#^#\CRV R24huupiuupiuupiuupiuupi \DdRpELi;iuupi)z3 Generates a value of a type based on the setting. TFc3P<"TFp\P!S4xK R#5ir:)randomchoice).0_ characterss& r :SamplingMethod._generate_value_for_type..s!3Oa j))3Os#&NzUnion type with no argscP<\PSSV^,V^,4#)rr_generate_value_for_type)xrrs&r9SamplingMethod._generate_value_for_type..@s!nEE%z1Q41r!zLiteral type with no argszOptional type with no argszCallable type with no argscR#r:r;)r*rUs*,rrros4r!c4<\PSSSR4#r:r)r*rUrr return_types*,rdummy_function?SamplingMethod._generate_value_for_type..dummy_functionos%>>!:{Dr!zUnable to process type z. PRs welcome :))3TYPE_OVERRIDESrrrintrandintfloatuniformrqstring ascii_lettersdigits punctuationjoinranger%listr lenr(rrsetrrprXmapnextiteritemsrtypes UnionType ValueError Exceptionzipr r+r/rr4_ops OpOverloadopsatenaddrrarmrir )rrr#r elem_type new_defaultr indexablekey_type value_type default_key default_val union_argsnew_typercr*zipped literal_argschoices optional_args callable_argsrrrsff&& @@rr'SamplingMethod._generate_value_for_types  '== !;< <  3@6==$/ Q'k Q # >>!T* * % >>!T* * # -- =@R@RRJ773829N3O Y % %#VV*1c'llT'!*%&d I)0CL14D'!*$K v~~a34 5A77!:y5   Y $ $W I#XX,3G T)A,'(4PT:,I+2c'lQ6F)A,DK v~~a34 5A77!:y5   Y + +W I#XX,3G T)A,'(4PT:,I+2c'lQ6F)A,DK #6>>!Q#78 9#;;%z99  Y % %#+I#6$$'CLLc$T'--/%: ;<=4j$t*- !H "s7==?';a'?+/W]]_0E+F( [+/[v~~a34  5A 77!:x!::!:z 5  Y & &')U__*M*M!),J:!# !:;;!==4!== *E 1tG}.DQQ E #&j "::z8 Y & &I&CC%D'0B*CD'F  Y ( (#I.L !<==}}\22&2Cl7l11lC!==11"N i ( ($Y/M  !=>>%a(I}}&??):y?)BB%z9d $t* $ i ( ($Y/M  !=>>'+K / 0 1  " ! %**// /99>>%%-- -  # #I . . ((3 3 # 1 1 +! +6ykAQRS SU""F #"  #2DsB `6) `; a,6a4a  a a2a#?a# a a c$<V^8dQhRRRS[/#)rsmrr) SamplingType)rr7s"rr rs A A% A, Ar!c V\P8Xd\\PR4#V\P8Xd\\PR4#\ RV 24h)zb Returns a function that will generate values from a type, based on the SamplingMethod passed in. TFzmalformed sampling method: )rrrrrr)rs&rdispatchSamplingMethod.dispatchsY && &>BBDI I >(( (>BBEJ J:2$?@ @r!r;N) r.rIrJrKrLrrrrrrrMrNrOs@rrrsCF FgTgTR A Ar!rc]tRtRtRtRtR#)Defaultizn Singleton default object that will cause the ConfigFuzzer to always use the default value set in the config. r;N)r.rIrJrKrLrMr;r!rrrsr!r.ca]tRtRtoRtV3RlRltV3RlRltV3RlRltV3R lR ltV3R lR lt V3R lRlt V3RlRlt V3Rlt Rt VtR#) ResultTypeizX The mapping of the combo strings to the result status after running the config fuzzer. c <V^8dQhRS[/#rrq)rr7s"rr ResultType.__annotate__s++#+r!c"RVP R2#)z ResultType[]_valsrEs&r__repr__ResultType.__repr__sTZZL**r!c<V^8dQhRR/#rAr;)rr7s"rr rs$r!c/VnR#r:rrEs&r__init__ResultType.__init__s  r!c <V^8dQhRS[/#rr)rr7s"rr rsr!c,\VP4#r:)rrrEs&r__len__ResultType.__len__s4::r!c <V^8dQhRS[/#rr)rr7s"rr rsr!c \VP4pVPP4F#pV\P8XgKV^,pK% V#)z9 Returns how many combos actually ran (weren't skipped). )rrvaluesr}r)r<retstatuss& rnum_ranResultType.num_ransD$**ojj'')F'q* r!c*<V^8dQhRS[RS[RR/#)rcomborrN ComboTyper})rr7s"rr rs"###F#t#r!cJ\\V44pW PV&R#r:)rXsortedr)r<rrs&&&rrResultType.setsfUm$" 5r!c4<V^8dQhRS[RS[R,/#)rrrNr)rr7s"rr rs++I+&4-+r!cb\\V44pVPPVR4#r:)rXrrrg)r<rs&&rlookupResultType.lookups%fUm$zz~~eT**r!c0<V^8dQhRS[S[,/#r)rr)rr7s"rr rs!!hy)!r!c6VPP4#r:)rkeysrEs&rrResultType.keysszz  r!c<<V^8dQh/S[S[S[3,;R&#)rr)rprr})rr7s"rr rs  6! "" r!rN)r.rIrJrKrLrrr rrrrrsrMrNrOs@rrrsX ++##++!!Er!rztorch._inductor.configforce_disable_cacheszcpp.cxx TYPE_CHECKINGmax_autotune_pointwisemax_autotune_gemmmax_autotune_gemm_backendsmax_autotune_conv_backendsmax_autotune_gemm_search_space+max_autotune_subproc_result_timeout_seconds-max_autotune_subproc_graceful_timeout_seconds.max_autotune_subproc_terminate_timeout_secondszaot_inductor.presetsz cuda.archz cuda.versionzcuda.cutlass_dirz cuda.cuda_cxxz rocm.archzrocm.ck_supported_archz rocm.ck_dirzrocm.rocm_home"check_stack_no_cycles_TESTING_ONLYsleep_sec_TESTING_ONLYz#triton.inject_relu_bug_TESTING_ONLY reorder_for_compute_comm_overlapenabled_metric_tablesprofile_bandwidth_regexdisable_cpp_codegenztrace.save_real_tensorspre_grad_fusion_optionsexternal_matmulz'test_configs.autotune_choice_name_regexz'test_configs.autotune_choice_desc_regexz'cpp.enable_floating_point_contract_flagpost_grad_custom_pre_passpost_grad_custom_post_pass'reorder_for_compute_comm_overlap_passesjoint_custom_post_passjoint_custom_pre_passpre_grad_custom_passcustom_partitioner_fninductor_choices_classcudagraph_policyztorch._dynamo.config!compiled_autograd_kwargs_overridefail_on_recompile_limit_hitsuppress_errorscaching_precompileca]tRtRtoRtR]P R3V3RlRlltV3RlRltV3R lR lt V3R lR lt V3R lRlt V3RlRlt V3RlRlt V3RlRltV3RlRltR)V3RlRlltR*V3RlRlltR*V3RlRlltV3RlRltV3RlR ltR+V3R!lR"lltV3R#lR$ltV3R%lR&ltV3R'ltR(tVtR#), ConfigFuzzeri a This tool makes it easy to search through config state-space with a minimal reproduction or test, either for debugging or just bug hunting. It has two entry points: - bisect, which randomly flips configs and tries to find the minimal reproduction upon failure. - fuzz_n_tuple, which tries every combination of n configs. This grows quickly as a function of n, so beware. bisect is recommended, but fuzz_n_tuple can give you peace of mind that a new config will compose with every other config. The main interface is a function factory that will return Callables to be torch.compiled. This function factory should return a test function when it's called. Said test function returns a boolean, which determines whether the ConfigFuzzer considers it a successful run or not. Throwing an exception from within the function will be considered a failure as well. # Example usage: ```python import torch._inductor.config as cfg def create_simple_test_model_gpu() -> FactoryOutputType: batch_size = 32 seq_length = 50 hidden_size = 768 def test_fn() -> bool: inp = torch.randn(batch_size, seq_length, hidden_size, device="cuda") weight = torch.randn(hidden_size, hidden_size, device="cuda") matmul_output = inp @ weight final_output = torch.nn.LayerNorm(hidden_size, device="cuda")(matmul_output) return True return test_fn fuzzer = ConfigFuzzer(cfg, create_simple_test_model_gpu, seed=2) # Test every pair of configs: results = fuzzer.fuzz_n_tuple(n, max_combinations=10000000) visualize_results(n, results) # Test random configs with bisection: ret = fuzzer.bisect(num_attempts=10) # reproduce a failing config fuzzer.reproduce( [{"triton.autotune_pointwise": ..., "coordinate_descent_tuning": ...}] ) ``` The list of known failures on inductor config are: cpp_wrapper, disable_cpp_codegen combo_kernels, benchmark_combo_kernel, profile_bandwidth, profile_bandwidth_regex trace.enabled, trace.save_real_tensors Nic L<V^8dQhRS[RS[RS[RS[R,RS[RS[/#)r config_moduletest_model_fn_factoryseedrNr test_timeout)r FactoryTyper ConfigTyper)rr7s"rr ConfigFuzzer.__annotate__HsL!#!##!# +!# !# d" !#  !#!#r!c fW0nW`n/VnWnW nVPP Vn\PV4Vn VfSVPP\9d)\VPP,Vn R#\R4hW@n R#)a Args: config_module: The module containing the configs to fuzz test_model_fn_factory: Function that returns a test model, which runs and returns True if successful, or the outputs if they should be compared with eager seed: Randomness seed. default: Default values for the config. Inductor has preset based on known failures. sm: How type value samples are generated, default TOGGLE. test_timeout: max time a test can take. Nz"No default passed to ConfigFuzzer.)rFrGdetailed_resultsrDrE_configfieldsrrsampler.MODULE_DEFAULTSrr)r<rDrErFrrrGs&&&&&&&rrConfigFuzzer.__init__Hs& (AC*%:"/3/A/A/I/I $--b1 ?!!**o=.t/A/A/J/JK  !EFF"Lr!c <V^8dQhRS[/#rr)rr7s"rr rJks  # r!c pRVP RVP RVP RVP R2 #)zConfigFuzzer(config_module=z, test_model_fn_factory=z, seed=z , default=))rDrErFrrEs&rrConfigFuzzer.__repr__ksH)$*<*<)=>%%)%?%?$@ {R\]a]i]i\jjk m r!c*<V^8dQhRS[RS[RR/#)rrvaluerN)rqr )rr7s"rr rJqs"77c7#7$7r!c 2\VPW4R#)z!Set a config value in the module.N)setattrrD)r<rrWs&&&r _set_configConfigFuzzer._set_configqs""J6r!c<V^8dQhRR/#rAr;)rr7s"rr rJus<<-F-F F1    s5Ac6<V^8dQhRS[S[,RS[/#)rconfigsr)rrIr)rr7s"rr rJs *!5*r!c N\4pVFpVPW24K V#)z#entrypoint to reproduce any failurer_reproduce_single_helper)r<riresultsconfs&& r reproduceConfigFuzzer.reproduces&,D  ) )$ 8r!c*<V^8dQhRS[RS[RR/#)rrnrmrNrIr)rr7s"rr rJs(JJZJ*JQUJr!c \RV 24VP4pVPV4VPW#4\RV RVP \ VP 444 24R#)zStarting repro of z Status of z: N)printrfupdate test_configrrXr)r<rnrmrfs&&& rrl%ConfigFuzzer._reproduce_single_helpersd "4&)*__& $ - 4&GNN53E$F#GHIr!c&<V^8dQhRS[RS[/#)rconfigrrr)rr7s"rr rJszjr!c<\4pVPW4V#r:rk)r<ryrms&& rreproduce_singleConfigFuzzer.reproduce_singles, %%f6r!c,<V^8dQhRS[RS[RS[/#)rrmrr)rrr})rr7s"rr rJs"11J1y1V1r!c\V4VPV4;p'dV#VP4pRpVFapWd9dRpVPR4'dRpVPV,pVP WgP VP4pWV&Kc V'd1VPV\P4\P#VPW4#)FTr) rtrrf startswithrNrOrrrr}rrv) r<rmrstryskiprfieldrWs &&& r _fuzz_helperConfigFuzzer._fuzz_helpers e & &2 &I"J#$$S))KK +EKK ,<,> !00r!c,<V^8dQhRS[RS[RS[/#)rnmax_combinationsr)rr)rr7s"rr rJs"cSJr!c l\4p\RV RVP 24\P!VP4\P !VP V4FIpVPW44pV\P8wgK+V^,pV^8:gK=\R4V# V#)zp Test every combination of n configs. returns a dict of this shape: {(config-1, config-2... config-n): status} z Starting z-tuple testing with seed z"Reached maximum combinations limit) rrtrFr itertools combinationsrNrr}r)r<rrrmrrs&&& r fuzz_n_tupleConfigFuzzer.fuzz_n_tuples , !5dii[AB DII++DKK;E""72BV^^# A% #q(>?<r!c$<V^8dQhRS[RR/#rfilenamerNr)rr7s"rr rJs3r!c \VR4;_uu_4p\P!RVPRVP/V4RRR4R# +'giR#;i)z'Save the current fuzzer state to a filewbrmrLN)openpickledumprmrL)r<rfs&& r save_stateConfigFuzzer.save_statesF (D ! !Q KKDLL*S>STVW " ! ! !s 0A A c$<V^8dQhRS[RR/#rr)rr7s"rr rJsFF3FFr!c \VR4;_uu_4p\P!V4pVR,VnVP R/4VnRRR4R# +'giR#;i)zLoad fuzzer state from a filerbrmrLN)rrloadrmrgrL)r<rrstates&& r load_stateConfigFuzzer.load_statesM (D ! !QKKNE +DL$)II.@"$ED !" ! ! !s .__annotate__s , ,d ,r!cZ<SP4Fwr\V RV 24K R#)z = N)rrt)rrWrys r print_config.ConfigFuzzer.test_config..print_configs( &  s5'*+!/r!cRV^8dQhR\R\\\3,/#)rexcr)rrprqr )rs"rr rs"    d38n r!ch<R\V4R\P!4RSP4/#) exception tracebackry)rqr format_exccopy)rrys&rget_error_info0ConfigFuzzer.test_config..get_error_infos/SXY113&++- r!c bV^8dQhR\R\R\R\R,R\/#)rmessage return_statusprint_tracebackrNr)rqr}rr)rs"rr rs? ! ! !! !" !T!  !   !r!c<\P!\PS4\V R24S!4V'dS!V4S PS&V'd\P !4SP SV4V#)z with config combination:)signalSIGALRMrtrLr print_excr) rrrr config_tupleroriginal_handlerrrmr<s &&&&r handle_return/ConfigFuzzer.test_config..handle_returnsh MM&..*: ; WI67 8 N6DS6I%%l3##% KK m 4 r!zEager exceptionTNinductor)backendzException compilingzException running compiledzFunction returned FalseFzFunction succeeded)rrralarmrGrtrXrrr4_dynamoresetr_rrZrErr}rcompilerrrr)r<rmryrrrdrW test_model_fnrtest_model_fn2compcompile_resultrrrrsfff @@@@rrvConfigFuzzer.test_configs"==9M9MN T&&' x()V[[]+ ... .3 . MM&..*: ;J , ,   ! !"   !<<>KD   T )*224   O !779N==DD !VN )6+C+CUD !!5v}}eTR R?  !6#D#DdC    %v'<'I I c<<V^8dQhRS[RS[RS[S[,/#)r num_attemptspr)rrrrI)rr7s"rr rJ$s'##3##jAQ#r!c L\RVP RV 24\P!VP4VP4\ 4p.p\ V4EF<p\RV^, RV 24VP 4pVPP4FuwrxWv9gK VPR4'dK&RV9gK/\P!4V8gKKVPWxPVP4p WV&Kw VPW64p V \\P \P".49gEKVP%W64;p 'gEK\RV 24VP'V 4EK? V#)z; Test configs and bisect to minimal failing configuration. z-Starting random testing with bisection, seed z, and p zRandom attempt /r TESTING_ONLYzMinimum failing config: )rtrFrr_rrrfrNrrrOrrrvrr}rr_bisect_failing_configappend) r<rrrmrattemptryr config_entryrWrminimal_failing_configs &&& rbisectConfigFuzzer.bisect$sd =dii[QRPSTU DII , "\*G OGaK=,@ A__&F,0KK,=,=,?( ,&11#66&j8 !+ KK"$;$;\=Q=QE*/:&-@%%g6FZ(GHH-1-H-H.)45K4LMNJJ56/+2 r!c:<V^8dQhRS[RS[RS[R,/#rrmfailing_configrN)rrI)rr7s"rr rJIs/YY!Y3=Y d Yr!cTVPV\VP444#r:)_bisect_failing_config_helperrr)r<rmrs&&&rr#ConfigFuzzer._bisect_failing_configIs%11'4@T@T@V;WXXr!c`<V^8dQhRS[RS[S[S[S[3,,RS[R,/#r)rrrXrqr rI)rr7s"rr rJNs74$4$!4$37c3h3H4$ d 4$r!c aa\RV 24V'gR#RVV3Rllp\V4^8:d*V!V4P4'd \V4#R#\P !V4\V4^,pVRVpW$RpV!V4P4'dSP SV4#V!V4P4'dSP SV4#\V4^8d\V4^,pWG,pW'Rp V!V 4P4'dSP SV 4#VRVV,p V!V 4P4'dSP SV 4#WRRV,p V!V 4P4'dSP SV 4#W(Rp V!V 4P4'dSP SV 4#\\V44FYp \V4UUu.uFwrW8wgK VNK pppV!V4P4'gKGSP SV4u# \V4#uuppi)z Bisect a failing configuration to find minimal set of configs that cause failure. Splits it into halves, then fourths, then tries dropping configs one-by-one. zbisecting config: NchV^8dQhR\\\\3,,R\/#)rrr)rrXrqr r})rs"rr @ConfigFuzzer._bisect_failing_config_helper..__annotate__[s'  DsCx) f r!cB<\V4pSPSV4pV#r:)rprv)rdresultrmr<s& rtest8ConfigFuzzer._bisect_failing_config_helper..test[s#QA%%gq1FMr!) rtrrrprshufflerr enumerate)r<rmrrmid first_half second_halflowhighquart1quart2quart3quart4ijrnew_listsff& rr*ConfigFuzzer._bisect_failing_config_helperNs6 ">"234   ~ ! #+/+?+G+G+I+I4' St S~&.!Q&#DS) $T*   # # % %55gzJ J   $ $ & &55g{K K ~ ! #n%*C9D#D)FF|##%%99'6JJ#DS)K7FF|##%%99'6JJ$"77FF|##%%99'6JJ#E*FF|##%%99'6JJs>*+A&/&?J&?da16&?HJH~%%''99'8LL, N## Ks  I( I(c2<V^8dQh/S[;R&S[;R&#)rrOr)rrI)rr7s"rr rJ s#t uvwr!) rDrrLrNrmrOrFrErG)r)zfuzzer_state.pkl)dg?)r.rIrJrKrLrrrrrZr_rfrorlr{rrrrrrvrrrrsrMrNrOs@rrBrB s7B&*+22 !#!#F  77<< JJ 110(FF77PSPSd##JYY 4$4$G r!rBc@V^8dQhR\R\R\RR/#)rrrmrrN)rrrq)rs"rr r s2j!j! j!j!+.j! j!r!cV^8wd\RV 24h\V4^8:d \R4h\/4pVP4F3pVP V^,4VP V^,4K5 \ V4pRpVR, pVF!pRP V4pVRV R2, pK# VR, pVFp VR V R2, pVFpVPW34p R p R p V \P8XdR p R p MV \P8XdR p Rp MlV \P8XdRp Rp MRV \P8XdRp Rp M8V \P8XdRp Rp MV \P8XdRp Rp MR p R p VRV RV R2, pK VR, pK VR, p\VR4;_uu_4p V P!V4RRR4R# +'giR#;i)zh Creates an HTML document representing the results of running the fuzzer with fuzz_n_tuple, with n = 2. zexpected n == 2, got zexpected non-empty resultsa Fuzzer Visualization

Fuzzer Visualization

zz
zzzzz?
\z
rr~-rOfailedeERCz z
wN)AssertionErrorrrrrrrrr}rrrrrrrwrite)rrmr input_setkey input_list html_contentcol_namecolrow_name status_enum status_class status_valfiles&&& rvisualize_resultsrs Av4QC899 7|q9::!+BI||~ c!f c!f "J&LP%%Lkk(#$se5)) **L(8*E22 "H!..()=>KLJfnn,(   -'   A AA'   C CC'   8 88'   5 55'  (  k,r*UK KL7#8  =@L h   <     s G00 H cV^8dQh/^\9d&\\\\,3,;R&^\9d\\\ 3,;R&#)rrrP)__conditional_annotations__rprqrr rI)rs"rr r sN~$$S$s)^$$d55c:o&5er!)z results.html)Hrrwrloggingrrrrrrcollections.abcrrrenumr functoolsrrr typingr r r r rrr4functorch.compiler!torch._inductor.custom_graph_passrrtorch._inductor.schedulerrtorch.utils._config_modulerrtorch.utils._ordered_setr getLoggerr.logr%r+r/r1rQr_rarz CUDA_BACKENDr}rrqr(rrrrcrXrrrprIrFactoryOutputTyperHrPrBrr )rs@rr"s  88$EE AR7A/!H ,   ,  CL::2h'L:L T FL $.,d' $z|nG$($Jd3i-s23 AATAAH ) #s(O #!#!N#s(^ RX&r,,- "++7+ + !' + W + %g + %g+ )'+ 6w+ 8+ 9'+ + W+ + G+ !+" W#+$ !'%+& w'+( ')+* -g++, !'-+. .w/+0 +G1+2 3+4 "75+6 w7+8 "79+: "7;+< 7=+> 27?+@ 27A+B 27C+D $WE+F %g17 ' 'GU+X%w('+W%w7e [5*5pw$w$t j!j!r!