+ j<Rt^RIHt^RIHt^RIHt^RIHtH t ] P!] 4t ]!RR7]!RR]444t ]!RR7]!R R ]444tR .tR #) zEvolla model configuration)strict)PreTrainedConfig)RopeParameters)auto_docstringloggingzwestlake-repl/Evolla-10B-hf) checkpointcxa]tRt^toRtRt^t^tRt^!t ^t Rt Rt Rt RtRtRtR tR tR tR tR tR tV3R ltRtVtR#) SaProtConfiga mask_token_id (`int`, *optional*, defaults to 4): The id of the *mask* token in the protein sequence model. position_embedding_type (`str`, *optional*, defaults to `"rotary"`): The type of position embedding to use in the protein sequence model. Currently only `"rotary"` is supported. rope_theta (`float`, *optional*, defaults to 10000.0): The base period of the RoPE embeddings. emb_layer_norm_before (`bool`, *optional*, defaults to `False`): Whether to apply layer normalization before the position embedding in the protein sequence model. token_dropout (`bool`, *optional*, defaults to `True`): Whether to apply dropout to the tokens in the protein sequence model. iii皙?i{Gz?h㈵>rotaryg@FTc<V^8dQh/S[;R&S[;R&S[;R&S[;R&S[;R&S[;R&S[;R&S[S[,;R&S[S[,;R &S[;R &S[;R &S[;R &S[;R &S[;R&S[;R&S[;R&S[;R&S[;R&#) vocab_size mask_token_id pad_token_id hidden_sizenum_hidden_layersnum_attention_headsintermediate_sizehidden_dropout_probattention_probs_dropout_probmax_position_embeddingsinitializer_rangelayer_norm_epsposition_embedding_type rope_thetaemb_layer_norm_before token_dropout is_decoderadd_cross_attention)intfloatstrbool)format __classdict__s"p/home/luca/screen-checking/.venv/lib/python3.14/site-packages/transformers/models/evolla/configuration_evolla.py __annotate__SaProtConfig.__annotate__s !"#$%&'()*!+,!-.*/0#(#+312!'34#56!78!+9:;< '=>?@AB%CN)__name__ __module__ __qualname____firstlineno____doc__rrrrrrrrrrrrrrrrr r!__annotate_func____static_attributes____classdictcell__)r's@r(r r sx JMLK!!'*03 #'#!N#+J"'MJ %Cr+r caa]tRt^>toRtRtR]/tRtRt Rt Rt Rt ^ t ^ t^tR tR tR tRtR tR tR t^tRtRt^t^t^@t^t^@t^tRt Rt!Rt"Rt#R t$R t%R t&R t'V3Rlt(V3Rlt)Rt*Vt+V;t,#) EvollaConfiga protein_encoder_config (`dict`, *optional*): Dictionary of configuration options used to initialize [`SaProtConfig`]. aligner_ffn_mult (`int`, *optional*, defaults to 4): The FFN multiplier for the aligner layer. aligner_enable_bias (`bool`, *optional*, defaults to `True`): Whether to use bias in the aligner layer. aligner_attention_probs_dropout_prob (`float`, *optional*, defaults to 0.1): The dropout ratio for the attention probabilities in the aligner layer. aligner_num_add_layers (`int`, *optional*, defaults to 8): The number of additional layers for the aligner layer. resampler_depth (`int`, *optional*, defaults to 6): The depth of the resampler layer in the llama model. resampler_dim_head (`int`, *optional*, defaults to 64): The dimension of the heads in the resampler layer in the llama model. resampler_heads (`int`, *optional*, defaults to 8): The number of heads in the resampler layer in the llama model. resampler_num_latents (`int`, *optional*, defaults to 64): The number of latents in the resampler layer in the llama model. resampler_ff_mult (`int`, *optional*, defaults to 4): The FFN multiplier for the resampler layer. Example: ```python >>> from transformers import EvollaModel, EvollaConfig >>> # Initializing a Evolla evolla-10b style configuration >>> configuration = EvollaConfig() >>> # Initializing a model from the evolla-10b style configuration >>> model = EvollaModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```evollaprotein_encoder_configgANiii8silui r FgTr r ii c <VPf&\4Vn\PR4M:\ VP\ 4'd\R/VPBVn\ SV`!R/VBR#)NzX`protein_encoder_config` is `None`. Initializing the `SaProtConfig` with default values.r,)r8r loggerinfo isinstancedictsuper __post_init__)selfkwargs __class__s&,r(r@EvollaConfig.__post_init__s_  & & .*6.D ' KKr s 33T : :*6*U9T9T*UD ' ''r+c<V^8dQh/S[S[,R,;R&S[;R&S[;R&S[;R&S[;R&S[;R&S[R,;R&S[;R &S[;R &S[;R &S[S[,R,;R &S[;R &S[S[,R,;R&S[;R&S[R,;R&S[R,;R&S[R,;R&S[R,;R&S[R,;R&S[R,;R&S[R,;R&S[R,;R&S[R,;R&S[;R&S[R,;R&S[R,;R&S[S[S[,,R,;R&S[;R&S[;R&S[R,;R&S[R,;R &#)!rNr8rrrrrnum_key_value_heads hidden_actr rms_norm_epsrope_parametersattention_biasattention_dropoutmlp_biasaligner_ffn_multaligner_enable_bias$aligner_attention_probs_dropout_probaligner_num_add_layersresampler_depthresampler_dim_headresampler_headsresampler_num_latentsresampler_ff_multrr bos_token_id eos_token_id use_cachetie_word_embeddingsr r!)r>rr"r$r#rr%list)r&r's"r(r)EvollaConfig.__annotate__>s9X!#33d:AYZ[\]^"_`ab!cdt'efgh!'ijkl$d*T18mn ops{T)/qrstDj$uv+wx+0$,s# JJ+\:KM=AJK"!&'J#'L48O N,/H#$'+9<()*"#O%'"#O(*$%##L%L+1LI %#J',(Yr+r6N)r1huggingface_hub.dataclassesrconfiguration_utilsrmodeling_rope_utilsrutilsrr get_loggerr-r;r r6__all__r,r+r(rfs!.31,   H %89&#&:&D89P(#P(:P(f  r+