+ jL"6^RIt^RIHtHt^RIHt^RIHtHtH t ^RI H t H t ^RI HtHtHtHt^RIHtHt]P*!]4t]!4'd^RIt]!4'd^RIt!RR ]R R 7t]!RR 7]!R R]444tR.tR#)N) AudioInputmake_list_of_audio) BatchFeature)ProcessingKwargsProcessorMixinUnpack)PreTokenizedInput TextInput)auto_docstringis_soundfile_availableis_torch_availablelogging)requiresrequires_backendsc"]tRt^$tRRR//tRtR#)VibeVoiceProcessorKwargs audio_kwargs sampling_ratei]N)__name__ __module__ __qualname____firstlineno__ _defaults__static_attributes__rs/home/luca/screen-checking/.venv/lib/python3.14/site-packages/transformers/models/vibevoice/processing_vibevoice.pyrr$s U IrrF)total)backendscaa]tRt^,to]tR V3RlltV3RlRltV3RlRlt] R V3RlV3Rlll4t R V3RlR llt R t Vt V;t#)VibeVoiceProcessorc <W@n\VRR4'd VPMVPV4VnWPn\VRR4'd VP MVPV4VnW`n\VRR4'd VPMVPV4Vn\SV`%WVR7R#)a audio_bos_token (`str`, *optional*, defaults to `"<|vision_start|>"`): The token used to indicate the beginning of audio generation. audio_eos_token (`str`, *optional*, defaults to `"<|vision_end|>"`): The token used to indicate the end of audio generation. audio_token (`str`, *optional*, defaults to `"<|vision_pad|>"`): The token used to indicate to continue generating audio. audio_bos_token_idNaudio_eos_token_idaudio_token_id) chat_template) audio_bos_tokengetattrr#convert_tokens_to_idsaudio_eos_tokenr$ audio_tokenr%super__init__)selffeature_extractor tokenizerr&r'r*r+ __class__s&&&&&&&rr-VibeVoiceProcessor.__init__1s" /y"6==  ( (00A  /y"6==  ( (00A  'y"2D99  $ $00=  *]Src <V^8dQhRS[/#)audio)r)format __classdict__s"r __annotate__VibeVoiceProcessor.__annotate__Vs33J3rc VP!V3/VBpVPR4;'gVPPp\P!VR,P RR7V, 4P 4P4Vn\\V44Uu.uFqPPW54NK ppW63#uupi)pad_to_multiple_of padding_mask)dim) r/getr;torchceilsuminttolist_num_audio_tokensrangelenreplace_audio_token)r.r5kwargsprocessed_audior;idxaudio_replacementss&&, r_process_audio!VibeVoiceProcessor._process_audioVs00A&A#ZZ(<=jjAWAWAjAj JJ~6::r:BEWW X \ \ ^ e e g Y^^abg^hXijXiQT66LXij22ks.C c,<V^8dQhRS[RS[RS[/#)r4 audio_inputs audio_idxreturn)dictrCstr)r6r7s"rr8r9_s'DDDDDrcJVPVPV,,#N)r+rE)r.rPrQs&&&rrH&VibeVoiceProcessor.replace_audio_token_s$"8"8"CCCrc <V^8dQhRS[S[,S[S[,,S[S[,,RS[R,RS[R,RS[S[,RS[/#)r4textr5N output_labelsrIrR)r r listrboolrrr)r6r7s"rr8r9csf99++d9o=EV@WW9D 9d{ 9 12 9  9rc <RV9d1VR,R8wd#\VPP R24h\SV`!R RVRV/VBpV'dVR,P 4pRV9dR WeR,^8H&R WfVP 8H&WeR&\P!VR,\PR 7pVeR WuR,VP 8H&WuR &V#)ad Main method to process text inputs with optional voice samples. This method processes text inputs (typically prepared by apply_chat_template) and optional voice samples for voice cloning. It expands audio diffusion tokens based on the actual audio length. Args: text (`str`, `List[str]`): The input text(s) to process, typically prepared by apply_chat_template with audio token placeholders. audio (`List[Union[str, np.ndarray]]`, *optional*): Audio samples for speaker voice cloning. Should match the number of audio token placeholders in text. output_labels (bool, *optional*, default=False): Whether to return labels for training. **kwargs: Additional keyword arguments passed to the tokenizer and feature extractor. Returns: [`BatchFeature`]: A [`BatchFeature`] with the following fields: - **input_ids** -- List of token ids to be fed to the model. - **attention_mask** -- List of indices specifying which tokens should be attended to by the model (when `return_attention_mask=True`). - **input_values** -- List of audio values to be fed to the model. Returned when `audio` is not `None`. - **padding_mask** -- List of indices specifying which audio frames should be attended to by the model. Returned when `audio` is not `None`. - **labels** -- Labels for language model training. Padding and audio diffusion tokens are masked with -100 (audio diffusion token embeddings are replaced by audio features, so their token identity is not a meaningful target). Audio bos/eos and text eos tokens are kept as targets so the LM learns when to start and stop generating audio. Returned when `output_labels=True`. - **acoustic_loss_mask** -- Boolean mask for positions where diffusion loss is computed. True at audio diffusion token positions. Returned when `output_labels=True`. return_tensorsptz% only supports `return_tensors='pt'`.rYr5 input_idsattention_masklabels)dtypeTacoustic_loss_maskri) ValueErrorr1rr,__call__cloner%r@ zeros_liker\) r.rYr5rZrIdatarbrdr1s &&&&, rrfVibeVoiceProcessor.__call__bsN v %&1A*Bd*J 7 788]^_ _wATAA&A +&,,.F4'6:,-2359FT000 1#N!&!1!1${2C5::!V  OS" #48K8K#KL);% & rcJ<V^8dQhRS[RS[R,RS[S[,/#)r4r5 output_pathNrR)rrTr[)r6r7s"rr8r9s1%%%4Z% c %rc \VR.4\V4p\V4FOwr4VP4P 4P 4P 4P4W&KQ \V4^8Xd<VfRp\P!W!^,VPP4V.#VfRp\P!VRR7.p\V4Fewrg\PP!VRV R24p\P!WVPP4VP#V4Kg V#)a  Save audio data to WAV file(s). TODO eventually move to AudioProcessor base class. Args: audio: Audio output from the model to be saved output_path: Output file path or directory for multiple files Returns: List[str]: Paths to the saved audio files. soundfilezvibevoice_output.wavvibevoice_outputsT)exist_okaudio_z.wav)rr enumeratedetachcpufloatnumpysqueezerGsfwriter/rosmakedirspathjoinappend) r.r5rlrKitem saved_pathsi audio_array file_paths &&& r save_audioVibeVoiceProcessor.save_audios" $ ."5)"5)IC**,224::<DDFEJ* u:?"4 HH[(D,B,B,P,P Q= "1 KK d 3K"+E"2GGLLqc6FG 1G1G1U1UV""9-#3r)rEr'r#r*r$r+r%)Nz<|vision_start|>z<|vision_end|>z<|vision_pad|>)NFrV)rrrrrvalid_processor_kwargsr-rMrHr rfrr__classdictcell__ __classcell__)r1r7s@@rr!r!,sS6#TJ33DD999v%%%rr!)r@)rz audio_utilsrrfeature_extraction_utilsrprocessing_utilsrrrtokenization_utils_baser r utilsr r r rutils.import_utilsrr get_loggerrloggerr@rnrxrr!__all__rrrrs 94HHCXX=   H %/u :UUUp r