+
j R t ^ RIt^RIHt ^RIHtHtHt ^RIH t H
t
^RI H t H
t
! R R]RR 7 t]
P ! ]4 t] ! R
R ]4 4 tR .tR# ) z
Processor class for Donut.
N)
ImageInput)ProcessingKwargsProcessorMixinUnpack)PreTokenizedInput TextInput)auto_docstringloggingc & ] tR t^tRRRRR//tRtR# )DonutProcessorKwargs text_kwargsreturn_mm_token_type_idsF return_text_replacement_offsets N)__name__
__module__ __qualname____firstlineno__ _defaults__static_attributes__r k/home/luca/screen-checking/.venv/lib/python3.14/site-packages/transformers/models/donut/processing_donut.pyr r s & -u
Ir r F)totalc a a ] tR t^&t o]tRV 3R llt]RV3R lV 3R lll4 t] V 3R l4 t
RR lt Rt Vt
V ;t# ) DonutProcessorc & < \ SV ` W4 R # )N)super__init__)selfimage_processor tokenizerkwargs __class__s &&&,r r DonutProcessor.__init__* s
4r c < V ^8 d QhRS[ R, RS[S[, S[S[, , S[S[, , R, RS[S[, /# ) imagesNtextr! )r r r listr r )format
__classdict__s "r __annotate__DonutProcessor.__annotate__. sT T! ++d9o=EV@WWZ^^ -. r c < Ve Ve VP RR4 \ SV ` ! RRVRV/VB pVe Ve
VR, VR& V# )Nadd_special_tokensFr& r' input_idslabelsr )
setdefaultr __call__)r r& r' r! model_inputsr" s &&&, r r2 DonutProcessor.__call__- s] $"2 2E : w'KvKDKFK 2%1+%>L "r c ( < \ SV ` R ., # )r0 )r model_input_names)r r" s &r r6 DonutProcessor.model_input_names< s w(H:55r c Vf V P P 4 p/ pV' Ed \ P ! RV\ P 4 pVf EMWP 4 R pRV9 d EMdVRVP
R4 ^, pV\ R4 \ R4 ) p\ P ! V4 p\ P ! RV R2V\ P 4 p V f VP VR4 pK V P 4 p \ P ! V4 p
\ P ! V 4 p \ P ! V
RV 2V\ P \ P , 4 p V e V P ^4 P 4 p RV 9 dB RV 9 d; V P V RVR7 p
V
' d \ V
4 ^8X d
V
^ , p
WV& M. WG& V P R 4 FM pVP 4 pW9 d V^ , R
8X d VRR R 8X d V^R pWG, P V4 KO \ WG, 4 ^8X d WG, ^ , WG& WP! V 4 \ V 4 , R P 4 pVR , R 8X g EK V.V P VR
, RVR7 , # V' d V' d V.# T# V' d . # RV/# )zC
Convert a (generated) token sequence into an ordered JSON format.
Nzz:N N:r> NN
text_sequence)r get_added_vocabresearch
IGNORECASEstartindexlenescapereplacegroupDOTALLstrip
token2jsonsplitappendfind)r tokensr; r< outputpotential_start start_tokenkey key_escaped end_tokenstart_token_escapedend_token_escapedcontentvalueleafs &&&& r rM DonutProcessor.token2json@ s ..88:Kf ii
FO & !6!6!8!:;K+%%&B (9(9#(>(BCK c%jCH95C ))C.K T+ a"8&"--PI R8 %OO - &(ii &<#$&IIi$8! ))*+51B0CDfbmm^`^g^gNg & %mmA . 4 4 6G (W-? $Ze f "5zQ(-a*/3K&( $+MM)$rj sk
% H H C ,+5
H % QG^ QG QGh
r