+ jesl^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIHtH t ^RI H t H t ^RI HtHtHt^RIt^RIt^RIt^RIt^RIHtHt^RIHt^RIHt^RIt]P<!4R8wd^RIt]!4'd-^R I H!t!^R I"H#t#^R I$H%t%^R I&H't'^R I(H)t)H*t*H+t+H,t,H-t-^RI.H/t/RRRR/t0]1!]Pd]Pf,4t4]1!]Pd]Pj,]Pf,R,4t6RRR/RRR/RRR/RRR/RRR/RRR /R!RR"//t7R#t8R$R%Ps]7Pu44 R&2t;R'R(lt<!R)R*4t=!R+R,4t>R-R.lt?R/R0lt@R:R1R2lltAR3R4ltBR5R6ltC]DR78Xd ]>!R8R97R#R# ]dELRi;i);N) AsyncIterator Awaitable) AnnotatedAny)urljoinurlparse urlunparse)AsyncInferenceClientChatCompletionStreamOutputGenerationConfig)is_rich_availableWindows)filesize)Console)Live)Markdown) BarColumnProgressProgressColumn TextColumnTimeElapsedColumn)Texthostname localhostporti@z .!\"#$%&'()*+,\-/:<=>?@[]^_`{|}~llamatextz5There is a Llama in my lawn, how can I get rid of it?codezyWrite a Python function that integrates any Python function f(x) numerically over an arbitrary interval [x_start, x_end]. helicopterz4How many helicopters can a human eat in one sitting?numbersz4Count to 10 but skip every number ending with an 'e'birdszWhy aren't birds real?socksz2Why is it important to eat socks after meditating?numbers2z$Which number is larger, 9.9 or 9.11?a **TRANSFORMERS CHAT INTERFACE** Chat interface to try out a model. Besides chatting with the model, here are some basic commands: - **!help**: shows all available commands (set generation settings, save chat, etc.) - **!status**: shows the current status of the model and generation settings - **!clear**: clears the current conversation and starts a new one - **!exit**: closes the interface am **TRANSFORMERS CHAT INTERFACE HELP** Full command list: - **!help**: shows this help message - **!clear**: clears the current conversation and starts a new one - **!status**: shows the current status of the model and generation settings - **!example {NAME}**: loads example named `{NAME}` from the config and uses it as the user input. Available example names: ``, `a#` - **!set {ARG_1}={VALUE_1} {ARG_2}={VALUE_2}** ...: changes the system prompt or generation settings (multiple settings are separated by a space). Accepts the same flags and format as the `generate_flags` CLI argument. If you're a new user, check this basic flag guide: https://huggingface.co/docs/transformers/llm_tutorial#common-options - **!save {SAVE_NAME} (optional)**: saves the current chat and settings to file by default to `./chat_history/{MODEL_ID}/chat_{DATETIME}.yaml` or `{SAVE_NAME}` if provided - **!exit**: closes the interface c0V^8dQhR\R\/#)base_urlreturnstr)formats"V/home/luca/screen-checking/.venv/lib/python3.14/site-packages/transformers/cli/chat.py __annotate__r.jsHH3H3Hc\V4pVPPR4PR4p\ VP VP VRRR34#)zQReturn the service root of `base_url`, where the serve management endpoints live./z/v1)rpathrstrip removesuffixr schemenetloc)r(parsedr3s& r-get_service_root_urlr9jsK h F ;;  c " / / 6D v}}fmmT2r2F GGr/ca]tRt^qtoV3RlRltV3RlRltV3RlRltRtV3RlR ltV3R lR lt RV3R lR llt RV3RlRllt V3RlRlt V3RlRlt RtVtR#) RichInterfacec,<V^8dQhRS[RS[RS[/#)r'model_iduser_idr(r*)r, __classdict__s"r-r.RichInterface.__annotate__rs"!!!s!c!r/cH\4VnWnW nW0nR#N)r_consoler=r>r()selfr=r>r(s&&&&r-__init__RichInterface.__init__rs     r/cz<V^8dQhRS[S[S[,,RS[S[S[S[,R,3,/#)r'streamr)N)rrr tupler+r)r,r?s"r-r.r@xs;;#;# .H IJ;# sC#I$$ %;#r/c "VPPRVP R24\VP^R7;_uu_4pRp^p\P!4pRpVGRjxL RjxL pVP ^,P Pp\VP ^,RV4p\VRR4p V e\V RV4pV'gKw\P!RR V4pW8, p.p VP4FOp V PV 4V PR 4'dV PR 4K>V PR 4KQ \RPV 4P!4R R7p VP#V RR7EK<ELAEL;ED=RRR4M +'giM;i\P!4X, p T ^8dQX^8dJYM, pTPP4TPPRT RT R RTR R24TPP4XX3#5i)z [bold blue]:)consolerefresh_per_secondr2N finish_reasonusagecompletion_tokensz <(/*)(\w*)>z\<\1\2\>z``` z z github-dark) code_themeT)refreshz[dim]z tokens in z.1fzs (z tok/s)[/dim])rCprintr=rtimechoicesdeltacontentgetattrresub splitlinesappend startswithrjoinstripupdate)rDrHliverrO start_timerMtokenoutputsrNlineslinemarkdownelapsed tok_per_secs&& r- stream_outputRichInterface.stream_outputxs l4==/<= $--A > >$D ! J(,M%+||) 4) 4e--*0088 ' a(8/= Y w5$(/7JL](^%&&gF OO-DLL&u-- T* V,.$BGGEN$8$8$:}U Hd 3S ,) 4| ? > > >`))+ * Q;,q0+5K MM   ! MM  %(9':+gc]RUVabeUffs t u ]""sWA I# !F?,F--F?1F35F0 6F39A,F?&CF?0F33F?6 I#? G BI#c <V^8dQhRS[/#r'r)r*)r,r?s"r-r.r@ssr/c VPPRVP R24pVPP4V#)z!Gets user input from the console. [bold red]: )rCinputr>rS)rDrps& r-rpRichInterface.inputs8 ##k$,,t$DE  r/c :VPP4R#)zClears the console.N)rCclear)rDs&r-rsRichInterface.clears r/c <V^8dQhRS[/#)r'rr*)r,r?s"r-r.r@ssr/c VPPRVP RV 24VPP4R#)z%Prints a user message to the console.roz>:[/ bold red] N)rCrSr>)rDrs&&r-print_user_message RichInterface.print_user_messages6 k$,,7GvNO r/c&<V^8dQhRS[RS[/#)r'rcolorr*)r,r?s"r-r.r@sCr/c |VPPRV RV 24VPP4R#)z,Prints text in a given color to the console.z[bold ]N)rCrS)rDrrzs&&&r- print_colorRichInterface.print_colors1 fUG1TF34 r/c,<V^8dQhRS[RS[RS[/#)r'messagedefaultr)r+bool)r,r?s"r-r.r@s" ( (s (T (d (r/c V'dRMRpVPPRV RV R24pVPP4VP4P 4pV'gV#VR9#)zFDisplays a yes/no prompt to the user, returning True for confirmation.zY/nzy/Nz [bold yellow]z (z): >yyes)rCrprSr_lower)rDrr default_hintresponses&&& r-confirmRichInterface.confirmsf 'uU ==&&wir,s'ST >>#))+N<''r/c <V^8dQhRS[/#)r'minimal)r)r,r?s"r-r.r@s$r/c VPP\V'd\M\44VPP4R#)z'Prints the help message to the console.N)rCrSrHELP_STRING_MINIMAL HELP_STRING)rDrs&&r- print_helpRichInterface.print_helps. HG%8UV r/c <V^8dQhRS[/#)r'modelr*)r,r?s"r-r.r@sRRcRr/c aaa\P!\\VP4R,R4RS/RR7pVP 4!RR\ 4pRRR R R R R R/oVPP\S4^,^F,8oVVV3Rlp\\R4\^(R7V!4\4VPR7pVPV!R4RR7pRp\WPPRR7;_uu_4VP!4EFpV'dVP#R4'gK%\$P&!VR,4p V P)R4p V R8XdV P)RR4pMV R8Xd\+V P)RR44hV R8XgKV P)R 4p V P)R!4p V!V 4p V 'd:V R 8XdR"MR#pVP-WmV R$,V P)R%4VR&7EKVP-Wm^RR'7EK RRR4V'd*VPP/\1R(S R)244M(VPP/\1R(S R*244VPP/4R# +'giL;i)+r1 load_modelrT)jsonrHc&a]tRt^toRtRtVtR#)3RichInterface.print_model_load..StatsColumncVP'g \R4#VPPR4R8Xd\P !\ VP44p\P !\ VP44pVP'd.R\P !\ VP44 R2MRpVPe?R\ VP^<,4 R\ VP^<,4R 2pMRp\V RV V V 2RR 7#\\ VP4 R\ VP4 24#) r2unitbytesz z/s:02dr1zprogress.download)style) totalrfieldsgetrdecimalint completedspeedtime_remaining)rDtaskdonetotretas&& r-render:RichInterface.print_model_load..StatsColumn.renderszzz8O;;??6*g5#++C,?@D"**3tzz?;CJN***b!1!1#djj/!B C2FZ\E**6 "3t':':b'@#A"B!CH[H[^`H`DabeCfg 4&#ugcU ;CVWWs4>>231S_4EFGGr/N)__name__ __module__ __qualname____firstlineno__r__static_attributes____classdictcell__r?s@r- StatsColumnrs H Hr/r processorzLoading processorconfigzLoading configdownloadzDownloading filesweightszLoading into memorycH<SPW4pS'dS RV 2#V#)u → )r) stage_key stage_textrshow_model_prefix stage_labelss& r-_label.RichInterface.print_model_load.._labels-%)))?J  |44 r/z[bold]{task.description}) bar_width)rKN)rF)rK transientsdata: :NNstatusreadycachederrorrz Unknown errorloadingstageprogressritemscurrentr) descriptionrrr)rrrz_*z was already loaded.*_z is warm.*_)requestspostrr9r(raise_for_statusrrCwidthlenrrrradd_taskr iter_linesr]rloadsr RuntimeErrorr`rSr)rDrrrrrtask_idrrfeventrrproglabelrrrs&f @@r-print_model_loadRichInterface.print_model_loadsb== (7#=| LT[]bSclp  !!# H. H& , & + ,  !MM//3u:>B3FF   1 2  # M  MM  ##F;$7t#D (MMT B B ++-4??9#=#= 48,8,W$"YYx7FW$&uyyO'LMMY&!IIg.E 99Z0D"5ME*/:*=w7 #$y/Y]YaYabiYjqu(!aW[\1.C6  MM  2eW4J)K L M MM  2eWK)@ A B ?C Bs 3K A1K1K4AK K c <V^8dQhRS[/#)r'rr )r,r?s"r-r.r@.s#3r/c VPPRVP R24VPPRV 24VPP4R#)zFPrints the status of the model and generation settings to the console.z[bold blue]Model: rPz [bold blue]N)rCrSr=)rDrs&&r- print_statusRichInterface.print_status.sK 0rBC k&23 r/)rCr(r=r>N)F)rrrrrErjrprsrwr}rrrrrrrs@r-r;r;qsh!! ;#;#z   ( ( RRhr/r;ca]tRtRtoRtR]R, R]R, 2RRRRRR3V3R lR llt]R 4tV3R lR lt Rt Rt Vt R#)Chati5(Chat with a model from the command line.zhttp://rrrNz./chat_history/cr<V^8dQhRS[S[S[P!RR73,RS[S[R,S[P!RR73,RS[S[S[,R,S[P!RR73,R S[S[R,S[P !R R73,R S[S[R,S[P !R R73,R S[S[S[P !RR73,RS[S[R,S[P !RR73,RS[S[R,S[P !RR73,RR/ #)r'r=z9ID of the model to use (e.g. 'HuggingFaceTB/SmolLM3-3B').)helpr(Nz7Base url to connect to (e.g. http://localhost:8000/v1).generate_flagsaFlags to pass to `generate`, using a space as a separator between flags. Accepts booleans, numbers, and lists of integers, more advanced parameterization should be set through --generation-config. Example: `transformers chat max_new_tokens=100 do_sample=False eos_token_id=[1,2]`. If you're a new user, check this basic flag guide: https://huggingface.co/docs/transformers/llm_tutorial#common-optionsuserzKUsername to display in chat interface. Defaults to the current user's name. system_promptzSystem prompt. save_folderzFolder to save chat history. examples_pathz"Path to a yaml file with examples.generation_configzPath to a local generation config file or to a HuggingFace repo containing a `generation_config.json` file. Other generation settings passed as CLI arguments will be applied on top of this generation config.r))rr+typerArgumentlistOption)r,r?s"r-r.Chat.__annotate__:sOD'D'C5p!qqrD' $J,ef f D' " I  NN[    D'& $J LLk l n 'D'.!tU\\?O-P!PQ/D'0sELL6T$UUV1D'2!tU\\?c-d!de3D'6% $J LLg   7D'B CD'r/c  2W n\VP4p V P\R,8Xd8V P\R,8XdVP VP4WnWPnW`n\V4p V PRRR7V P!R /\V4BWn RVRVRVPP4/VnVeTM \4VnV'd9\#V4;_uu_4p \$P&!V 4VnR R R 4M \*Vn\-4'g \/R 4h\0P2!VP544R # +'giLQ;i) rrrT) do_samplemax_new_tokensr(r=rNzHYou need to install rich to use the chat interface. (`pip install rich`)r)r(rrDEFAULT_HTTP_ENDPOINTr check_healthr=rrload_generation_configr`parse_generate_flagsrto_dictsettings get_usernameropenyaml safe_loadexamplesDEFAULT_EXAMPLESr ImportErrorasynciorun _inner_run) rDr=r(rrrrrrr8rfs &&&&&&&&& r-rE Chat.__init__:s1F! $--( ??3J? ?FKKShioSpDp   dmm , *&((9: S 9 =,^<= #Xz8Xt{{ObObOde !,D,.  m$$ $q 1 %$-DM!""hi i  DOO%&%$s F F c\\V4R,R4p\P!V4pVP^8wd\ RV RVP R24hR# \P d\ RT R24hi;i)r1healthzThe server running on z returned status code z on health check (/health).zNo server currently running on z. To run a local server, please run `transformers serve` in aseparate shell. Find more information here: https://huggingface.co/docs/transformers/servingT)rr9httpxr status_code ValueError ConnectError)url health_urloutputs& r-rChat.check_healths1#6r(T)r)r(Nz!exitrrrrrrrr r!r"r#r$r%r'r(r)r*r+rr,rrWr-r.r/r0r1r2r3rr)rHr extra_body assistantlengthz2Generation stopped after reaching the token limit.yellowzContinue generating?u'Please continue. Do not repeat text.”r)&r;r=rr(rsr4rrrrr rwrpr]rr5r6r3r^rrTr7r8rr}r_r`rrr\rr9rto_json_stringchat_completionrjrKeyboardInterrupt)rDrrrclientpending_user_inputrr;rr<r=r>r?rCrH model_outputrMs& r-rChat._inner_runs!4==$))VZVcVcd  2 23 T*""4==1'???6-1 f)5%7 -1*!44Z@%.__%6 "W,#x//0B0BC!) #w.!,,. #..w77C @P@P@RV^8dQhR\R,R\/#)r'rNr))r+r )r,s"r-r.r.Rs# C CcDj C=M Cr/cVf \4#RV9dU\PPV4p\PP V4p\P !W4#\P !V4#)Nr)r r6r3dirnamebasenamefrom_pretrained)rrRrs& r-rrRse !!##''//"3477##$56//BB//0ABBr/cTV^8dQhR\\,R,R\/#)r'rNr))rr+r)r,s"r-r.r.^s#7$7$cT)97$d7$r/c Ve\V4^8Xd/#VUu.uFpRV9gK VNK ppV'd*\P!RRPV4 R24hVUu/uFBpRVP R^4^,,R,VP R^4^,bKD ppVP 4UUu/uF,wrEYEP 4R9dVP 4MTbK. pppVP 4UUu/uFwrEYER8XdR MTbK pppR R lpVP 4UUu/uFwrEYF!V4'gRV R2MTbK pppR PVP 4UUu.uF wrEV R V 2NK upp4pRV,R,pVPRR 4pVPRR4pVPRR4pVPRR4pVPRR4p\P!V4pV#uupiuupiuuppiuuppiuuppiuuppi \Pd\RT RT 24hi;i)zUParses the generate flags from the user input into a dictionary of `generate` kwargs.r'r(r%r)"truefalseNonenullc0V^8dQhR\R\/#)r'sr)r)r,s"r-r.*parse_generate_flags..__annotate__ws//S/T/r/cfVPR4pVPRR^4P4#)-r/r2) removeprefixreplaceisdigit)r]s&r- is_number'parse_generate_flags..is_numberws, NN3 yyb!$,,..r/z, z: {}z"null"z"true"z"false"z"[[z]"r|zPFailed to convert `generate_flags` into a valid JSON object. `generate_flags` = z Converted JSON string = )rXrY) rr BadParameterr^r5rrrbrrJSONDecodeErrorr ) rr= invalid_flagsgenerate_flags_as_dictkvrdgenerate_flags_stringprocessed_generate_flagss & r-rr^s^!4!9 &4Hnd4TTnMH  6v{{=7Q6RS1 1  drrcq[_cDJJsA$6q$99C?CQRASTUAVVcqr KaJfJfJhJh$! %661779A=JhKaJfJfJhiJh$!a;A=Jhi/ RhQmQmQopQoa11QCq1DQop !II?U?[?[?]&^?]tq!Bqc{?]&^_ "77#=299(FK199(FK199)WM199$D199$D #'::.C#D  $#eIsjq '_     $$2#3()>(? A   s5 HH&AH!2H& H,=!H2?H8 H>>'I%cTV^8dQhR\R,R\\,/#)r'rNr)r+rr)r,s"r-r.r.s&SSC$JS$t*Sr/c$V'dRRRV/.#.#)z Returns a new chat conversation.r,systemrWr)rs&r-r4r4s=JVXy- 8 9RPRRr/c^V^8dQhR\R\\,R\R\/#)r'rrrr)rr)r,s"r-r.r.s,%%%4:%%#%r/cD\P!\PPV4RR7\ VR4;_uu_4p\ P !RVRV/V^R7RRR4\PPV4# +'giL/;i)z!Saves the chat history to a file.T)exist_okwr chat_history)indentN)r6makedirsr3rRrrdumpabspath)rrrrs&&& r-r8r8sfKK)D9 h   :x>!L  77??8 $$  s B B c$V^8dQhR\/#rmr*)r,s"r-r.r.s11c1r/c\P!4R8Xd\P!4#\P !\P !44P#)z)Returns the username of the current user.r)platformrtr6getloginpwdgetpwuidgetuidpw_namerr/r-rrs8I%{{}||BIIK(000r/__main__z meta-llama/Llama-3.2-3b-Instruct)r=rB)Errr6rrYstringrTcollections.abcrrtypingrr urllib.parserrr r rrrhuggingface_hubr r transformersr transformers.utilsrreadlinerrtrrichr rich.consoler rich.liver rich.markdownr rich.progressrrrrr rich.textrrset ascii_letters whitespaceALLOWED_KEY_CHARSdigitsALLOWED_VALUE_CHARSrrr^r9rr9r;rrrr4r8rrrr/r-rs  4!66  L)0   ?? !$&``#[&$?,,v/@/@@A 6==(6+<+<?@A &HAAHZZz C7$tS %1 z45Q  sF((F32F3