yjq`ddlZddlZddlZddlmZddlmZddlmZ ddl m Z ddl m Z ddlmZddlmZddlmZdd lmZmZdd lmZdd lmZdd lmZdd lmZmZddl m!Z!ddl"m#Z#ddl$m%Z%ddl&m'Z'm(Z(ddl)m*Z*ddl+m,Z,m-Z-ddl.m/Z/m0Z0m1Z1ddl2m3Z3ddl4m5Z5m6Z6ddl7m8Z8m9Z9ej:e;Z<Gdde Z=de=dej=fdZ>gdZ?defdZ@ejAjBZBejAjCZCd ZDGd!d"eZEd#eFd$eGd%eFdeFfd&ZHd#eFd$eGd%eFdeFfd'ZIedeGfd(ZJedeGfd)ZKe-d*+ dNdd,d#eFd-eGd.eFdzd/eFdzdeeFf d0ZLe-d1+ dNdd,d#eFd.eFdzd/eFdzdeeFfd2ZMd/eFd3eFd4eGd5eGd6eFd7ejNddfd8ZOd/eFd3eFd4eGd5eGd6eFd9eEd7ejNddfd:ZPdd,d#eFd%eFdzd9eEd-eGd6eFd;eGdZSd?ed@e=d/eFd3eFddf dAZTdeEjUfd?ed/eFd3eFdBeGdzd9eEdeFf dCZVeEjUfd?ed/eFd3eFd9eEde=dzf dDZWd?ed/eFd3eFdeQe=dze=dzffdEZXddFdGd?ed/eFd3eFdHeGdBeGdzdIeRdeQej=dzeYe9j#ffdJZZddFdGd?ed/eFd3eFdHeGdBeGdzdIeRdeFfdKZ[dLeYe9j#deFfdMZ\dS)ON)Enum)cache)cleandoc) TypedDict)update) AsyncSession)schemas)ConfiguredModelSettingssettings)session_cache_key) tracked_dbResourceNotFoundException)HonchoLLMCallResponsehoncho_llm_call)LLMTelemetryContext)Message)prometheus_metrics)AgentToolSummaryCreatedEventemit) CallPurpose)accumulate_metricconditional_observe)DeriverComponentsDeriverTaskTypes TokenTypes) utc_now_iso)estimate_tokenstrack_deriver_input_tokens)crudmodelscPeZdZUdZeed<eed<eed<eed<eed<eed<dS) Summarya A summary object. Stored in session metadata and used in a session's get_context. Attributes: content: The summary text. message_id: The primary key ID of the message that this summary covers up to. summary_type: The type of summary (short or long). created_at: The timestamp of when the summary was created (ISO format string). token_count: The number of tokens in the summary text. content message_id summary_type created_at token_countmessage_public_idN)__name__ __module__ __qualname____doc__str__annotations__int %  Hard limit: P words maximum. If needed, drop lower-priority detail to stay within the limit. crMrNrOs r4short_summary_promptrWdsM &',-  r3c 4td|d|d|dS)z!Generate the long summary prompt.a You are a system that creates thorough, comprehensive summaries of conversations. Focus on capturing: 1. Key facts and information shared (**Capture as many explicit facts as possible**) 2. User preferences, opinions, and questions 3. Important context and requests 4. Core topics discussed in detail 5. User's apparent emotional state and personality traits 6. Important themes and patterns across the conversation If there is a previous summary, ALWAYS make your new summary inclusive of both it and the new messages, therefore capturing the ENTIRE conversation. Prioritize key facts across the entire conversation. Provide a thorough and detailed summary that captures the essence of the conversation. Your summary should serve as a comprehensive record of the important information in this conversation. Prefer an exhaustive chronological narrative over a list of bullet points. Return only the summary without any explanation or meta-commentary. rQrRrSrTrVs r4long_summary_promptrYsM "#*+01  r3cd ttdddS#t$rYdSwxYw)zQEstimate tokens for the short summary prompt (without messages/previous_summary).r8rrV)rrW Exceptionr2r3r4$estimate_short_summary_prompt_tokensr]sX  #%&(       ss ! //cd ttdddS#t$rYdSwxYw)zPEstimate tokens for the long summary prompt (without messages/previous_summary).r8rrVr[)rrYr\r2r3r4#estimate_long_summary_prompt_tokensr`sX  #%&(       ssr^zCreate Short Summary)nameworkspace_name input_tokensprevious_summaryrcc :Ktt|tjjdz}|r|}nd}t |||}t t|tjjt|tj j dd{VSNg?zSThere is no previous summary -- the messages are the beginning of the conversation.summary)rc call_purposeparent_category) model_configprompt max_tokens telemetry) r1minr rDMAX_TOKENS_SHORTrWrrFrr SUMMARY_SHORTvalue)rMrdrercrNrOrls r4create_short_summaryrsss<)9)JKKdRSSLv 0 u !L*?F!.00#4%)$28%            r3zCreate Long Summaryc Kttjjdz}|r|}nd}t |||}t t |tjjt|tj j dd{VSrg) r1r rDMAX_TOKENS_LONGrYrrFrr SUMMARY_LONGrr)rMrercrNrOrls r4create_long_summaryrwsx'7$>??Lv 0 u L*?F!.00#3%)$17%            r3 session_namer&message_seq_in_sessionr* configurationc ,KjjdurdSjjzdk}jjzdk}|dur|durdS|rE|rCfd}fd} t j|| dd{VdS|r@t tjd{Vtd d d d dS|r@t tj d{Vtd d d d dSdS)a Create short/long summaries if thresholds met. This function checks for both short and long summary needs independently, without assuming any relationship between their thresholds. Args: workspace_name: The workspace name session_name: The session name message_id: The message ID message_seq_in_session: The sequence number of the message in the session message_public_id: The public ID of the message configuration: The resolved configuration for the message FNrc Kttjd{VtdddddS)Nr&ryr*r'rzsummary__long_summary_up_to_messagecount)_create_and_save_summaryrArLrrzr&r*ryrxrcsr4create_long_summary_taskz5summarize_if_needed..create_long_summary_task0s*%'="3(-+        8>88J88,&      r3c Kttjd{VtdddddS)Nr}r~rshort_summary_up_to_messager)rrArKrrsr4create_short_summary_taskz6summarize_if_needed..create_short_summary_taskAs*%'="3(.+        8>88J88-&      r3T)return_exceptionsr}r~rrrr) rhenabledmessages_per_long_summarymessages_per_short_summaryasynciogatherrrArLrrK) rcrxr&ryr*rzshould_create_longshould_create_shortrrs `````` r4summarize_if_neededr sy,$-- !6!PPTUU !6!QQUVVU""':e'C'CJ1J          "          "n $ $ & & % % ' '"              *%'="3(-+        8>88J88,&       ! *%'="3(.+        8>88J88-&        r3r'cKtd|jtj}t d4d{V}t ||||d{V} | r"| d} | |kr dddd{VdS| r| dnd} |tjkr |j j n |j j } t|| z dzd} tj|||| |d{V}|s/td| dddd{VdSt!|}|d j}|d jdd }t'|}t)d |D}| r| d nd }||z}dddd{Vn#1d{VswxYwYt+|| ||||||| d{V\}}}}|tjkrt/}nt1}|st3t4jt8j|t8j|t8j|it@j!j"rKtGj$|d t4jj%tLj'j%t8j(j%t d4d{V}tS||||d{Vdddd{Vn#1d{VswxYwYtUd|d||jd|ddtUd|d||jd|d dtj|z dz}tUd|d||jd|d|sLtWtYdd dd|||t'|||tjkrdnd|||||dSdS) a Create a new summary and save it to the database. 1. Get the latest summary 2. Get the messages since the latest summary 3. Generate a new summary using the messages and the previous summary 4. Save the new summary to the database zCreating new %s summaryzsummary.fetch_dataNr&r%) start_seqend_seqz'No messages to summarize for message %scg|] }|j Sr2)r)).0messages r4 z,_create_and_save_summary..sKKKww2KKKr3r)r) rMrOr'rdr*last_message_idlast_message_content_preview message_countrc) task_type components)rr token_type componentz summary.saver~r _summary_textblob _summary_sizetokensi_summary_creationmsderiver summarizershortlong)run_id iterationrj agent_typercrxr&rryr'rd output_tokensprevious_summary_tokensmessage_tokensprompt_scaffold_tokens)-loggerdebugratime perf_counterr r<rArLrhrrmaxr!get_messages_by_seq_rangewarning_format_messagesidr%lensum_create_summaryrKr]r`rrrDrPROMPTMESSAGESPREVIOUS_SUMMARYr METRICSENABLEDrrecord_deriver_tokensrrrOUTPUT OUTPUT_TOTAL _save_summaryrrr)rcrxr&ryr*r'rz summary_startdblatest_summarylatest_summary_message_idrOmessages_per_summaryrmessagesrMrrrmessages_tokensrrd new_summary is_fallbackllm_input_tokensllm_output_tokens prompt_tokenssummary_durations r4rr{s$ LL*L,=>>>%''M.//(A(A(A(A(A(A(A2*  l          (6|(D %(J66(A(A(A(A(A(A(A(A(A(A(A(A(A(A>L Uy 9 9QU {///  ! ; ;&A  .1EEI1MM (,(F   * ) ) ) # # # # # #   NNDj Q Q Q =(A(A(A(A(A(A(A(A(A(A(A(A(A(AB.h77"2,/'/|';CRC'@$H KK(KKKLLCQ"X."?"?WX&)@@ Q(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A(A^-3!!+'%A#%           {(((<>> ;==  "&.!(-!*O!24K       #   4!-0*28%,2+8>     n--                                          0>00J00  +++I  0>00J00  +++M" )++m;tC0>00J00  ///    (  )'-),!(mm'=(4 8I(I(IWWv-/(?.'4!          s2 *FBF"A*F F(+F(1K K&)K&rrrcdKd} d} d} d} |tjkrt||||d{V} nt|||d{V} | j} | j}| j} | j} | sJt d| j d} |dkr d|d|d nd } | rt| nd}d} d} n?#t$r2t d |dkr d|d|d nd } d}d} YnwxYwt| ||jt!|| | | | fS) aQ Generate a summary of the provided messages using an LLM. Args: formatted_messages: Pre-formatted message string previous_summary_text: Optional previous summary to provide context summary_type: Type of summary to create ("short" or "long") input_tokens: Token count for input message_public_id: Public ID of the last message last_message_id: ID of the last message last_message_content_preview: Preview of last message content for fallback message_count: Number of messages for fallback Returns: A tuple of (Summary, is_fallback, llm_input_tokens, llm_output_tokens) where is_fallback indicates if the summary was generated using a fallback instead of an LLM call, and the token counts are from the LLM call (0 if fallback was used) NFrrbzNGenerated summary is empty (finish_reasons=%s). Falling back to basic summary.TzConversation with z messages about z...r8zError generating summary!r9)rArKrsrwr%rrdstriprerrorfinish_reasonsrr\ exceptionr$rrr)rMrOr'rdr*rrrrcresponserrr summary_textsummary_tokenss r4rr"s@37HK, ;, , ,1"%- HH1"%-H  ' !/#0$2!!## " LL`'   K!1$$f]eeD`eeee  ?KQ_\:::PQN  !     4555q   b a a@\ a a a a      &%+"}}&/       sBJJJJJJJJ $ bL b bR` b b     K 266}bII&-{#!3K  v~ v~,> ? ? v~"l2 3 3 $n>AA$GG TT     **T   ))++!.,??I  i ( ((((((((((s/%AAcutoffcKt||||d{V}|r&tj||||d|d{V}ntj||||d{V}t|}|rd|dd|dS|S) a Get a summarized version of the chat history by combining the latest summary with all messages since that summary. Note: history is exclusive of the cutoff message. Args: db: Database session workspace_name: The workspace name session_name: The session name cutoff: (Optional) message ID to cutoff at summary_type: Type of summary to get ("short" or "long") Returns: A string formatted history text with summary and recent messages Nr&)start_idend_id)rz r%z z )r<r!get_messages_id_ranger)rrcrxrr'rhr messages_texts r4r>r>s0 NL,OOOOOOOOG  3   \*          3  V          %X..M     r3cK tj|||d{V}n#t$rYdSwxYw|jt i}|r |j|vrdS||jS)a: Get summary for a given session. Args: db: Database session workspace_name: The workspace name session_name: The session name summary_type: Type of summary to retrieve ("short" or "long") Returns: The summary data dictionary, or None if no summary exists N)r!rrrr:rrr)rrcrxr'rrGs r4r<r<s$(\>JJJJJJJJ $tt%,$=$A$A-QS$T$TI  *);;t \' (( ! //c4K tj|||d{V}n#t$rYdSwxYw|jt i}|t jj|t j jfS)a Get both short and long summaries for a given session. Args: db: Database session workspace_name: The workspace name session_name: The session name Returns: A tuple of the short and long summaries, or None if no summary exists N)NN) r!rrrr:rrArKrrrL)rrcrxrrGs r4r=r=s (\>JJJJJJJJ $zz%,$=$A$A-QS$T$TI ==*0 1 19==AQAW3X3X XXrTrinclude_summary token_limitrc K|dkrdgfSd}|}d}|r=t|dz} t|||d{V\} } | r| dnd} | r| dnd} | rl| | krf| | kr`tj| d| d| d| d| d| d d  }|| dz }| d}n| rl| | krf| dkr`tj| d| d| d| d| d| d d  }|| dz }| d}nt d || | tj|||||| d{V}||fS)a Get session context similar to the API endpoint but for internal use. Args: db: Database session workspace_name: The workspace name session_name: The session name token_limit: Maximum tokens for the context cutoff: Optional message ID to stop at (exclusive) include_summary: Whether to include summary if available Returns: Tuple of (summary, messages) where summary is a Summary pydantic model (or None) and messages is the list of message objects rNg?r)r%r&r'r(r*r8r9zNo summary available for get_context call with token limit %s, returning empty string. Normal if brand-new session. long_summary_len: %s, short_summary_len: %s)rrr) r1r=r r$r:rrr!r)rrcrxrrrrhrmessages_start_idsummary_tokens_limitlatest_short_summarylatest_long_summarylong_len short_lenrs r4r?r?)sO0aRxG!O.";#455:L  ; ; 5 5 5 5 5 5 11:MS&}55RS;OV(77UV  " 0009$$o+I6.|<0@.|</ >"5"9"9:Mr"R"R G*,? ,NNO 3L A    %.2F%F%F9WX==o,Y7/ =1.A/ =0?"6":":;NPR"S"S G*,@,OOO 4\ B   LLr    / "# H H r3cK|dkrdSt||||||d{V\}}t|}|r|jnd} | r |r d| d|dS| rd| dS|r|SdS) z Get formatted session context as a string for internal use (e.g., deriver). This is a convenience wrapper around get_session_context that formats the output as a string. rr8rNz z z z )r?rr%) rrcrxrrrrhrrsummary_contents r4r@r@sar1 ' GX%X..M)08goobO=      rr3rcjt|dkrdSdd|DS)z{ Format a list of messages into a string by concatenating their content and prefixing each with the peer name. rr8 c0g|]}|jd|jS)z: ) peer_namer%)rmsgs r4rz$_format_messages..s*LLLC77#+77LLLr3)rjoin)rs r4rrs;  8}}r 99LL8LLL M MMr3rC)]rloggingrenumr functoolsrinspectrrUtypingr sqlalchemyrsqlalchemy.ext.asynciorsrcr src.cache.clientr src.configr r src.crud.sessionr src.dependenciesr rrsrc.llmrr src.llm.typesr src.modelsr src.telemetryrsrc.telemetry.eventsrrsrc.telemetry.events.llmrsrc.telemetry.loggingrr src.telemetry.prometheus.metricsrrrsrc.utils.formattingrsrc.utils.tokensrrr8r!r" getLoggerr+rr$r;__all__rFrDMESSAGES_PER_SHORT_SUMMARYMESSAGES_PER_LONG_SUMMARYrrAr/r1rWrYr]r`rsrwResolvedConfigurationrrtupleboolrrrKr>r<r=listr?r@rr2r3r4r)s !!!!!!//////22222288888888......''''''444444::::::::------,,,,,,CCCCCCCC000000HHHHHHHH -,,,,,HHHHHHHH  8 $ $i(W_   )#:)))) &-H$,F &&&&&$&&&  @ D c     S    0111$(  "&     Dj  $J  3   21 F/000$("& Dj$J  3 10>nnnn n  n 0 n nnnnbd d d  d  d  d d 0d  d d d d b"&^^^^:^^ ^  ^  ^#&^^$J^ 7D#s "#^^^^B1)1) 1)1) 1)  1)1)1)1)p + 1 77777 $J 7  7  7777|!, 1 ))))) )  t^ ))))<YYYY 7T>7T> )* YYYY@ YYYYYY Y $J YY 7?T !4#7 78YYYYD ...... . $J .. ....bNtFN3NNNNNNNr3