yj6+dZddlmZddlmZddlmZmZddlm Z ddl m Z ddl m Z Gdd eeZGd d e ZGd d eeZGdde ZgdZdS)aTLLM-call events for Honcho telemetry. These events fire once per provider hit (each iteration of an agentic tool loop, each deriver/summarizer LLM call, etc.) and carry the full cost-attribution context: model/provider/transport, token counts with cache breakdown, finish reason, outcome (success/error), retry/fallback state, and run correlation. Unlike the existing aggregate `*Completed` events (representation, dialectic, dream), this event is high-volume. It participates in the `settings.TELEMETRY.HIGH_VOLUME_SAMPLE_RATE` sampler so per-iteration emission can be tuned against a budget. ) annotations)Enum)ClassVarLiteral)Field)ModelTransport) BaseEventc*eZdZdZdZdZdZdZdZdZ dS) CallPurposeuClosed taxonomy for LLM call purposes. The schema lint enforces that all `LLMCallCompletedEvent` emissions use a value from this enum. Adding a new call site requires adding a value here first — keeps the analytics taxonomy stable. zderiver.representationzdialectic.answerzdream.deductionzdream.inductionz summary.shortz summary.longN) __name__ __module__ __qualname____doc__DERIVER_REPRESENTATIONDIALECTIC_ANSWERDREAM_DEDUCTIONDREAM_INDUCTION SUMMARY_SHORT SUMMARY_LONG@/DATA/AppData/hermes/projects/honcho/src/telemetry/events/llm.pyr r s:6)'O'O#M!LLLrr ceZdZUdZdZded<dZded<dZded <d Zded <e d d Z ded<e d dZ ded<e d dZ ded<e ddZ ded<e d dZded<e ddZded<e dd Zd!ed"<e d#d$Zd!ed%<e d#d&Zd!ed'<e d#d(Zd!ed)<e d#d*Zd!ed+<e d d,Zded-<e dd.Zd/ed0<e dd1Zd2ed3<e d d4Zded5<e dd6Zd!ed7<e dd8Zd!ed9<e dd:Zd2ed;<e dd<Zd=ed><e d?d@Zd2edA<e d#dBZd!edC<e d?dDZd2edE<e d dFZ dedG<e d dHZ!dIedJ<dMdLZ"d S)NLLMCallCompletedEventuEmitted once per provider hit by `honcho_llm_call_inner`. Covers success, failure, and cancellation via `outcome`. The last attempt of a tenacity retry chain is flagged with `is_final_attempt=True` regardless of outcome — calibration queries for "exhausted" use `outcome='error' AND is_final_attempt`. Cancellations (typically client disconnect mid-stream or server shutdown) are distinct from errors and should not feed error-rate alerting. Streaming note: when `was_stream=True`, the token counts are placeholders (0) because token totals aren't knowable until the stream drains. Use the aggregate envelopes (`DialecticCompletedEvent` etc.) for streamed-call accuracy until streaming completion is wired through. zllm.call.completed ClassVar[str] _event_type ClassVar[int]_schema_versionllm _category high_volume _volume_classNWorkspace namedefault description str | Noneworkspace_namez@Closed enum identifying the call site (deriver, dialectic, etc.)zCallPurpose | None call_purposezYParent category for analytics joins: 'representation' | 'dialectic' | 'dream' | 'summary'parent_category.z0SDK transport: 'anthropic' | 'openai' | 'gemini'r'r transportzBest-effort vendor inference for relay setups (e.g. 'anthropic' when an OpenRouter base_url + 'anthropic/claude-...' model is used); None when not reliably inferableprovider_labelz(Model identifier as sent to the providerstrmodelz#max_tokens value used for this callinteffective_max_output_tokensrzProvider input_tokensprovider_input_tokenszProvider output_tokensprovider_output_tokenszTokens read from prompt cachecache_read_tokenszTokens written to prompt cachecache_creation_tokensz5First finish reason from the response (None on error) finish_reasonz'success' when the provider returned a result, 'error' when it raised, 'cancelled' when the awaitable was cancelled (client disconnect, server shutdown). Cancellations should be excluded from error-rate alerting.(Literal['success', 'error', 'cancelled']outcomezTrue when this is the last allowed attempt (attempt == retry_attempts). Combine with outcome='error' to identify retry-exhausted calls. Cancellations are not retried so this reflects the attempt at cancellation time.boolis_final_attemptzSException class name when outcome is 'error' or 'cancelled' (e.g. 'CancelledError') error_classz!1-indexed tenacity attempt numberattemptz Total attempts allowed by callerretry_attemptsz4True when this attempt used the fallback ModelConfig was_fallback(Wall-clock duration of the provider callfloat duration_msFzTrue if tools were provided has_toolsz(Number of tool calls the model requestedtool_call_countuaTrue for the stream_final_response path. Token counts are 0 placeholders — see class docstring. was_streamz-Agent run id (ULID when widened in follow-up)run_idu1-indexed iteration within an agentic tool loop. Passed explicitly via LLMTelemetryContext — NOT read from set_current_iteration (that fires after the LLM call)z int | None iterationreturnc r|jpd}|j|jnd}|d|d|jd|jd|j S)zResource id includes run_id + iteration + attempt + transport/model so multi-attempt retries within one iteration get distinct ids.noneNr:)rFrGr=r-r0)selfrunrGs rget_resource_idz%LLMCallCompletedEvent.get_resource_idsTk#V&*n&@DNNa PP PPDLPP4>PPDJPPPrrHr/)#r r rrr__annotations__rr!r#rr)r*r+r-r.r0r2r3r4r5r6r7r9r;r<r=r>r?rBrCrDrErFrGrNrrrrr)s  "6K5555%&O&&&&$I$$$$#0M0000"'tAQ!R!R!RNRRRR',uV(((L#(%o###O !& K!!!I"'|"""Ns(RSSSESSSS',u >((( "'q>U!V!V!VVVVV"'%?W"X"X"XXXXX"U>"'?""" !&K!!!M9> k999G#U o$eiK 5*MNNNGNNNN%1STTTNTTTT OL  CK eE7TUUUIUUUU 5IOuwJ CF"EyI QQQQQQrrc:eZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d S) EmbeddingCallPurposeuClosed taxonomy for embedding call purposes. Mirrors `CallPurpose` for LLM calls. Adding a new embedding call site requires adding a value here first — keeps the analytics taxonomy stable and prevents free-form `track_name` drift from leaking into queries. search_memorysearch_messagescreate_observations vector_syncsummarymessage_createdialectic_prefetchsession_context_searchpreference_extractiongeneric_document_searchN)r r rr SEARCH_MEMORYSEARCH_MESSAGESCREATE_OBSERVATIONS VECTOR_SYNCSUMMARYMESSAGE_CREATEDIALECTIC_PREFETCHSESSION_CONTEXT_SEARCHPREFERENCE_EXTRACTIONGENERIC_DOCUMENT_SEARCHrrrrRrRsU$M'O/KG%N.537rrRceZdZUdZdZded<dZded<dZded <d Zded <e d d Z ded<e d dZ ded<e d dZ ded<e ddZ ded<e ddZded<e ddZded<e d d!Zded"<e dd#Zd$ed%<e dd&Zd'ed(<e d)d*Zd+ed,<e d d-Zded.<e d d/Zded0<d3d2Zd S)4EmbeddingCallCompletedEventaMEmitted once per embedding-provider call. Embedding calls are real provider spend (per-token like LLM calls). Search tools, observation creation, the message-embedding sync, and the deriver/summarizer paths all hit the embedding API; this event captures cost-attribution context for all of them. Volume note: this event is high-volume. Interactive paths (`search_memory` / `search_messages`) emit one event per query, so under a search-heavy dialectic load this can match or exceed the LLM call rate. The shared `HIGH_VOLUME_SAMPLE_RATE` covers both. zembedding.call.completedrrrrrr r!r"r#Nr$r%r(r)zClosed enum identifying the call site. Set by callers via the `embedding_call_purpose` ContextVar; None when the call originated outside an instrumented path.zEmbeddingCallPurpose | Noner*zHParent category for analytics joins (e.g. 'dialectic', 'representation')r+.z'openai' | 'gemini'r,r/providerzModel identifierr0z2Number of texts embedded in this call (batch size)r1 input_countru3tiktoken-based size proxy for the embedded text. ESTIMATE only — the embedding client uses encoding_for_model() with a cl100k_base fallback (see embedding_client.py:68-71), which is exact for older OpenAI models, an approximation for newer ones, and a rough proxy for Gemini (which has its own tokenizer).input_tokens_estimater@rArBz'success' when the provider returned a result, 'error' when it raised, 'cancelled' when the awaitable was cancelled. Cancellations should be excluded from error-rate alerting.r8r9FzTrue on the last retry attempt. Mirrors LLMCallCompletedEvent's convention: combine with outcome='error' to identify exhausted embedding calls. Cancellations are not retried.r:r;z;Exception class name when outcome is 'error' or 'cancelled'r<zGAgent run id when called from an agentic loop; None for sync/CRUD pathsrFrHc ||jpd}|jr |jjnd}|d|d|jd|jd|j S)zResource id includes timestamp-derived components implicitly via generate_id(); we just stake out a non-empty identifier scope.rJunknownrK)rFr*valuerir0rj)rLrMpurposes rrNz+EmbeddingCallCompletedEvent.get_resource_ids[k#V-1->M$#))IQQQQ$-QQ$*QQt?OQQQrrO)r r rrrrPrr!r#rr)r*r+rir0rjrkrBr9r;r<rFrNrrrrhrhs  " F999G#U >$eQK ]F RRRRRRrrh)r rhrRrN)r __future__renumrtypingrrpydanticr src.configrsrc.telemetry.events.baser r/r rrRrh__all__rrrrwsf  #"""""$$$$$$$$%%%%%%////// " " " " "#t " " " nQnQnQnQnQInQnQnQb888883888.OROROROROR)ORORORd   r