yjHUdZddlmZddlZddlmZddlmZddlm Z ddl m Z m Z m Z mZmZdd lmZmZdd lmZmZejeZed d Zd ed <ddd8dZedGddZd9dZd:d#Zd;d)Zdd6Z"gd7Z#dS)?uRuntime config planning and retry/fallback selection. Owns: - Resolution of ConfiguredModelSettings → ModelConfig. - Per-attempt planning (AttemptPlan) including primary/fallback selection and reasoning-effort/thinking-budget resolution. - Per-call effective config construction (applying caller kwarg overrides onto the selected ModelConfig). - Retry attempt tracking via a ContextVar, plus the temperature-bump heuristic. ) annotationsN) ContextVar) dataclass)Any)ConfiguredModelSettings ModelConfigModelTransportresolve_model_configsettings)backend_for_providerclient_for_model_config)ProviderClientReasoningEffortTypecurrent_attempt)defaultzContextVar[int])nameproviderr modelstrr str | NonereturnNonectjsdS ddlm}dtj||di}|||d<|jdi|dS#t $r&}td|Yd}~dSd}~wwxYw) zEBest-effort annotation of the current Langfuse span with LLM routing.Nr) get_clientmetadata) namespacerrrz+Failed to update Langfuse span metadata: %s) r LANGFUSE_PUBLIC_KEYlangfuser NAMESPACEupdate_current_span Exceptionloggerdebug)rrrr update_kwargsexcs 7/DATA/AppData/hermes/projects/honcho/src/llm/runtime.py#update_current_langfuse_observationr)$s  'I'''''' %/$)   $(M& !( (99=99999 III BCHHHHHHHHHIs4A A6A11A6T)frozencneZdZUdZded<ded<ded<ded <d ed <d ed <ded<ded<ded<dS) AttemptPlana Per-attempt plan produced by `plan_attempt`. Replaces the old loose tuple-of-six (`ProviderSelection`) with a single dataclass. Carries everything the executor / tool loop needs to make one backend call without re-resolving configuration mid-call. r rrrrclient int | Nonethinking_budget_tokensrreasoning_effortrselected_configintattemptretry_attemptsbool is_fallbackN)__name__ __module__ __qualname____doc____annotations__rr(r,r,?sJJJ&&&&))))    LLLr<r, model_config%ModelConfig | ConfiguredModelSettingsrcNt|tr|St|S)zHReturn a runtime ModelConfig, resolving settings-shape inputs if needed.) isinstancerr )r=s r(resolve_runtime_model_configrASs*, ,,  - --r<r3r2r4cH||ks|j|S|j}tdid|jd|jddd|jd|jd|jd|jd |jd |j d |j d |j d |j d|j d|jd|jd|jd|jS)zPick the effective config for this attempt. Primary config on all attempts except the last, which swaps to the resolved fallback (if any). Nr transportfallbackapi_keybase_url temperaturetop_ptop_kfrequency_penaltypresence_penaltyseedthinking_effortr/provider_paramsmax_output_tokensstop_sequences cache_policyr)rDrrrCrErFrGrHrIrJrKrLrMr/rNrOrPrQ)r=r3r4fbs r(select_model_config_for_attemptrS\s2.  L$9$A  B    hh ,,        NN  hh hh .. ,, WW **  "88 ** ..  ((! "__# r<runtime_model_configcall_thinking_budget_tokensr.call_reasoning_effortrc bt|||}|j}t||}||u}|r|n|j} |r|n|j} ||krI|jBt d|d|d|jd|jdzd|d|jzt||j|| | ||||  S) zBuild the AttemptPlan for `attempt`. Reasoning params are drawn from the caller when we're still on the primary config, and from the fallback config otherwise, so cross-transport fallbacks use provider-appropriate params. )r3r4NzFinal retry attempt /z: switching from z to zbackup ) rrr-r/r0r1r3r4r6) rSrCrr/rMrDr$warningrr,) rTr3r4rUrVselectedrr- is_primaryattempt_thinking_budgetattempt_reasoning_efforts r( plan_attemptr^s(/%H !H $Xx 8 8F11J'1V##x7V",I1I.  %9%B%N N7 N N^ N N N%/RR2F2LRRR S3338>33 4   n61 %"N    r<r1ModelConfig | NonerG float | None stop_seqslist[str] | Noner/r0c|t||||||Sddi}|||d<|||d<|||d<|||d<||S) uBuild the ModelConfig passed to the executor / request_builder. Per-call kwargs (temperature, stop_seqs, thinking_*) win when set; otherwise the selected_config's values are used. When selected_config is None (test-only callers passing provider+model directly) a minimal ModelConfig is synthesized. max_output_tokens is forced to None so the per-call max_tokens kwarg is authoritative — matching historical honcho_llm_call_inner behavior. N)rrCrGrPr/rMrOrGrPr/rM)update)r model_copy)r1rrrGrar/r0updatess r(effective_config_for_callrgs(#$#9,      3D9G!, $- !),B()#%5!"  % %W % 5 55r<c|dkr9tdkrtddS|S)u@Bump temperature from 0.0 → 0.2 on retry attempts for variety.gr z,Bumping temperature from 0.0 to 0.2 on retryg?)rgetr$r%)rGs r(effective_temperaturerjsAco1133a77 CDDDs r<planrc6t|j|jS)u;Convenience helper: plan → ready-to-call ProviderBackend.)r rr-)rks r(resolve_backend_for_planrms  t{ ; ;;r<) r,rrgrjr^rmrArSr))rr rrrrrr)r=r>rr)r=rr3r2r4r2rr) rTrr3r2r4r2rUr.rVrrr,)r1r_rr rrrGr`rarbr/r.r0rrr)rGr`rr`)rkr,rr)$r: __future__rlogging contextvarsr dataclassesrtypingr src.configrrr r r registryr rtypesrr getLoggerr7r$rr;r)r,rArSr^rgrjrm__all__rr<r(rxs   #"""""""""""!!!!!!DCCCCCCC66666666  8 $ $$.:.?#K#K#KKKKK IIIIII6 $&....!!!!H////d&6&6&6&6R<<<<   r<