yjddlmZddlmZddlmZddlmZddlm Z ddl m Z ddl mZmZmZmZmZmZmZmZmZddlmZdd lmZdd lmZdd lmZdd lmZdd l m!Z!m"Z"ddl#m$Z$m%Z%ddl&m'Z'm(Z(m)Z)m*Z*ddl+m,Z,ddl-m.Z.m/Z/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6ddl7m8Z8m9Z9ddl:m;Z;ee<Z=eGddZ>dZ?e(dZ@deAdeAdeAfdZBe'e?e,jCjDd e(e !e'jEe?e,jCjFd e@"d#edeAdeAdeGeAefd$zfd%ZHd&eGeAe%jIfdeJfd'ZK dJdeAd(eGeAefd$zdeeLe$jMfd)ZNd*d+d#ed,e%jOdeAd-ePde4e$jMf d.ZQd*d/d#edeAdeAd0ePde$jMf d1ZRd#ed,e%jSdeAdeAde$jMf d2ZT dKd#ed4ed5eUed6eJdeJf d7ZVd#edeAdeAde>fd8ZW dJd#edeAd9eAd:eAd$zde$jMf d;ZXd#edeAdeAdZ\deAdeAdeeLeAeGeAefeGeAefePffd?Z]d#edeAdeAd ? ? v~"l2 3 3      C  {tf,]n 2*n   r3 peer_configscXtd|DS)z Count the number of peers that will be observing others based on their configurations. Args: peer_configs: Dictionary of peer names to their session configurations Returns: Number of peers that will be observing others c3(K|] }|j dVdS)r$N)observe_others).0configs r4 z,count_observers_in_config..os*NNV8MNqNNNNNNr3)sumvalues)rRs r4count_observers_in_configr[cs- NN|2244NNN N NNr3filterscNKttjtjj|ktjjdk}t |tj|}|tjjS)z1 Get all active sessions in a workspace. T) rrrNrOr5rHr!order_byrL)r5r\stmts r4 get_sessionsr`rst v~ v~,> ? ? v~'4/ 0 0 fng 6 6D ==2 3 33r3F_retrysessionrbc K|jstdt|||jd{V}d}|^tjdi|}t |||dd{V}|jstd|jd|d}d}d} d} |k|j r9t|j } | tj krt|j| t|tj|d{V} tj||j|jpi|jr|jd ni } |4d{V||dddd{Vn#1d{VswxYwYd}d}n#t,$rVt.d |j|rt3d |jdt5|||d d{VcYSwxYw|j|j|jkr|j|_d}|jP|jpi} |jd } i| | }|j|kr ||_d}|j rKt;||d|j Dd{V} t=|||j|j dd{V|d{V| | d{V| | d{V|rtC||j}tE||j#|j|j$|j|j|j%|j|j&dtj'j(d{Vt.d|j|tS||S)a] Get an active session in a workspace or create it if it does not exist. If the session already exists, provided metadata replaces the current metadata, provided configuration keys are merged into the existing configuration, and any provided peers are ensured to be members of the session. If the session does not exist, the workspace and peers are created as needed before the session is created. Args: db: Database session session: Session creation payload, including optional metadata, configuration, and session-peer configuration workspace_name: Name of the workspace _retry: Whether to retry after a concurrent create conflict Returns: GetOrCreateResult containing the session and whether it was created Raises: ValueError: If session.name is empty ResourceNotFoundException: If the named session exists but is inactive ObserverException: If adding peers would exceed the observer limit ConflictException: If concurrent creation prevents fetching or creating the session zSession name must be providedNFloadSession  not found in workspace rGT exclude_noner5rGrIrKz5Race condition detected for session: %s, retrying getz!Unable to create or get session: rac8g|]}tj|Srir PeerCreaterV peer_names r4 z)get_or_create_session..s37@" 222r3r5peers)r5r6 peer_namesfetch_after_upsertrE)expirez(Session %s cache updated in workspace %s)createdr2)*rG ValueErrorrQrrNrmergerHr rvr[rSESSION_OBSERVERS_LIMITrr'rWorkspaceCreatemetadatarK model_dump begin_nestedaddrloggerdebugrget_or_create_sessionrIcopyr%_get_or_add_peers_to_sessioncommit post_commitr=rrFr5rJrLCACHEDEFAULT_TTL_SECONDSr")rCrcr5rb session_datahoncho_sessionrPneeds_cache_updatery ws_result peers_resultobserver_countexisting_configincoming_config merged_config cache_keys r4rrsD <:8999'NGLIIIIIIIIL-1Nn,,|,,"3'''!xx%x88888888' +Q7<QQQQ  GIL   F6w7IJJN @@@' nEEE2   # 8 8 8         )'-2$'/:::MMM     Y(( ' ' ' ' ' ' ' '~&&& ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' '!% GG Y Y Y LLG    'F FF/r7NSWXXXXXXXXX X X X Y   ()W-===(/(8N %!%   ,-;ArGGIIO%3>>D>QQOBB/BM+}<5      6 n    ^W = = ==s7F*,FF* FF*!F"F**AH  H include_inactivercKt|||d{V}|td|d||s|dstd|d|tjdi|}t |||dd{V}|S)a Get a session in a workspace. Args: db: Database session session_name: Name of the session workspace_name: Name of the workspace include_inactive: If True, return sessions even if they are marked for deletion. This should only be used for internal operations like the deletion task. Returns: The session Raises: ResourceNotFoundException: If the session does not exist or is inactive NrgrhrHFrer2)rQr rrNrr{)rCr6r5rdatarPrcs r4 get_sessionr&s. NLAA A A A A A AD |' M| M M^ M M    D$5 ' M| M M^ M M   . 4 Cs###HHSuH--------G Nr3cVKt|tj||d{Vj}d}|j|j|jkr|j|_d}|jN|jpi}i||jd}|j|kr ||_d}|st d|||S| d{Vt||}t|d{Vt d||S) a Get or create a session, then apply metadata and configuration updates. Provided metadata replaces the current metadata when present. Provided configuration keys are merged into the existing configuration instead of replacing it wholesale. Args: db: Database session session: Session update schema workspace_name: Name of the workspace session_name: Name of the session Returns: The updated session Raises: ResourceNotFoundException: If the named session exists but is inactive ConflictException: If concurrent creation prevents fetching or creating the session ri)r5NFTrjz5Session %s unchanged in workspace %s, skipping updatezSession %s updated successfully)rr SessionCreateresourcer~rIrKrrrrrr=r) rCrcr5r6r needs_update base_configrrs r4update_sessionrSs8$ %<888          L#(AWEU(U(U$+$4! (%39r??AA   #..D.AA   '= 8 8+8N (L  C      ))++".,??I I & &&&&&&&& LL2LAAA r3modelfilter_conditions batch_sizecKd}|jjjd} t |t ||}t|| |}ttt| |d{V}|jpd} || z }| dkrn|S)aI Delete records in batches that match the given filter conditions. Args: db: Database session model: SQLAlchemy model class filter_conditions: List of SQLAlchemy filter conditions batch_size: Number of records to delete per batch Returns: Total number of records deleted rTN) __table__ primary_keycolumnsrZrrOr limitr in_ typing_castrrexecuterowcount) rCrrr total_deletedprimary_key_columnsubquery delete_stmt delete_result batch_deleteds r4_batch_delete_matchingrs$M4<CCEEaH  % & & , ,T3D-E F F L LZ X X Umm))*<*@*@*J*JKK #L$5RZZ =T=T7T7T7T7T7T7TUU %.3! & A     r3c l Kt|||dd{V} |ttjt tjtjj dd|ktjtjj dd|kd{V|ttj tj j |j kd{V|ttjtjj|ktjj|kd{V}t#|}t)}|4|r1i}|D]0}||jg|1g} |D]M} | dt5| D]$\} } | | jd | %N |d |} || | d{Vt:d t?| d |n7#t@$r*}t:!d |d|Yd}~nd}~wwxYwtE|tjtjj|ktjj|kgdd{V|ttj#j tj#j$tj#j%tj#j|ktj#j|kd{V}|}||ri}|D]R}|d||j$|j%} || g|j S|&D]\} } || |d{Vt:d t?|d| P#t@$r*}t:!d| d|Yd}~d}~wwxYwtE|tj#tj#j|ktj#j|kgdd{V}tE|tj'tj'j|ktj'j|kgdd{V}|ttj(tj(j|ktj(j|kd{V||d{V|)d{VtUtW||d{Vt:d|nJ#t@$r=}t:,d|||-d{V|d}~wwxYwt]||S)at Delete a session and all associated data (hard delete). This performs cascading deletes for all session-related data including: - Active queue sessions - Queue items - Message embeddings (batched) - Documents (theory-of-mind data, batched) - Messages (batched) - Session peer associations - The session itself Args: db: Database session workspace_name: Name of the workspace session_name: Name of the session Returns: SessionDeletionResult containing cascade counts Raises: ResourceNotFoundException: If the session does not exist TrNr9c|jSN)rF)es r4z delete_session..s!$r3)r?_messagezDeleted z message vectors for session z-Failed to delete message vectors for session z: r)rdocumentz document vectors from z'Failed to delete document vectors from z*Session %s and all associated data deletedzFailed to delete session %s: %s)r*r+)/rrr rActiveQueueSessionrOr r split_part work_unit_key QueueItem session_idrFrMessageEmbeddingr6r5listscalarsallr# setdefault message_idappendrZsort enumerateget_vector_namespace delete_manyrrlen ExceptionwarningrDocumentobserverobserveditemsMessage SessionPeerrrr=errorrollbackr))rCr5r6rembedding_result embeddingsexternal_vector_storemessage_chunksemb vector_idschunks chunk_idxchunk namespacer doc_result documentsdocs_by_namespacedocdoc_idsr+r*s r4delete_sessionrs/4' L.4N Yjj 6, - - 3 3OF$=$KSRSTT%&OF$=$KSRSTT#$     jj 6# $ $ * * +~/@@           "$ 6* + + 1 1'4 D'6.H  " "        *224488::;; 9 ; ; ! , ,GIN! J J))#."==DDSIIII%'J(//11 I I  ///(1&(9(9II$Iu%%)9&G&GI&G&GHHHHI 1FF~ ,77 :NNNNNNNNN [s:[[\[[   WLWWTUWW %   #'4 D'6.H           :: "((  e, <..@         NN$$  ! , ,68   K K1FF"LL  ",,Y;;BB36JJJJ'8&=&=&?&?  " 7 /;;IwOOOOOOOOOLLS3w<<SS SS!NNR)RRqRR%;  O, <..@ % % %       "8  N+|;-? " " "       jj 6% & & , ,"/<?"1^C           ii'''''''''iikk 1., O OPPPPPPPPP A<PPPP  6 aHHHkkmm !)/   spI Y(AKY K< K72Y7K<} tjj| j| j}||?|d{Vt> d|S) a Clone a session and its data. If cutoff_message_id is provided, only clone messages up to and including that message. The following data is copied to the new session: - Session metadata - Session configuration - All messages (or up to cutoff_message_id) with their content, metadata, and peer associations - Session-peer associations with their configurations (observe_me, observe_others) The new session gets a unique ID (nanoid) and fresh timestamps. Args: db: SQLAlchemy session workspace_name: Name of the workspace the target session is in original_session_name: Name of the session to clone cutoff_message_id: Optional ID of the last message to include in the clone Returns: The newly created session TNzOriginal session not foundz.sR    (,!,, *%4      r3r6rrr5rKzSession %s cloned successfully)!rrrNrOr5rGrHrscalar_one_or_noner r public_idr6rMrzgenerate_nanoidrIrKrflushrFrrr^rrr returningrrrrrr)rCr5rrr_resultoriginal_sessioncutoff_messagemessages_to_clone_scalarsmessages_to_clone new_messages insert_stmt session_peers session_peernew_session_peerrs ` @r4 clone_sessionr}s: v~ v~,> ? ? v~"&;; < < v~'4/ 0 0  ::d## # # # # # #F0022'(DEEEN$fn%%++ N $(9 9 N '+@ @   "yy...... N  .%   #.&4 K FF; ((** &. ! ! ' '#'<<  D$)Czz&.+tN4Ez/R/RRSS ==* + +D')jj&6&6 6 6 6 6 6 615577      )   L((226>BBK::k<88 8 8 8 8 8 8F &$ % % + +'+@@  D::d## # # # # # #FNN$$((**M%!! !-$)",)&4         ))++ LL13HIII r3rvcKt|||d{Vttjtjj|ktjj|ktjj|tjj d tj }||d{V|d{VdS)a} Remove specified peers from a session. Args: db: Database session workspace_name: Name of the workspace session_name: Name of the session peer_names: Set of peer names to remove from the session Returns: True if peers were removed successfully Raises: ResourceNotFoundException: If the session does not exist Nleft_atT)rrrrrOr6r5rrrris_rZr nowrr)rCr5r6rv update_stmts r4remove_peers_from_sessionrs, b, 7 77777777 v!""    +| ;   - ?   ( , ,Z 8 8   & * *4 0 0     # # **[ ! !!!!!!!! ))++ 4r3cKttjtjt tjjtjjktjjtjjk tjj |k tjj|k tjj dS)z Get all peers from a session. Args: db: Database session workspace_name: Name of the workspace session_name: Name of the session Returns: Paginated list of Peer objects in the session N) rrPeerjoinrr rGrrr5rOr6rrr:s r4get_peers_from_sessionr s" v{      F$6$@@ *f.@.OO     v!.,> ? ? v{)^; < < v!)--d33 4 4 r3c(Kttjjdtjjdtjjdtjjdd tjttjjtjj ktjj tjj k tjj|k tjj |k tjj |k}|S)a Get configuration from both SessionPeer and Peer tables for all peers in a session. NOTE: does not filter for active peers. Will return peers that have left the session. Args: workspace_name: Name of the workspace session_name: Name of the session Returns: Select statement returning peer_name, peer_configuration, session_peer_configuration, and a boolean indicating if the peer is currently in the session rrpeer_configurationsession_peer_configurationNrH)rrr rGlabelrKrrrr r rrr5rOr6)r5r6r_s r4get_session_peer_configurationr8s"  K  " "; / / K % + +,@ A A   , 2 23O P P   ' + +D 1 1 8 8 E E        F$6$@@ *f.@.OO     v!.,> ? ? v{)^; < < v!0NB C C! & Kr3cKt|}|tjkrt||t t jt jj|kt jj |k}| |d{V}| }|td|d|tt jt jj|kt jj|kt jjdt'j}| |d{V}t+||d|Dd{V} t-||||d{V} |d{V| d{V| S)a Set peers for a session, overwriting any existing peers. If peers don't exist, they will be created. Args: db: Database session workspace_name: Name of the workspace session_name: Name of the session peer_names: Set of peer names to set for the session Returns: List of SessionPeer objects for all peers in the session Raises: ResourceNotFoundException: If the session does not exist Nrgrhrc8g|]}tj|Srnrorqs r4rsz)set_peers_for_session..s&NNNiw!y111NNNr3rt)r5r6rv)r[rr|rrrrNrOr5rGrrr rrr6rrrZr rr%rrr) rCr5r6rvrr_rrcrrrus r4set_peers_for_sessionr^s>./z::N888 n=== v~ v~,> ? ? v~"l2 3 3 ::d## # # # # # #F''))G' M| M M^ M M   v!""    +| ;   - ?   & * *4 0 0    # #::k** * * * * * *F- %NN:NNNL/ %!       E ))++  " " $ $$$$$$$$ Lr3T)rwrwc K|s|sgSttjtjjktjjktjjd}||d{V}t| St|}|dkr;ttjtjjktjjktjjdtjj|tjjdjt*}||d{V}|pd} | |z} | t.jkrt3| t5tjfd|D} | gdtjdt?tjj d| j!jftjjd} || d{V|sgSttjtjjktjjktjjd}||d{V}t| S) aU Upsert session-peer memberships for a session and optionally fetch the active memberships afterward. New peers are inserted, peers that previously left the session are rejoined, and already-active peers keep their existing session-level configuration. Args: db: Database session workspace_name: Name of the workspace session_name: Name of the session peer_names: Mapping of peer names to session-level configuration fetch_after_upsert: If True, query and return the active session peers after the upsert. If False, skip that read and return an empty list. Returns: Active SessionPeer objects after the upsert, or an empty list when the post-upsert fetch is skipped Raises: ObserverException: If adding peers would exceed the observer limit NrrUc ng|]1\}}|tjd|d2S)N)r6rrr5 joined_atrrK)r rr)rVrrrKr6r5s r4rsz0_get_or_add_peers_to_session..sZ ) =!-&"0!XZZ!.!9!9!;!;    r3)r6rrr5)else_)rrrK)index_elementsset_)"rrrrOr6r5rrrrrrr[r countrrnotin_keysrKastextrrrMrr|r pg_insertrZron_conflict_do_updaterr is_notexcluded) rCr5r6rvrw select_stmtrnew_observer_countexisting_observers_stmtexisting_observer_counttotal_observersr_s `` r4rrs>  ,! IV/0066   +| ;   - ?   & * *4 0 0  zz+........FNN$$((**+++3:>>A#)"6"6"<"<   +| ;   - ?   & * *4 0 0   ( / /!!     ,-= > E J J   # # zz"9::::::::"(--//"6Q14FF X= = =#L/BB B V' ( ( / / -7,<,<,>,>   D"  % %FFF!#+22488$-:UV(6   &  D **T    +,,22'<7)^;"&&t,,K ::k** * * * * * *F   $$&& ' ''r3peer_idcKttjtjj|ktjj|ktjj|k}||d{V}|}|td|d|d|tj di|j S)ac Get the configuration for a peer in a session. Args: db: Database session workspace_name: Name of the workspace session_name: Name of the session peer_id: Name of the peer Returns: Configuration for the peer Raises: ResourceNotFoundException: If the session or peer does not exist Nz Session peer z not found in session z in workspace r2) rrrrOr5r6rrrrr rSessionPeerConfigrK)rCr5r6r'r_rrs r4get_peer_configr*s0 &$ % % + +)^;'<7$/  D ::d## # # # # # #F,,..L' gG g g< g gWe g g     $ B B|'A B BBr3rrrWc Kt|||d{Vt||tj|d{Vt t jt jj|kt jj |kt jj |k}| |d{V}| }|j rC|r"|jr|jddnd}|st t!jt jj|kt jj |kt jjdt jj |kt jjdjt,} | | d{V}|pd} | dz } | t0jkrt5|| |d} |rE|jr6|j} | | | |_n5| |_n-t j|||| }|||d{VdS) ai Set the configuration for a specific peer in a session. Args: db: Database session workspace_name: Name of the workspace session_name: Name of the session peer_name: Name of the peer config: The peer configuration to set Raises: ObserverException: If the update would exceed the observer limit NrirUFrr$Trjr) rr&rrprrrrOr6rrr5rrrUrKgetr rrrrrrrMrr|rrrrrr) rCr5r6rrrWr_rris_currently_observerr$r update_data new_configs r4set_peer_configr0>s* b, 7 77777777 2~w'9y'I'I'I J JJJJJJJJ v!"" v!.,> ? ? v!+y8 9 9 v!0NB C C  ::d## # # # # # #F,,..LF  , : L & * *+;U C C C % F&,TZ\\&:&:&@&@"/<?"1^C"*..t44","01ABINN ' ' #::&=>>>>>>>>F#]]__1N a N @@@' nEEE###66K  % 5%388::J   k * * *)3L & &)4L & &)%)%    | ))++r3r)r)c dataclassesrloggingrtypingrrrcashewsrnanoidrr sqlalchemyr r r r r rrrsqlalchemy.dialects.postgresqlrsqlalchemy.enginersqlalchemy.excrsqlalchemy.ext.asynciorsqlalchemy.ormrsqlalchemy.typesrrsrcrrsrc.cache.clientrrrr src.configrsrc.exceptionsrrr src.utils.filterr!src.utils.typesr"src.vector_storer#peerr%r& workspacer'r,rr)r;SESSION_LOCK_PREFIXstrr=rrlockedDEFAULT_LOCK_TTL_SECONDSdictrQr)r0r[tuplerNr`rboolrr SessionUpdaterrrrrsetrr r rrrrr*r0r2r3r4rOsS!!!!!!&&&&&&......UUUUUUUUUUUUUUUUUUUUUU>>>>>>******))))))//////55555500000000   *)))))------666666////////...... 8    T,,..888 c      " > -000     " > 2555   #s(^d   2 OsG556 O O O O O"&*444 #s(^d "4 E&. !"4444. _>_>_>_>  "_>_>  _> v~& _>_>_>_>N# ******  *  ^ ****ZBB  "BB B  ^ BBBBR !!! !Cy! !  !!!!H~~&)~9<~~~~~J%) pppppTz p  ^ ppppf&&&&C &  &&&&R E&+ >### E#tCH~tCH~t; <=####LFFFFS'334 F  &  FFFF^ $ l(l(l(l(l(l(S'334 l(  l( & l(l(l(l(^%C%C%C%C %C   %C%C%C%CPVVVV V  % V  VVVVVVr3