Pmj!*dZddlmZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z m Z ejeZdZd!d Zd"dZddd#dZd$dZ d%d&dZd'd ZdS)(uFlush pending messages and agent transcripts to disk before shutdown to prevent data loss. When FTS5 index corruption prevents ``INSERT INTO messages``, the gateway accumulates messages in ``_pending_messages`` (memory-only) and the live ``agent._session_messages`` cannot be flushed via ``_flush_messages_to_session_db``. On shutdown, ``.clear()`` discards the only surviving copy — permanent user data loss. This module provides three hooks: 1. ``flush_pending_to_file()`` — called BEFORE ``_pending_messages.clear()`` during shutdown. Serialises any non-empty pending slots to a JSON file under ``/pending_messages/``. 2. ``recover_pending_to_db()`` — called AFTER ``runner.start()`` on startup. Reads flush files, inserts messages into state.db via ``SessionDB.append_message`` (so FTS indexing, session metadata, and display_kind are handled correctly), then deletes the flush file on success. 3. ``flush_agent_history_to_file()`` — called from ``_finalize_shutdown_agents`` when ``_flush_messages_to_session_db`` raises. Dumps the live ``agent._session_messages`` to the same atomic JSON recovery directory. See issue #72680 for the full incident report. ) annotationsN)Path)AnyDictOptionalcddlm}|dz }|dddtjdkrtj|d|S)zIReturn the pending-messages flush directory under the active HERMES_HOME.r)get_hermes_homepending_messagesTi)parentsexist_okmodeposix)hermes_constantsr mkdirosnamechmod)r flush_dirs Atomically write one private, uniquely named recovery payload.r)atomic_json_writezpending-z.jsoni)r defaultz-Failed to fsync pending-message directory: %sN) utilsr%uuiduuid4hexstrr!OSErrorloggerdebug)rr"r%file_id final_pathexcs r_write_payloadr2=s''''''jllG66666J  K##### KKK  DcJJJJJJJJJKsA A>A99A>shutdown)reasonpendingr4r+intc |sdSt}ttj}d}t|D]h\}}| t |}|t |||||d|dz }6#t$r&}t d||Yd}~ad}~wwxYw|rt d||||S)aSerialise non-empty ``_pending_messages`` slots to disk. Parameters ---------- pending: The adapter or runner ``_pending_messages`` dict. Values may be ``MessageEvent`` objects (adapter) or plain strings (runner). reason: Logged context (``shutdown``, ``restart``, etc.). Returns ------- int Number of sessions flushed. rN) session_keyr4tsdataz*Failed to flush pending message for %s: %sz/Flushed %d pending message(s) to %s (reason=%s)) rr6timelistitems_serialise_valuer2 Exceptionr-r.info) r5r4rr9flushedr8value serialisedr1s rflush_pending_to_filerERs:( q  I TY[[  BG"7==??33 U =  )%00J! #.$&     qLGG    LL<S            = Y    NsB 1B  B<B77B<rCrOptional[dict]ct|drqdt|ddi}dD]Y}t||d}|D tj||||<0#tt f$rt |||<YUwxYwZ|St|t rd|iSt|tr? tj||S#tt f$rdt |icYSwxYwdt |iS)zrsG2#"""""  &&&&&&&&&&  8 $ $KKKK0777777t    <dddddN1 1 1 1 1 1 r