Pmj.dZddlmZddlmZmZddlmZedGddZd=d Z d d d d d d d d d dd d d d d>dZ d d d d d?d!Z d"d"d"d d#d@d)Z d"d"d*dAd-Z dBd/Zd0ZdBd1Zd d2dCd4ZdDd5ZdEd6ZdBd7ZdFd8Zd d9dGd:ZdHdId<Zd S)JuProvider/model inventory context — shared substrate for the dashboard ``/api/model/options``, the TUI ``model.options``/``model.save_key`` JSON-RPC handlers, and the interactive picker. Before this module the three call-sites each duplicated: 1. The 17-LOC config-slice that pulls ``model.{default,name,provider,base_url}``, ``providers:``, and ``custom_providers:`` out of ``load_config()``; 2. The call into ``list_authenticated_providers`` with the resulting kwargs; 3. (TUI only) a 45-LOC post-pass that merges authenticated rows with unconfigured ``CANONICAL_PROVIDERS`` rows and emits ``authenticated``/ ``auth_type``/``key_env``/``warning`` hints for the picker UI. Consolidating those three steps into one entry point eliminates two bugs the duplicates were hiding: - The dashboard read ``cfg.get("custom_providers")`` directly, missing the v12+ keyed ``providers:`` form (which the TUI handled via ``get_compatible_custom_providers``). - The TUI's canonical-merge keyed on ``is_user_defined`` to decide ordering. Section 3 of ``list_authenticated_providers`` sets ``is_user_defined=True`` even for canonical slugs that appear in the ``providers:`` config dict, which silently demoted them to the tail of the picker. ``_reorder_canonical`` keys on slug membership instead. Substrate facts (verified May 2026): - ``list_authenticated_providers`` already populates each row's ``models`` from the curated catalog (same source as the picker). Do NOT call ``provider_model_ids()`` per row to "freshen" — that bypasses curation and pulls in non-agentic models (Nous /models returns ~400 IDs including TTS, embeddings, rerankers, image/video generators). ) annotations) dataclassreplace)OptionalT)frozencfeZdZUdZded<ded<ded<ded<ded <d Zded <d d d d ddZd S) ConfigContextzSnapshot of the model + provider config every inventory caller needs. Built once via ``load_picker_context()``; the TUI overlays live agent state via ``with_overrides()`` before passing through. strcurrent_provider current_modelcurrent_base_urldictuser_providerslistcustom_providersNexcluded_providersr r r Optional[str]return'ConfigContext'cRi}|r||d<|r||d<|r||d<|r t|fi|n|S)uReturn a copy with truthy overrides applied. Truthy-only because the TUI reads agent attributes that may be empty strings before an agent is spawned — empties must NOT clobber the disk-config values. r r r )r)selfr r r kws :/home/thesage/.hermes/hermes-agent/hermes_cli/inventory.pywith_overrideszConfigContext.with_overrides9sa  6%5B! "  0"/B   6%5B! "&(2wt""r"""d2)r rr rr rrr)__name__ __module__ __qualname____doc____annotations__rrrrr r +s ##### +/'+*. 33333333rr rc |ddlm}m}|}|di}t |t r]|d|ddpd}|ddpd}|ddpd}n|rt |nd}d}d}|d }|d id pg}t|||t |t r|ni||t |tr|ng S) uLoad the disk-config snapshot every consumer needs. Replaces the inline 17-LOC config-slice that ``web_server.py`` and ``tui_gateway/server.py`` (×2 sites) used to do. r)get_compatible_custom_providers load_configmodeldefaultnameproviderbase_url providers model_catalogr)r r r rrr) hermes_cli.configr$r%get isinstancerr r r) r$r%cfg model_cfgr r r rawexcludeds rload_picker_contextr5Ps\ ONNNNNNN +--C$$I)T""! ivr1J1JKKQr $==R88>B$==R88>B+4;I  ''+  Cww++//0DEEKH )#)(d33;ss88=='1(D'A'AI88r    rFN) explicit_onlyinclude_unconfigured picker_hintscanonical_orderpricing capabilitiesfeaturedforce_fresh_nous_tierrefreshprobe_custom_providersprobe_current_custom_provider for_picker max_modelsctxr6boolr7r8r9r:r;r<r=r>r?r@rArB int | Nonerc ~ddlm}||j|j|j|j|j|| | | | | |jpg }t|j}||gd|Dz}|r2t||}t|t||dz} ddl m }n#t$rd}YnwxYw|t|D]K}|d r4d |d pgDLr|D]}|d r|d d }||s:|d pg}fd|D}t%|t%|kr||d <t%||d<|r*t|dt||Dz}|rt'||rt)|}|rt+|||rt-||rt/|||j|jdS)u Build the ``{providers, model, provider}`` shape every consumer needs from a single substrate call. Flags: - ``explicit_only``: keep only providers the user explicitly configured (current provider, providers from config, or providers backed by provider-specific env vars). This hides ambient / auto-seeded credentials from desktop chat pickers. - ``include_unconfigured``: append ``CANONICAL_PROVIDERS`` rows that ``list_authenticated_providers`` didn't emit (TUI uses this to show the full provider universe in the picker). - ``picker_hints``: add ``authenticated``/``auth_type``/``key_env``/ ``warning`` per row (TUI ``ModelPickerDialog`` shape). - ``canonical_order``: reorder canonical-slug rows to ``CANONICAL_PROVIDERS`` declaration order; truly-custom rows go last (TUI display order). - ``pricing``: enrich each row with formatted per-model pricing and, for Nous, ``free_tier``/``unavailable_models`` so the GUI picker can show $/Mtok columns and gate paid models on free accounts — mirroring the ``hermes model`` CLI picker. Adds network calls (pricing fetch + Nous tier check); only set for interactive pickers. - ``capabilities``: add a per-row ``capabilities`` map ``{model: {fast, reasoning}}`` so pickers can gate the model-options controls (fast toggle / reasoning) to what each model actually supports, instead of offering knobs the backend would reject. - ``featured``: add a per-row ``featured_models`` list — the newest few models per lab (by models.dev release_date, ranked within the row's own models; see ``_FEATURED_PER_LAB``) for aggregator providers that serve dozens of models across many labs. Pickers default their visible set to these; the rest of ``models`` stays reachable via search / show-all. Empty for single-lab providers (callers fall back to top-N). Derived live from models.dev — no allowlist. - ``force_fresh_nous_tier``: bypass the short Nous free-tier cache when selecting Portal-recommended Nous models and applying tier gating. Keep this false for UI picker opens; explicit auth/model flows can opt in when they need freshly-purchased credits to show up immediately. - ``refresh``: bust the per-provider model-id disk cache so every row re-fetches its live catalog. Set only for an explicit user-triggered "refresh models" action; normal picker opens leave it false to stay snappy on the 1h cache. - ``probe_custom_providers``: allow saved custom/provider endpoints to run live ``/models`` discovery while building the payload. GUI picker opens should leave this false unless the user explicitly refreshes; the row can still render its configured model immediately, and slow/offline local endpoints no longer block the dialog. - ``probe_current_custom_provider``: when ``probe_custom_providers`` is false, still live-probe the current custom endpoint. This keeps normal GUI/TUI picker opens fast while making the active custom provider's model list match the classic CLI picker. - ``for_picker``: interactive-picker visibility. Keeps providers whose credential pool exists but is entirely rate-limited (exhausted) in the list. Rate limits are per-model, so a different model under the same provider may still work; hiding the provider strands the user. Set for any surface a human is choosing from, not for programmatic resolution. r)list_authenticated_providers) r r r rrr=rBr>r?r@rArNcg|]=}t|dddk;|>Sslugr)moar r/lower.0rs r z(build_models_payload..sEWWW!s1553D3D/E/E/K/K/M/MQV/V/VA/V/V/VrT current_only)is_routing_aggregatoris_user_definedc3>K|]}|VdSNrM)rOms r z'build_models_payload..s*"P"P17799"P"P"P"P"P"PrmodelsrJr)c@g|]}|v|Sr"rX)rOrY user_modelss rrQz(build_models_payload..s+PPP!17799K3O3OA3O3O3Or total_modelscg|]=}t|dddk;|>SrIrLrNs rrQz(build_models_payload..sKxxx1PSTUTYTYZ`bdTeTePfPfPlPlPnPnrwPwPwQPwPwPwrr=)r,r&r*)hermes_cli.model_switchrGr r r rrr_moa_provider_row_filter_explicit_provider_rowsr_append_unconfigured_rowshermes_cli.providersrT Exceptionsetr/updatelen_apply_picker_hints_reorder_canonical_apply_pricing_apply_capabilities_apply_featured)rCr6r7r8r9r:r;r<r=r>r?r@rArBrGrowsmoa_row_is_routing_aggregatorrowrJoriginalfilteredr]s @rbuild_models_payloadrursPEDDDDD ' '--')-35&C17R   D  455GyWWtWWWW  -dC88 Dzz5 #D    &XXXXXXX &&&!%&) #  Q QCww()) Q"""P"Pswwx7H7H7NB"P"P"PPPP  8 8 877,--wwvr**.-d33778,,2PPPPxPPPx==3x==00$,CM*-h--C'yDzzxx(A$(L(Lxxxx"D!!!(!$''Jt3HIIII"D!!!"(  sB!! B0/B0)r6r7r>c t|}t|t|t|ddddd|||  S)aBuild the shared API-server/dashboard/TUI model-options payload. This wraps ``build_models_payload`` with the stable picker shape and the safe custom-provider probe policy used for normal GUI/TUI opens: - normal open: probe only the current custom provider so offline saved endpoints do not block the picker - explicit refresh: probe every custom provider while busting the model cache so live catalogs repopulate fully T) r6r7r8r9r:r;r<r>r?r@)rDru)rCr6r7r>s rbuild_model_options_payloadrwsZ"7mmG  =))!"677&*1k    rr))r r r rBr r r r list[dict]ct|||}t|ddd|d}d|DS)ucProvider rows for any auxiliary-task picker (vision, compression, …). THE entry point for every aux picker — present and future. Call this instead of ``list_authenticated_providers()`` directly. Aux pickers kept re-deriving their own kwargs and each one silently dropped a different slice of the user's configuration. Two independent contributor PRs landed against the same two call sites for exactly this: #52642 (user ``providers:`` / ``custom_providers:`` entries never appeared) and #66624 (providers with an exhausted credential pool were hidden). Both were per-site kwarg patches, so the next aux picker would have reintroduced the same gap. Routing through one function makes the correct behaviour the default that a new caller cannot forget: - user-defined ``providers:`` and saved ``custom_providers:`` entries - ``model_catalog.excluded_providers`` honoured, matching ``/model`` - exhausted-credential-pool providers stay visible (``for_picker``) - the active custom endpoint is probed, offline saved ones are not, so the picker never blocks on a dead local server The virtual ``moa`` row is excluded: auxiliary tasks must not run the MoA reference fan-out, and ``auxiliary_client`` unwraps a ``moa`` provider to its aggregator slot anyway (see ``_resolve_auto``), so offering it here would be a choice silently rewritten behind the user's back. Mirrors the same filter in ``hermes_cli/moa_cmd.py``. Rows are the standard ``list_authenticated_providers`` shape. Pair with :func:`format_aux_picker_entries` to render them. rTF)rAr?r@rBr,cg|]P}t|dpddkN|QSrI)r r/striprMrNs rrQz)build_aux_picker_rows..osQ Q Q Q!s155==#6B77==??EEGG5PPAPPPr)r5rru)r r r rBrCros rbuild_aux_picker_rowsr|?stH    . .)#) /  C  $&*       D R Qt Q Q QQr)r r ro list[tuple[str, str, list[str]]]c g}t|pd}tt|pd}|D]}t|dpd}|dp|}|dp#t |dpg} | rd| dnd} ||kr|r|sdnd} |||| | t|dpgf|S) u#Render aux-picker rows as ``(slug, label, models)`` menu entries. Owns the label text and the ``← current`` marker so every aux picker presents providers identically. Callers add their own leading/trailing entries (``auto``, ``Custom endpoint``, ``Back``) around this list. A custom endpoint set via a raw ``base_url`` is "current" only through that URL — never through a provider slug — so when ``current_base_url`` is set no provider row is marked, matching the pre-existing behaviour of both call sites. r)rJr(r^r[u — z modelsu ← current)r r{rMrDr/riappendr) ror r entries current_slug has_base_urlrrrJr(total model_hintmarkers rformat_aux_picker_entriesrrsa"13G'-2..4466<<>>L,23399;;<>D'$()@$A$A  %%% $III%55e<<==&DKK #N'##s "B BBc ddlm}n#t$rd}YnwxYw|D]}t|dpd}|dpg}i}t|D]\}}d|vr|dddnd}|si}n^d} |-|||p |d |} | rt| d dnd} | |g || |ft|d krg|d <g} | D]A} t| d d} | d| dt DBdt|Dt| fd|d <dS)u@Attach a ``featured_models`` shortlist to each aggregator provider row. Aggregator providers (nous, openrouter) serve dozens of models across many labs, so a flat "top-N" default would drop whole labs from the picker. Instead we surface the ``_FEATURED_PER_LAB`` newest models per lab (the vendor segment of a ``vendor/model`` id), ranked by models.dev ``release_date`` among that row's OWN models — never against the current date, so the choice is stable as models age. Same-date ties (and labs whose models lack a date) fall back to the row's curated order, which is already flagship-first, so a lab keeps its headliners rather than an arbitrary slice. Derived live from the models.dev catalog already loaded on this path (same source as pricing/capabilities) — there is no hand-maintained allowlist to keep in sync. Non-aggregator providers (a single lab, local endpoints, custom proxies) get an empty list and callers fall back to their existing top-N behaviour; splitting one lab into a shortlist would just hide models. r)get_model_infoNrJr)r[/ openrouter release_datefeatured_modelsc$|d|d fS)Nrrr")es rz!_apply_featured..sAaD1Q4%=rT)keyreversec3"K|] \}}}|V dSrWr")rO_pos_dater&s rrZz"_apply_featured..s)WW&8dE5EWWWWWWrci|]\}}|| Sr"r")rOirYs r z#_apply_featured..s444$!QA444rc|SrWr")rYorders rrz!_apply_featured..s arr)rrrfr r/r{rM enumeratesplitgetattr setdefaultrrivaluessortedextend_FEATURED_PER_LAB)rorrrrJr[by_labposr&labdateinfor<rrankedrs @rrnrnsF$3333333 !J!J3776??(b))//117799""(b9;#F++ B BJC,/5LL%++c1%%a((bC D)%~dE22Ynn\SX6Y6Y<@Hwt^R888b   c2 & & - -sD%.@ A A A A v;;??%'C! "  }} X XGG)@)@$OOOF OOWWFCUDUCUz,_append_unconfigured_rows..s& , , ,!AfIOO   , , ,rr)api_keyz6Configured provider missing usable credentials; paste z- to reactivate. Showing the saved model only.ziConfigured provider is not authenticated; run `hermes model` to reactivate. Showing the saved model only.TFrzconfigured-current) rJr( is_currentrUr[r^source authenticated auth_typekey_envwarning canonical)rJr(rrUr[r^r)hermes_cli.authrrrrr rMr r r{rJr/rapi_key_env_varsrlabel)rorCrSrrrseencur cur_modelextrasentryr1rrrs rrdrdsI211111GGGGGGGG , ,t , , ,D   %2 , , . .CC%+,,2244IF$. .  :     % %   EJ,,..#55  :     $ $#'' 33C),; )I0$Q''  ))g)000000  MM!J,00U[II"&',-6>ykkB)2$9AA2%*!*&&        (,,UZEE#j..00C7#( !%    MrcNddlm}t|jpd}g}|D]}t|dd}|sL|dr||w|r||kr|||dkr$tr||||r|||S)a'Keep only rows backed by explicit user configuration. ``list_authenticated_providers`` intentionally discovers ambient / auto- seeded credentials (for example GitHub CLI -> Copilot). Desktop chat model pickers want the narrower subset the user explicitly configured for Hermes. r)!is_provider_explicitly_configuredr)rJrUrK) rrr r r{rMr/r"_raw_config_has_enabled_moa_preset)rorCrrkeptrrrJs rrcrcEs@BAAAAAs+1r2288::@@BBLD37762&&''--//5577   77$ % %  KK      DL00 KK     5== 233 ! C    , ,T 2 2  KK    Krc ddlm}|}n#t$rYdSwxYwt|tsdS|dttsdSd}t|trq|D]Z\}}t|pds)t|tsdS|ddrdS[dShd }tfd |Do"tddS) a~Return True when the user's raw config explicitly enables MoA. ``load_config()`` includes ``DEFAULT_CONFIG["moa"].presets.default`` for everyone. Explicit-only model pickers must not treat that default as a user choice, but they should keep MoA visible once the user has saved at least one enabled preset (or an older flat MoA config) in their own config.yaml. r)read_raw_configFrKpresetsr)Tenabled>fanout aggregator max_tokensreference_modelsreference_max_tokensreference_temperatureaggregator_temperaturec3 K|]}|vV dSrWr")rOrrKs rrZz5_raw_config_has_enabled_moa_preset..s'11cscz111111r) r.rrfr0rr/itemsr r{anyrD)rr3rr(preset legacy_keysrKs @rrrhsz555555o uu c4 u ''%..C c4 uggi  G'4  #MMOO  LD&tzr??((** fd++ ttzz)T** tt uK 1111[111 1 1 Td3779d;S;S6T6TTs  ""c~ddlm}|D]}d|vr|ddko|d }| |d<|r|drT||d}|r|jnd }|r|jr |jdnd }||d <||d <|d kr|rd |dnd|d|d<dS)a0Add ``authenticated``/``auth_type``/``key_env``/``warning`` per row. Mutates ``rows`` in-place. Rows already from ``list_authenticated_providers`` are marked ``authenticated=True``; the unconfigured skeleton rows from ``_append_unconfigured_rows`` get the picker's setup-hint shape. rrrrrr[rUrJrr)rrzpaste z to activatez!run `hermes model` to configure ()rN)rrr/rr)rorrr is_skeletonr1rrs rrjrjs8211111   c ! !  ggh'';6Pswwx?P?P;P #.O cgg&788  ##CK00%(7CMMi  , C  # #  %K II%%'% +W * * * *AYAAA I+  rcddlm}dt|Dtfd|Dfd}fd|D}||zS)uCanonical slugs in ``CANONICAL_PROVIDERS`` declaration order; truly-custom rows last. Keys on slug membership, NOT ``is_user_defined`` — section 3 of ``list_authenticated_providers`` sets ``is_user_defined=True`` on rows from the ``providers:`` config dict even when the slug is canonical. Keying on the flag would silently demote canonical providers configured via the new keyed schema. r)rc$i|] \}}|j|Sr"r)rOrrs rrz&_reorder_canonical..s B B B41aQVQ B B Brc30K|]}|dv |VdS)rJNr"rOrPrs rrZz%_reorder_canonical..s1//qAfI......//rc |dS)NrJr")rPrs rrz$_reorder_canonical..seAfI&rrc(g|]}|dv |Srr"rs rrQz&_reorder_canonical..s' 8 8 8A6%!7!7a!7!7!7r)rrrr)rorcanonrrs @rrkrks655555 B B9-@#A#A B B BE ////D/// & & & &   E9 8 8 8 8 8 8F 6>rr`c ,ddlm}m}m}m}m}d}|D]}t |dd} |dpg} | sR || pi} n#t$ri} YnwxYw| svi} | D] } | | }|s|dd}|dd}|d d}|dkr ||nd}|dkr ||nd}|r ||nd}|d ko |d kp|dk}||||d }| d krW|sU||||d }|3|\}}}||d<|dkr|||d<|dkr|||d<|| | <| r| |d<| d kri | ||}t||d<|r$|t| | d\}}||d<ng|d<#t$rd|d<g|d<YwxYwdS)uEnrich each provider row with per-model pricing + Nous tier gating. Mutates ``rows`` in-place. For every row whose provider supports live pricing (openrouter / nous / novita) adds:: row["pricing"] = {model_id: {"input": "$3.00", "output": "$15.00", "cache": "$0.30" | None, "free": bool}} For Nous additionally adds:: row["free_tier"] = bool # current account is free-tier row["unavailable_models"] = [...] # paid models a free user can't pick Prices are pre-formatted via ``_format_price_per_mtok`` so the GUI just renders strings — identical formatting to the CLI picker. All failures are swallowed (best-effort): a row simply gets no ``pricing`` key. r)_format_price_per_mtokcheck_nous_free_tiercompute_sale_discountget_pricing_for_providerpartition_nous_models_by_tierNrJr)r[prompt completioninput_cache_readfree)inputoutputcachernousrsdiscount_percent was_input was_outputr:) force_fresh free_tierT)runavailable_modelsF) rrrrrrr r/rMrfrDr)ror=rrrrrnous_free_tierrrrJr[ raw_pricing formattedmidpinp_rawout_raw cache_rawinpoutris_freersalerwas_prompt_raw was_out_raw _selectable unavailables rrlrls~,&*NI/I/37762&&''--//""(b   22488>BKK   KKK   %' % #% #C$$A eeHb))GeeL"--G0"55I5<]]((111C5<]]((111C9BL**9555EVmD)C#)G Ev~~g~,,WaeeJ&7&7#DHA$nk0@E,-%++-C-C*..k*#b((.D.D'//l+#IcNN  '&C N 6>> /!)%9%9$9&&&N$(#7#7K !3/L/LV kT000,K1>>>>>"";;==#4#4U#;#;#ArBBcggi,,113344 4'+1r88::eC$KK!"m    ttsA+B!/1B!! B/.B/)rr )rCr r6rDr7rDr8rDr9rDr:rDr;rDr<rDr=rDr>rDr?rDr@rDrArDrBrErr) rCr r6rDr7rDr>rDrr) r r r r r r rBrErrx)rorxr r r r rr})rorxrr)rorxrCr rSrDrrx)rorxrCr rrx)rrD)rorxrrx)rorxr=rDrr)r))r r rr)r __future__r dataclassesrrtypingrr r5rurwr|rrmrrnrdrcrrjrkrlrbr"rrrs|B#"""""********  $!3!3!3!3!3!3!3!3HJ !&!"'#'*/!ffffffX !& L! 0R0R0R0R0R0Rl D########T8J8J8J8JD CCCCCCL    F)U)U)U)UX# # # # L0#(j/j/j/j/j/j/Zr