Pmj' UdZddlZddlZddlZddlZddlmZddlmZddl m Z m Z m Z m Z mZddlmZddlZejeZdZdZd Ziae ee fed <daeed <daeed <ejZejZ d a!eGddZ"eGddZ#iddddddddddddddddddddddddd dd!d!d"d"d#d#d$d#id%d&d'd(d)d*d+d+d,d-d.d/d0d0d1d2d2d2d3d3d4d3d5d5d6d6d7d7d8d8d9d9d:d:d;d<dZ%e e eefed?<d@efdAZ&d@e ee ffdBZ'd@e efdCZ(dDe ee fd@dfdEZ)d@e ee ffdFZ*dkdGZ+dDe ee fdHed@dfdIZ,dJe-dHed@dfdKZ.dkdLZ/dkdMZ0 dldNdOdPe1dQe1d@e ee ffdRZ2dSedTed@e e3fdUZ4dVe ee fd@e e3fdWZ5eGdXdYZ6dSed@e e ee ffdZZ7d[e ee fdTed@e e ee ffd\Z8dSedTed@e e6fd]Z9dSed@e efd^Z:ddl;Z;e;j<d_e;j=Z>e;j?ed`<e@hdaZAdSedbed@e1fdcZBdSed@e efddZCdbedee ee fdfed@e"fdgZDdfedee ee fd@e#fdhZEdNdOdfedQe1d@e e#fdiZFdfedbed@e e"fdjZGdS)mupModels.dev registry integration — primary database for providers and models. Fetches from https://models.dev/api.json — a community-maintained database of 4000+ models across 109+ providers. Provides: - **Provider metadata**: name, base URL, env vars, documentation link - **Model metadata**: context window, max output, cost/M tokens, capabilities (reasoning, tools, vision, PDF, audio), modalities, knowledge cutoff, open-weights flag, family grouping, deprecation status Data resolution order: 1. In-memory cache (fresh, or stale served immediately while a single background daemon thread refreshes) 2. Disk cache (~/.hermes/models_dev_cache.json — any age; stale data is served rather than blocking callers on the network) 3. Network fetch (https://models.dev/api.json) — only when no cache exists at all; failed refreshes back off for 5 minutes process-wide Latency-sensitive callers (gateway route-identity checks) pass ``allow_network=False`` and never touch the network. Other modules should import the dataclasses and query functions from here rather than parsing the raw JSON themselves. N) dataclass)Path)AnyDictListOptionalTuple)atomic_json_writezhttps://models.dev/api.jsonii,_models_dev_cache_models_dev_cache_time_models_dev_retry_afterFceZdZUdZeed<eed<eed<eed<dZeed<dZeed<dZ eed <dZ eed <dZ eed <dZ eed <d Z eedfed<d Zeedfed<dZeed<dZeed<dZeeed<dZeed<dZeed<dZeeed<dZeeed<dZeed<dZeed<dZeed<dZeed<d efd!Zd efd"Z d efd#Z!d efd$Z"d efd%Z#d efd&Z$dS)' ModelInfoz1Full metadata for a single model from models.dev.idnamefamily provider_idF reasoning tool_call attachment temperaturestructured_output open_weights.input_modalitiesoutput_modalitiesrcontext_window max_outputN max_inputg cost_input cost_outputcost_cache_readcost_cache_writeknowledge_cutoff release_datestatus interleavedreturnc.|jdkp |jdkS)Nr)r r!selfs 6/home/thesage/.hermes/hermes-agent/agent/models_dev.py has_cost_datazModelInfo.has_cost_data^s":d&6&::c"|jpd|jvS)Nimage)rrr+s r-supports_visionzModelInfo.supports_visionasB'T-B"BBr/cd|jvS)Npdfrr+s r- supports_pdfzModelInfo.supports_pdfds---r/cd|jvS)Naudior5r+s r-supports_audio_inputzModelInfo.supports_audio_inputgs$///r/c|sdSd|jddd|jddg}|j|d|jddd |S) zrr2r6r9rrr?)r,capss r-format_capabilitieszModelInfo.format_capabilitiesss > % KK $ $ $ > ! KK    ! ! " KK ! ! !       KK     $ $ & & ! KK  ! - KK+ , , ,   ( KK ' ' '"&3tyyG3r/)%__name__ __module__ __qualname____doc__str__annotations__rboolrrrrrrr rrintrrrr floatr!r"r#r%r&r'r(rr.r2r6r9rArHrr/r-rr8sE;; GGG III KKKItItJK#t###L$)+eCHo***)+uS#X+++NCJ#Ix}###JK'+OXe_+++(,huo,,,cL#FCK;t;;;;CCCCC.d....0d0000 S    4S444444r/rcheZdZUdZeed<eed<eedfed<eed<dZeed<d Ze ed <d S) ProviderInfoz-Full metadata for a provider from models.dev.rr.envapir$docr model_countN) rIrJrKrLrMrNr rVrWrPrr/r-rSrSsd77 GGG III sCx HHHCMMMKr/rS openrouternovitaz novita-ai anthropicopenaiz openai-codexzaikimizkimi-for-codingz kimi-codingmoonshotstepfunzkimi-coding-cnminimaxz minimax-oauthz minimax-cndeepseekalibabaz qwen-oauthcopilotzgithub-copilotz ai-gatewayvercelz opencode-zenopencodez opencode-gokilocodekilo fireworksz fireworks-ai huggingfacegeminigooglexaiz xai-oauthxiaominvidiagroqmistral togetherai perplexitycohere ollama-cloud)rsrtPROVIDER_TO_MODELS_DEV_MODELS_DEV_TO_PROVIDERr)c(ddlm}|dz S)zReturn path to disk cache file.rget_hermes_homezmodels_dev_cache.json)hermes_constantsryrxs r-_get_cache_pathr{s(000000 ?  6 66r/c, t}|r=t|d5}tj|cdddS#1swxYwYn2#t $r%}t d|Yd}~nd}~wwxYwiS)z%Load models.dev data from disk cache.zutf-8)encodingNz(Failed to load models.dev disk cache: %s)r{existsopenjsonload Exceptionloggerdebug) cache_pathfes r-_load_disk_cachersD$&&      $j7333 $qy|| $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ DDD ?CCCCCCCCD Is:3A"A A"AA"AA"" B,B  Bc$ t}|sdS|j}t j|z }|dkrdS|S#t $r&}t d|Yd}~dSd}~wwxYw)u<Return age (in seconds) of the disk cache file, or None if missing. Used by ``fetch_models_dev`` to short-circuit the network probe when a recent on-disk cache exists. Errors (missing file, permission denied, weird filesystem) all return None — callers fall through to the network fetch path. Nrz(Failed to stat models.dev disk cache: %s)r{r~statst_mtimetimerrr)rmtimeagers r-_disk_cache_age_secondsrs$&&   "" 4!!*ikkE! 774  ?CCCttttts""A5AA B)B  Bdatac t}t||dddS#t$r&}td|Yd}~dSd}~wwxYw)z.Save models.dev data to disk cache atomically.N),:)indent separatorsz(Failed to save models.dev disk cache: %s)r{r rrr)rrrs r-_save_disk_cacherszD$&& *d4JOOOOOO DDD ?CCCCCCCCCDs!% AAActjtd}||}t |t r|std|S)zFetch the live models.dev registry without touching local caches. Raises on network errors and on an empty/invalid registry payload. ) )timeoutz0models.dev returned an empty or invalid registry)requestsgetMODELS_DEV_URLraise_for_statusr isinstancedict ValueError)responsers r-_fetch_models_dev_from_networkrsf|NG<<z#_commit_registry..+sG S Sz!T?R?R SCh## $ $ S S S S S Sr/N) rr rr r rrrsumvalues)rrs r-_commit_registryrs{T!Y[[ LLK  D  S Sdkkmm S S SSS r/excctjtzatd|t|dS)zRecord a failed refresh: arm the process-wide 5-minute backoff. Callers must hold ``_models_dev_fetch_lock`` (see ``_commit_registry``). zs 2-// # 7 7 T 6 6 6 6 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 999 # 9 9 !!< 8 8 8 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9 99& 2 2,1 ) 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 % 2 2,1 ) 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2sA5 A9A9AB, B BA0$ B0A4 4B7A4 8B;B,BB,BB#&B#,C4C7 CC C C CctjtkrdSt5tr ddddSdadddn #1swxYwYt jt dd} |dS#t$rG}t5dadddn #1swxYwYt d|Yd}~dSd}~wwxYw)zStart one daemon refresh worker if none is already running. Honors the process-wide failure backoff: after a failed refresh, no new background worker is spawned until ``_models_dev_retry_after``. NTzmodels-dev-refresh)targetrdaemonFz-Failed to start models.dev refresh thread: %s) rr rr threadingThreadrstartrrr)threadrs r-$_start_background_refresh_models_devrMs y{{,,, !-- (  --------)-%--------------- - !F I  III& 2 2,1 ) 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 DaHHHHHHHHH IsR A A  AA2B CCB( C(B, ,C/B, 0CCT allow_network force_refreshrch|sOtrtSt}|r*|at}|tj|z ndatS|s2tr+tjtz t krtS|sDtr=t tt dtS|st}|t}|r|a|t kr@tj|z at dt||n7t tt d|tS|s#tjtkrtSt5tj}|s8trtcdddS|tkrtcdddS t}t|d|cdddS#t$r}t!|dYd}~nd}~wwxYwtsDtadatr-t dtttcdddS#1swxYwYdS) uFetch models.dev registry. Cache hierarchy: in-mem → disk → network. Returns the full registry dict keyed by provider ID, or empty dict on failure. Cache hierarchy (when ``force_refresh=False``): 1. Fresh in-memory cache → return immediately. 2. Stale in-memory cache → return immediately and refresh in a single background daemon thread. Callers never block on the network while any cache exists; ``models.dev`` only changes when providers add new models, so stale data is preferable to a foreground timeout. 3. Disk cache file (any age) → load, populate in-mem, return immediately. Stale disk caches trigger the same background refresh. 4. No cache at all → singleflight foreground network fetch. On success, save to disk + in-mem and return. 5. Any failed refresh (foreground or background) suppresses further automatic refreshes for 5 minutes process-wide. When ``force_refresh=True`` (used by ``hermes config refresh``, the "refresh model catalog" code path), cache fast paths and the failure backoff are bypassed; the function hits the network and only falls back to cached data if the call fails. When ``allow_network=False``, any memory or disk cache is returned regardless of age and no request is made — used by latency-sensitive paths (gateway route-identity checks) that must never wait on the network. Nrz@Using stale in-memory models.dev cache; refreshing in backgroundzALoaded models.dev from fresh disk cache (%d providers, age=%.0fs)zGUsing stale models.dev disk cache (age=%.0fs); refreshing in background foregroundrz1Loaded stale models.dev disk cache (%d providers))r rrrr rrrrrrr rrrrr)rr disk_datadisk_agenowrrs r-fetch_models_devris<  !  %$ $$&&   ) .00H*2*> h&&A #! ! !Y[[1 15J J J   !.!!!!,... N   !  )*,,  (**I )$-!333.2Y[[8-C*LL458^^X ,---8:::LL3  )( !TY[[+BBB  !!ikk )  )( !!!!!!!! ,,,( !!!!!!!! 9133D T 6 6 6 6!!!!!!!! 9 9 9 !!< 8 8 8 8 8 8 8 8 8 9 !  0 2 2 %& "   G)** !7!!!!!!!!!!!!!!!!!!s=%#J'J'4 H!! I+I<J'IAJ''J+.J+providermodelc"t|}|sdSt}||}t|tsdS|di}t|tsdS||}|rt |}|r|S|}|D]2\} } | |krt | }|r|cS3dD]} || z} || }|rt |}|r|cS|| z} |D]4\} } | | krt | }|r|ccS5dS)zLook up context_length for a provider+model combo in models.dev. Returns the context window in tokens, or None if not found. Handles case-insensitive matching and filters out context=0 entries. Nr)z:cloudz-cloud)rurrrr_extract_contextloweritems)rrmdev_provider_idr provider_datarentryctx model_lowermidmdatasuffix suffixed_keysuffixed_lowers r-lookup_models_dev_contextrs .11(;; t   DHH-..M mT * *t   x , ,F fd # #t JJu  E u%%  J++--Kllnn U 99;;+ % %"5))C  '  v~  <((  "5))C  $v- ,,..  JCyy{{n,,&u--JJJJJ   4r/rct|tsdS|d}t|tsdS|d}t|ttfr|dkrt|SdS)zExtract context_length from a models.dev model entry. Returns None for invalid/zero values (some audio/image models have context=0). Nlimitcontextr)rrrrPrQ)rrrs r-rr%s eT " "t IIg  E eT " "t ))I  C#U|$$q3xx 4r/cheZdZUdZdZeed<dZeed<dZeed<dZ e ed<d Z e ed <d Z e ed <d S)ModelCapabilitiesz;Structured capability metadata for a model from models.dev.Tsupports_toolsFr2supports_reasoning@ r max_output_tokensr$ model_familyN)rIrJrKrLrrOrNr2rrrPrrrMrr/r-rr:szEEND!OT!!!$$$$ NC   !s!!!L#r/rct|}|sdSt}||}t|tsdS|di}t|tsdS|S)zResolve a Hermes provider ID to its models dict from models.dev. Returns the models dict or None if the provider is unknown or has no data. Nr)rurrrr)rrrrrs r-_get_provider_modelsrFs .11(;; t   DHH-..M mT * *t   x , ,F fd # #t Mr/rc||}t|tr|S|}|D]6\}}||krt|tr|cS7dS)zBFind a model entry by exact match, then case-insensitive fallback.N)rrrrr)rrrrrrs r-_find_model_entryr[s JJu  E% ++--Kllnn U 99;;+ % %*UD*A*A %LLL 4r/ct|}|dSt||}|dSt|dd}|di}t |t r|d}nd}t |t rd|v}n#t|dd}t|dd}|d i}t |t si}|d } t | ttfr| d krt| nd } |d } t | ttfr| d krt| nd} |ddpd} t|||| | | S)uLook up full capability metadata from models.dev cache. Uses the existing fetch_models_dev() and PROVIDER_TO_MODELS_DEV mapping. Returns None if model not found. Extracts from model entry fields: - reasoning (bool) → supports_reasoning - tool_call (bool) → supports_tools - attachment (bool) → supports_vision - limit.context (int) → context_window - limit.output (int) → max_output_tokens - family (str) → model_family NrF modalitiesinputr1rrrrrroutputrrr$)rr2rrrr) rrrOrrrlistrPrQr)rrrrr input_modsr2rrrroutrrs r-get_model_capabilitiesrks"( + +F ~t fe , ,E }t%))K7788N<,,J*d##^^G,,  *d##?!Z/uyyu==>>eii U;;<< IIgr " "E eT " " ))I  C!+C#u!>!>V377SXXXPVN ))H  C$.sS%L$A$AWcAggCSW99Xr**0bL %'-%+!    r/cddlm}|pt}|gSfd|DS)zReturn all model IDs for a provider from models.dev. Returns an empty list if the provider is unknown or has no data. r)normalize_providerNc4g|]}t||Sr)"_should_hide_from_provider_catalog)rrrs r- z(list_provider_models..s9   1(C@@     r/)hermes_cli.modelsrrkeys)rrrs` r-list_provider_modelsrsv 544444!!(++7xH !( + +F ~     {{}}   r/zZ-tts\b|embedding|live-|-(preview|exp)-\d{2,4}[-_]|-image\b|-image-preview\b|-customtools\b_NOISE_PATTERNS> gemma-3-1b gemma-3-2b gemma-3-4b gemma-3-12b gemma-3-27b gemma-3-1b-it gemma-3-2b-it gemma-3-4b-itgemini-1.5-progemma-3-12b-itgemma-3-27b-itgemma-4-26b-itgemma-4-31b-itgemini-1.5-flashgemini-2.0-flashgemma-4-26b-a4b-itgemini-1.5-flash-8bgemini-2.0-flash-litemodel_idc|pd}|pd}|dvr |tvrdSdS)Nr$>rjrkTF)stripr_GOOGLE_HIDDEN_MODELS)rrprovider_lowerrs r-rrsen"++--3355N>r((**0022K---+AV2V2Vt 5r/c@t|}|gSg}|D]s\}}t|tst ||r,|ddsCt |r^||t|S)zReturn model IDs suitable for agentic use from models.dev. Filters for tool_call=True and excludes noise (TTS, embedding, dated preview snapshots, live/streaming, image-only models). Returns an empty list on any failure. NrF) rrrrrrrsearchr>)rrresultrrs r-list_agentic_modelsrs"( + +F ~ Fllnn   U%&&   -h < <  yye,,    ! !# & &   c Mr/rawrc |dpi}t|tsi}|dpi}t|tsi}|dpi}t|tsi}|dpg}|dpg}|d}t|ttfr|dkrt|nd} |d} t| ttfr| dkrt| nd} |d} t| ttfr| dkrt| nd} t did |d |d d p|d |d d pd d |dt |dddt |dddt |dddt |dddt |dddt |dddt|trt|nddt|trt|ndd| d| d| dt |ddpddt |ddpddd|vr|dt |dnddd |vr|d t |d ndd!|d"d pd d#|d#d pd d$|d$d pd d%|d%dS)&zEConvert a raw models.dev model entry dict into a ModelInfo dataclass.rcostrrrrrNrrr$rrrFrrrrrrrrrrrr r!r" cache_readr# cache_writer% knowledger&r'r() rrrrPrQrrOrtuple)rrrrrrr output_modsrctx_introut_intinpinp_ints r-_parse_model_infor's@ GGG   "E eT " " 776?? bD dD ! !&&,"J j$ ' ' ((.BJ..**0bK ))I  C$S3,77JC!GGc#hhhG ))H  C$S3,77JC!GGc#hhhG ))G  C$S3,77MC!GGc#hhhG     8  WWVR ,H wwx$$*  K   sww{E22333   sww{E22333   e44555 66777 sww':EBBCCC #''.%88999 /9T.J.JRz***PR 1;;0M0MU% ,,,SU w 7 '  '1--2333! "$((8Q//41555# $6BT5I5IdS_N`Nld<0111rv% &8E7L7LQUVcQdQptM2333vz' (b117R) *WW^R006B+ ,wwx$$*- .GGM5111/ r/c |dpg}|dpi}t||ddp|t|trt |nd|ddpd|ddpdt|t rt |nd S) zAConvert a raw models.dev provider entry dict into a ProviderInfo.rTrrr$rrUrVr)rrrTrUrVrW)rrSrrr!rr)rrrTrs r-_parse_provider_infor)9s ''%.. BC WWX   $"F   WWVR /K$S$// 7E#JJJR GGE2   $" GGE2   $"#-fd#;#;BCKKK    r/ct||}|rtntd}||}t|tsdSt ||S)zGet full provider metadata from models.dev. Accepts either a Hermes provider ID (e.g. "kilocode") or a models.dev ID (e.g. "kilo"). Returns None if the provider is not in the catalog. FrN)rurrrrr))rrmdev_idrrs r-get_provider_infor,Ks|%((kBBG  3 E 2 2 2 ((7  C c4 t  - --r/c\t||}t}||}t|tsdS|di}t|tsdS||}t|trt |||S|}|D]E\}} ||kr(t| trt || |cSFdS)zGet full model metadata from models.dev. Accepts Hermes or models.dev provider ID. Tries exact match then case-insensitive fallback. Returns None if not found. Nr)rurrrrr'rr) rrr+rpdatarrrrrs r-get_model_infor/is%((kBBG   D HHW  E eT " "t YYx $ $F fd # #t **X  C#t9 3888..""Kllnn:: U 99;;+ % %*UD*A*A %$S%99 9 9 9 4r/)r)N)F)HrLrloggingrr dataclassesrpathlibrtypingrrrrr utilsr r getLoggerrIrrrrr rMrNr rQr LockrrrrrSrurvr{rrrrrrrrrrrOrrPrrrrrrrrecompile IGNORECASErPattern frozensetrrrr'r)r,r/rr/r-r<s+0  !!!!!!33333333333333######  8 $ $.%'4S>&&& !!!!!""""')))9>++ % K4K4K4K4K4K4K4 K4\   '*,'* k'*'* h '* H '*  5 '* '*$'*!'*y'*''*y'*Y'*,'* '* y!'*")#'*'*$%'*&(''*(J)'**=+'*,-'*./'*0=1'*2 h3'*4 h5'*6 57'*<='*> h?'*@ hA'*B FC'*DyE'*F,G'*H,I'*'*J"M'*'*'*S#X'''T59$sCx.188877777 $sCx.    %4D4S>DdDDDDS#X$ , , , ,4S>ST* y C D     2 2 2 2IIII: ~!:>~!~!~!~!37~! #s(^~!~!~!~!B88C8HSM8888v DcN x}    *  38DcN+C* d38n S Xd3PS8n=U     :S::BS9T::::z349& (bj0M" ###4#$s)<00$sCx.0s0y0000f c S#X <    &04....(,. l....< # ir/