OǻiX>dZddlZddlZddlmZddlmZmZmZm Z erddl m Z ddl m Z ddlmZddlmZdd lmZmZmZmZmZmZmZmZdd lmZmZdd lmZej@e!Z" dd l#m$Z$d Z%GddeZ*GddZ+y#e&$r dZ%dZ'dZ(dZ$dZ)Y'wxYw)z OpenTelemetry metrics collector for redis-py. This module defines and manages all metric instruments according to OTel semantic conventions for database clients. N)Enum) TYPE_CHECKINGCallableOptionalUnion)ConnectionPool) AsyncDatabase)ConnectionPoolInterface) SyncDatabase)$REDIS_CLIENT_CONNECTION_CLOSE_REASON$REDIS_CLIENT_CONNECTION_NOTIFICATIONAttributeBuilder CSCReason CSCResultGeoFailoverReasonPubSubDirection get_pool_name) MetricGroup OTelConfig)deprecated_args)MeterTFceZdZdZdZdZdZy) CloseReasona Enum representing the reason why a Redis client connection was closed. Values: APPLICATION_CLOSE: The connection was closed intentionally by the application (for example, during normal shutdown or explicit cleanup). ERROR: The connection was closed due to an unexpected error (for example, network failure or protocol error). HEALTHCHECK_FAILED: The connection was closed because a health check or liveness check for the connection failed. application_closeerrorhealthcheck_failedN)__name__ __module__ __qualname____doc__APPLICATION_CLOSEERRORHEALTHCHECK_FAILEDY/opt/lhia/marcimex/agent/venv/lib/python3.12/site-packages/redis/observability/metrics.pyrr/s , E-r%rc.eZdZdZdZdZdedefdZdId Z dId Z dId Z dId Z dId Z dIdZdIdZ dJdeedeedeedeedeedeedeefdZdededededef dZdeddeddefdZdeddfd Zdeddfd!Zd"eddfd#Zd$ed%d&eddfd'Zd"ed&eddfd(Z e!d)gd*d+, dKd-ed&edeedeed.eed)eedeedeedeedeed/eeddfd0Z" dLd1ee#deeddfd2Z$d3eded4eddfd5Z%d"eddfd6Z& dLd7e'd8eed9eeddfd:Z(e!d;gdeed?eed;eeddf d@Z) dNdAee*ddfdBZ+ dNdCedee,ddfdDZ-dEeddfdFZ.e/defdGZ0defdHZ1y)ORedisMetricsCollectorap Collects and records OpenTelemetry metrics for Redis operations. This class manages all metric instruments and provides methods to record various Redis operations including connection pool events, command execution, and cluster-specific operations. Args: meter: OpenTelemetry Meter instance config: OTel configuration object zredis-pyz1.0.0meterconfigcts td||_||_t |_d|_tj|jjvr|jtj|jjvr|jtj|jjvr|jtj|jjvr|j!tj"|jjvr|j%tj&|jjvr|j)tj*|jjvr|j-t.j1dy)NzROpenTelemetry API is not installed. Install it with: pip install opentelemetry-apiz!RedisMetricsCollector initialized)OTEL_AVAILABLE ImportErrorr)r*r attr_builderconnection_countr RESILIENCY metric_groups_init_resiliency_metricsCOMMAND_init_command_metricsCONNECTION_BASIC_init_connection_basic_metricsCONNECTION_ADVANCED!_init_connection_advanced_metricsPUBSUB_init_pubsub_metrics STREAMING_init_streaming_metricsCSC_init_csc_metricsloggerinfo)selfr)r*s r&__init__zRedisMetricsCollector.__init__QsDA    ,. $  ! !T[[%>%> >  ) ) +   $++";"; ;  & & (  ' '4;;+D+D D  / / 1  * *dkk.G.G G  2 2 4   !:!: :  % % '  DKK$=$= =  ( ( * ??dkk77 7  " " $ 78r%returnNc|jjddd|_|jjddd|_|jjdd d |_y ) zInitialize resiliency metrics.zredis.client.errorsz{error}z`A counter of all errors (both returned to the user and handled internally in the client library)nameunit descriptionz&redis.client.maintenance.notificationsz{notification}z,Tracks server-side maintenance notificationsz"redis.client.geofailover.failoversz {geofailover}z6Total count of failovers happened using MultiDbClient.N)r)create_counter client_errorsmaintenance_notifications geo_failoversrAs r&r2z.RedisMetricsCollector._init_resiliency_metricsvsv!ZZ66&z7  *.)B)B9!F*C* & "ZZ665 P7 r%c|jjddd|jj|_|jj ddd|_|jjd d d |_y ) z$Initialize basic connection metrics.z db.client.connection.create_timeszTime to create a new connectionrFrGrH#explicit_bucket_boundaries_advisoryz'redis.client.connection.relaxed_timeoutz {relaxation}z@Counts up for relaxed timeout, counts down for unrelaxed timeoutrEzredis.client.connection.handoffz {handoff}zIConnections that have been handed off (e.g., after a MOVING notification)N) r)create_histogramr*buckets_connection_create_timeconnection_create_timecreate_up_down_counterconnection_relaxed_timeoutrIconnection_handoffrMs r&r6z4RedisMetricsCollector._init_connection_basic_metricss&*jj&A&A3904 0Z0Z 'B' #+/***K*K:Z+L+ ' #'**";";2c#<# r%c|jjddd|_|jjddd|jj |_|jjd d d |_y ) z'Initialize advanced connection metrics.zdb.client.connection.timeoutsz {timeout}zaThe number of connection timeouts that have occurred trying to obtain a connection from the pool.rEzdb.client.connection.wait_timerOz/Time to obtain an open connection from the poolrPzredis.client.connection.closed {connection}z"Total number of closed connectionsN)r)rIconnection_timeoutsrRr*buckets_connection_wait_timeconnection_wait_timeconnection_closedrMs r&r8z7RedisMetricsCollector._init_connection_advanced_metricss#'::#<#<0{$=$  %)JJ$?$?1I04 0X0X %@% !"&!:!:1<";" r%ct|jjddd|jj|_y)z0Initialize command execution metric instruments.zdb.client.operation.durationrOzCommand execution durationrPN)r)rRr*buckets_operation_durationoperation_durationrMs r&r4z+RedisMetricsCollector._init_command_metricss4"&**"="=/404 0V0V #># r%cJ|jjddd|_y)z%Initialize PubSub metric instruments.zredis.client.pubsub.messagesz {message}z&Tracks published and received messagesrEN)r)rIpubsub_messagesrMs r&r:z*RedisMetricsCollector._init_pubsub_metricss'#zz88/@ 9 r%ct|jjddd|jj|_y)z(Initialize Streaming metric instruments.zredis.client.stream.lagrOzkEnd-to-end lag per message, showing how stale are the messages when the application starts processing them.rPN)r)rRr*"buckets_stream_processing_duration stream_lagrMs r&r<z-RedisMetricsCollector._init_streaming_metricss6**55*F04 0^0^ 6 r%c|jjddd|_|jjddd|_|jjdd d |_y ) z8Initialize Client Side Caching (CSC) metric instruments.zredis.client.csc.requestsz {request}z)The total number of requests to the cacherEzredis.client.csc.evictionsz {eviction}z#The total number of cache evictionszredis.client.csc.network_savedByz,The total number of bytes saved by using CSCN)r)rI csc_requests csc_evictionscsc_network_savedrMs r&r>z'RedisMetricsCollector._init_csc_metricssu JJ55,C6  "ZZ66-=7  "&!:!:1F";" r%server_address server_portnetwork_peer_addressnetwork_peer_port error_typeretry_attempts is_internalcDt|dsy|jj||}|j|jj ||||j|jj |||j jd|y)a Record error count Args: server_address: Server address server_port: Server port network_peer_address: Network peer address network_peer_port: Network peer port error_type: Error type retry_attempts: Retry attempts is_internal: Whether the error is internal (e.g., timeout, network error) rJNrkrl)rmrnrp)rorq attributes)hasattrr.build_base_attributesupdatebuild_operation_attributesbuild_error_attributesrJadd) rArkrlrmrnrorprqattrss r&record_error_countz(RedisMetricsCollector.record_error_counts,t_- !!77)#8      8 8%9"3- 9       4 4%' 5   qU3r%maint_notificationct|dsy|jj||}|j|jj ||||t <|j jd|y)a7 Record maintenance notification count Args: server_address: Server address server_port: Server port network_peer_address: Network peer address network_peer_port: Network peer port maint_notification: Maintenance notification rKNrs)rmrnrtru)rwr.rxryrzr rKr|)rArkrlrmrnrr}s r&record_maint_notification_countz5RedisMetricsCollector.record_maint_notification_counts$t89 !!77)#8      8 8%9"3 9  7I23 &&**1*?r% fail_from)r r fail_toreasonct|dsy|jj|||}|jj d|S)z Record geo failover Args: fail_from: Database failed from fail_to: Database failed to reason: Reason for the failover rLN)rrrrtru)rwr.build_geo_failover_attributesrLr|)rArrrr}s r&record_geo_failoverz)RedisMetricsCollector.record_geo_failover6sTt_- !!??@  !!%%aE%::r%callbackctj|jjvr |jsy|j j ddd|g|_y)z Initialize observable gauge for connection count metric. Args: callback: Callback function to retrieve connection count Nzdb.client.connection.countrYz!Number of connections in the poolrFrGrH callbacks)rr5r*r1r/r)create_observable_gaugerArs r&init_connection_countz+RedisMetricsCollector.init_connection_countPsS  ( ( 0I0I I))  $ B B-;j !C! r%ctj|jjvr |jsy|j j ddd|g|_y)z Initialize observable gauge for CSC items metric. Args: callback: Callback function to retrieve CSC items count Nzredis.client.csc.itemsz{item}z5The total number of cached responses currently storedr)rr=r*r1 csc_itemsr)rrs r&init_csc_itemsz$RedisMetricsCollector.init_csc_itemsgsL ??$++";"; ;DNN ;;)Oj < r% pool_namect|dsy|jj|}|jj d|y)zo Record a connection timeout event. Args: pool_name: Connection pool name rZNrrtru)rwr.build_connection_attributesrZr|rArr}s r&record_connection_timeoutz/RedisMetricsCollector.record_connection_timeout{sDt23 !!== =R   $$Q5$9r%connection_pool)r rduration_secondsct|dsy|jjt|}|jj ||y)z Record time taken to create a new connection. Args: connection_pool: Connection pool implementation duration_seconds: Creation time in seconds rTNrru)rwr.rrrTrecord)rArrr}s r&record_connection_create_timez3RedisMetricsCollector.record_connection_create_timesQt56 !!==#O4>  ##**+;*Nr%ct|dsy|jj|}|jj ||y)z Record time taken to obtain a connection from the pool. Args: pool_name: Connection pool name duration_seconds: Wait time in seconds r\Nrru)rwr.rr\r)rArrr}s r&record_connection_wait_timez1RedisMetricsCollector.record_connection_wait_timesEt34 !!== =R !!(()9e(Lr% batch_sizezXThe batch_size argument is no longer used and will be removed in the next major version.z7.2.1) args_to_warnrversion command_name db_namespace is_blockingc t|dsy|jj|sy|jj |||} | j |jj ||| | | | j |jj||jj|| y)a Record command execution duration. Args: command_name: Redis command name (e.g., 'GET', 'SET', 'MULTI') duration_seconds: Execution time in seconds server_address: Redis server address server_port: Redis server port db_namespace: Redis database index batch_size: Number of commands in batch (for pipelines/transactions) error_type: Error type if operation failed network_peer_address: Resolved peer address network_peer_port: Peer port number retry_attempts: Number of retry attempts made is_blocking: Whether the operation is a blocking command r`N)rkrlr)rrmrnrprroru) rwr*should_track_commandr.rxryrzr{r`r) rArrrkrlrrrormrnrprr}s r&record_operation_durationz/RedisMetricsCollector.record_operation_durationsFt12 {{// = !!77)#%8      8 8)%9"3-' 9       4 4% 5  &&'7E&Jr% close_reasonc t|dsy|jj}|r|j|t<|j |jj ||jjd|y)z Record a connection closed event. Args: close_reason: Reason for closing (e.g. 'error', 'application_close') error_type: Error type if closed due to error r]Nrrtru) rwr.rvaluer ryr{r]r|)rArror}s r&record_connection_closedz.RedisMetricsCollector.record_connection_closeds}t01 !!==? :F:L:LE6 7    4 4% 5  ""1"7r%connection_namerelaxedct|dsy|jj|}||t<|jj |rdnd|y)a  Record a connection timeout relaxation event. Args: connection_name: Connection name maint_notification: Maintenance notification type relaxed: True to count up (relaxed), False to count down (unrelaxed) rVN)rrtru)rwr.rr rVr|)rArrrr}s r&!record_connection_relaxed_timeoutz7RedisMetricsCollector.record_connection_relaxed_timeout s[t9: !!==+> 7I23 ''++AbU+Sr%ct|dsy|jj|}|jj d|y)z Record a connection handoff event (e.g., after MOVING notification). Args: pool_name: Connection pool name rWNrrtru)rwr.rrWr|rs r&record_connection_handoffz/RedisMetricsCollector.record_connection_handoff$sDt12 !!== =R ##A%#8r% directionchannelshardedct|dsy|jj|||}|jj d|y)z Record a PubSub message (published or received). Args: direction: Message direction ('publish' or 'receive') channel: Pub/Sub channel name sharded: True if sharded Pub/Sub channel rbN)rrrrtru)rwr.build_pubsub_message_attributesrbr|)rArrrr}s r&record_pubsub_messagez+RedisMetricsCollector.record_pubsub_message6sRt./ !!AAB    u 5r% consumer_namez[The consumer_name argument is no longer used and will be removed in the next major version. lag_seconds stream_nameconsumer_groupct|dsy|jj||}|jj ||y)z Record the lag of a streaming message. Args: lag_seconds: Lag in seconds stream_name: Stream name consumer_group: Consumer group name consumer_name: Consumer name reN)rrru)rwr.build_streaming_attributesrer)rArrrrr}s r&record_streaming_lagz*RedisMetricsCollector.record_streaming_lagPsK*t\* !!<<#)=  {u=r%resultct|dsy|jj|}|jj d|y)z} Record a Client Side Caching (CSC) request. Args: result: CSC result ('hit' or 'miss') rhN)rrtru)rwr.build_csc_attributesrhr|)rArr}s r&record_csc_requestz(RedisMetricsCollector.record_csc_requestpsCt^, !!66f6E aE2r%countct|dsy|jj|}|jj ||y)z Record a Client Side Caching (CSC) eviction. Args: count: Number of evictions reason: Reason for eviction riN)rru)rwr.rrir|)rArrr}s r&record_csc_evictionz)RedisMetricsCollector.record_csc_evictionsCt_- !!66f6E u7r% bytes_savedct|dsy|jj}|jj ||y)z Record the number of bytes saved by using Client Side Caching (CSC). Args: bytes_saved: Number of bytes saved rjNru)rwr.rrjr|)rArr}s r&record_csc_network_savedz.RedisMetricsCollector.record_csc_network_saveds?t01 !!668 "";5"Ar%c*tjS)z Get monotonic time for duration measurements. Returns: Current monotonic time in seconds )time monotonicr$r%r&monotonic_timez$RedisMetricsCollector.monotonic_times~~r%c<d|jd|jdS)NzRedisMetricsCollector(meter=z , config=))r)r*rMs r&__repr__zRedisMetricsCollector.__repr__s-djj\4;;-qQQr%)rCN)NNNNNNN) NNNNNNNNN)NN)NNN)N)2rrrr METER_NAME METER_VERSIONrrrBr2r6r8r4r:r<r>rstrint Exceptionboolr~rrrrrrrrfloatrrrrrrrrrrrrrrrr staticmethodrrr$r%r&r(r(As] JM#9e#9Z#9J ( * *    0)-%).2+/*.(,&*,4  ,4c],4'sm ,4 $C= ,4 Y' ,4! ,4d^,4\"@"@"@" "@  "@  "@H;89;67;" ;4    .    ( :3 :4 :OJKO O  O(MM M  M("^i)-%)&*$(*..2+/(,&*;K;K ;K! ;K c] ;K sm ;KSM;KY';K'sm;K$C=;K! ;Kd^;K ;K  ;K~/3*.8{+8Y'8  86TT T T  T.99 9*"&"& 6"6#6$ 6  64%&l&*(,'+ >>c]>! >  } >  >  >:'+3#3 3&'+88#8  8$BB B$ E  R#Rr%r(),r loggingrenumrtypingrrrrredis.asyncio.connectionrredis.asyncio.multidb.databaser redis.connectionr redis.multidb.databaser redis.observability.attributesr r rrrrrrredis.observability.configrr redis.utilsr getLoggerrr?opentelemetry.metricsrr,r-Counter Histogram UpDownCounterrr(r$r%r&rs ;;7<83   ?'   8 $ +N.$.$n Rn R5NGI EM s,B BB