mirror of
https://github.com/tendermint/tendermint.git
synced 2026-01-09 22:47:24 +00:00
89 lines
12 KiB
Markdown
89 lines
12 KiB
Markdown
---
|
|
order: 4
|
|
---
|
|
|
|
# Metrics
|
|
|
|
Tendermint can report and serve the Prometheus metrics, which in their turn can
|
|
be consumed by Prometheus collector(s).
|
|
|
|
This functionality is disabled by default.
|
|
|
|
To enable the Prometheus metrics, set `instrumentation.prometheus=true` in your
|
|
config file. Metrics will be served under `/metrics` on 26660 port by default.
|
|
Listen address can be changed in the config file (see
|
|
`instrumentation.prometheus\_listen\_addr`).
|
|
|
|
## List of available metrics
|
|
|
|
The following metrics are available:
|
|
|
|
| **Name** | **Type** | **Tags** | **Description** |
|
|
|-----------------------------------------|-----------|-----------------|--------------------------------------------------------------------------------------------------------------------------------------------|
|
|
| abci_connection_method_timing | Histogram | method, type | Timings for each of the ABCI methods |
|
|
| consensus_height | Gauge | | Height of the chain |
|
|
| consensus_validators | Gauge | | Number of validators |
|
|
| consensus_validators_power | Gauge | | Total voting power of all validators |
|
|
| consensus_validator_power | Gauge | | Voting power of the node if in the validator set |
|
|
| consensus_validator_last_signed_height | Gauge | | Last height the node signed a block, if the node is a validator |
|
|
| consensus_validator_missed_blocks | Gauge | | Total amount of blocks missed for the node, if the node is a validator |
|
|
| consensus_missing_validators | Gauge | | Number of validators who did not sign |
|
|
| consensus_missing_validators_power | Gauge | | Total voting power of the missing validators |
|
|
| consensus_byzantine_validators | Gauge | | Number of validators who tried to double sign |
|
|
| consensus_byzantine_validators_power | Gauge | | Total voting power of the byzantine validators |
|
|
| consensus_block_interval_seconds | Histogram | | Time between this and last block (Block.Header.Time) in seconds |
|
|
| consensus_rounds | Gauge | | Number of rounds |
|
|
| consensus_num_txs | Gauge | | Number of transactions |
|
|
| consensus_total_txs | Gauge | | Total number of transactions committed |
|
|
| consensus_block_parts | Counter | peer_id | number of blockparts transmitted by peer |
|
|
| consensus_latest_block_height | gauge | | /status sync_info number |
|
|
| consensus_fast_syncing | gauge | | either 0 (not fast syncing) or 1 (syncing) |
|
|
| consensus_state_syncing | gauge | | either 0 (not state syncing) or 1 (syncing) |
|
|
| consensus_block_size_bytes | Gauge | | Block size in bytes |
|
|
| consensus_step_duration | Histogram | step | Histogram of durations for each step in the consensus protocol |
|
|
| consensus_block_gossip_receive_latency | Histogram | | Histogram of time taken to receive a block in seconds, measure between when a new block is first discovered to when the block is completed |
|
|
| consensus_block_gossip_parts_received | Counter | matches_current | Number of block parts received by the node |
|
|
| consensus_quorum_prevote_delay | Gauge | | Interval in seconds between the proposal timestamp and the timestamp of the earliest prevote that achieved a quorum |
|
|
| consensus_full_prevote_delay | Gauge | | Interval in seconds between the proposal timestamp and the timestamp of the latest prevote in a round where all validators voted |
|
|
| consensus_proposal_timestamp_difference | Histogram | | Difference between the timestamp in the proposal message and the local time of the validator at the time it received the message |
|
|
| consensus_vote_extension_receive_count | Counter | status | Number of vote extensions received |
|
|
| consensus_proposal_receive_count | Counter | status | Total number of proposals received by the node since process start |
|
|
| consensus_proposal_create_count | Counter | | Total number of proposals created by the node since process start |
|
|
| consensus_round_voting_power_percent | Gauge | vote_type | A value between 0 and 1.0 representing the percentage of the total voting power per vote type received within a round |
|
|
| consensus_late_votes | Counter | vote_type | Number of votes received by the node since process start that correspond to earlier heights and rounds than this node is currently in. |
|
|
| evidence_pool_num_evidence | Gauge | | Number of evidence in the evidence pool |
|
|
| p2p_peers | Gauge | | Number of peers node's connected to |
|
|
| p2p_peer_receive_bytes_total | Counter | peer_id, chID | number of bytes per channel received from a given peer |
|
|
| p2p_peer_send_bytes_total | Counter | peer_id, chID | number of bytes per channel sent to a given peer |
|
|
| p2p_peer_pending_send_bytes | Gauge | peer_id | number of pending bytes to be sent to a given peer |
|
|
| p2p_router_peer_queue_recv | Histogram | | The time taken to read off of a peer's queue before sending on the connection |
|
|
| p2p_router_peer_queue_send | Histogram | | The time taken to send on a peer's queue which will later be sent on the connection |
|
|
| p2p_router_channel_queue_send | Histogram | | The time taken to send on a p2p channel's queue which will later be consumed by the corresponding service |
|
|
| p2p_router_channel_queue_dropped_msgs | Counter | ch_id | The number of messages dropped from a peer's queue for a specific p2p channel |
|
|
| p2p_peer_queue_msg_size | Gauge | ch_id | The size of messages sent over a peer's queue for a specific p2p channel |
|
|
| mempool_size | Gauge | | Number of uncommitted transactions |
|
|
| mempool_tx_size_bytes | Histogram | | transaction sizes in bytes |
|
|
| mempool_failed_txs | Counter | | number of failed transactions |
|
|
| mempool_recheck_times | Counter | | number of transactions rechecked in the mempool |
|
|
| state_block_processing_time | Histogram | | time between BeginBlock and EndBlock in ms |
|
|
| state_consensus_param_updates | Counter | | number of consensus parameter updates returned by the application since process start |
|
|
| state_validator_set_updates | Counter | | number of validator set updates returned by the application since process start |
|
|
|
|
## Useful queries
|
|
|
|
Percentage of missing + byzantine validators:
|
|
|
|
```prometheus
|
|
((consensus_byzantine_validators_power + consensus_missing_validators_power) / consensus_validators_power) * 100
|
|
```
|
|
|
|
Rate at which the application is responding to each ABCI method call.
|
|
```
|
|
sum(rate(tendermint_abci_connection_method_timing_count[5m])) by (method)
|
|
```
|
|
|
|
The 95th percentile response time for the application to the `deliver_tx` ABCI method call.
|
|
```
|
|
histogram_quantile(0.95, sum by(le) (rate(tendermint_abci_connection_method_timing_bucket{method="deliver_tx"}[5m])))
|
|
```
|