有时候需要给Prometheus打标签,比如说联邦集群接入,需要知道是哪个集群,remote write写入的时候也需要做个标记。

直接在集群打标签

vim prometheus.yml

1
2
3
4
5
6
7
8
9
10
global:
scrape_interval: 15s # Set the scrape interval to every 15 seconds. Default is every 1 minute.
evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute.
# scrape_timeout is set to the global default (10s).

external_labels:
env: uat
dept: ops
project: xxx
...

这样就可以给集群内的所有metrics打上这三个标签。

通过联邦集群打标签

如果集群不好进行操作,可以通过联邦集群接入,在联邦主节点进行配置

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
global:
scrape_interval: 15s
evaluation_interval: 15s
scrape_timeout: 10s

scrape_configs:
- job_name: 'federate-https'
scrape_interval: 15s
scrape_timeout: 15s
honor_labels: true
metrics_path: '/federate'
scheme: https
params:
'match[]':
- '{job=~".+"}'
static_configs:
- targets:
- '192.168.77.11:9090'
- '192.168.77.12:9090'
labels:
env: uat
dept: ops
project: xxx

给接入的target打标签

这种只是给当前这个target打标签,不是全局生效

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
- job_name: node_exporter
honor_timestamps: true
scrape_interval: 5s
scrape_timeout: 5s
metrics_path: /metrics
scheme: http
follow_redirects: true
static_configs:
- targets:
- 192.168.13.117:9100
- 192.168.13.118:9100
- 192.168.13.119:9100
labels:
env: uat
dept: ops
project: xxx