安装

到 GitHub 下载一个可执行文件，直接运行即可，或者使用 systemd 来运行，也可以直接部署到 Kubernetes 中。
https://github.com/prometheus/snmp_exporter

systemd 配置：

1
2
3
4
5
6
7
8
9
10
[Unit]
Description=snmp_exporter
After=network.target

[Service]
ExecStart=/opt/snmp_exporter/snmp_exporter --config.file=/opt/snmp_exporter/snmp.yml
Restart=on-failure

[Install]
WantedBy=multi-user.target

交换机或服务器打开 snmp 协议

这一步需要在交换机或服务器的 ipmi 上配置，交换机这种网络设备一般都只支持 snmp 协议来获取数据，比如说每个接口的状态（有没有插网线等）
对于服务器，像 cpu 占用率、内存使用率这些数据使用 node_exporter 就可以做，为啥还要使用 snmp_exporter 呢，snmp_exporter 可以做到一些底层的监控，比如说：风扇转速、电源是否有损坏的（一般服务器都有多个电源模块）、温度情况、磁盘阵列状态（是否有硬盘坏掉了，比如做了 raid1，坏了一块硬盘在软件层面是无感知的，但是需要及时更换硬盘了。）

打开 snmp 协议后，需要设置并记录一下团体名。

测试 snmp 命令示例：

1
2
3
snmpwalk -v 2c -c 123456 100.200.1.254
snmpwalk -v 2c -c 123456 172.18.48.5 1.3.6.1.2.1.47.1.1.1.1.7
snmpwalk -v3 -u sysadmin -a MD5 -A rootuser -x DES -X rootuser -l authpriv 100.200.1.24

生成配置文件

snmp exporter 开源软件中有个 snmp generator ，可以用于生成 snmp exporter 的配置文件。
配置文件中根据硬件的 MIB 文件生成了 OID 的映射关系。以 Cisco 交换机为例，在官方 GitHub 上下载最新的 snmp.yml 文件，由于 Cisco 交换机使用的是 if_mib 模块，在 if_mib 下新增 auth 配置，团体名要和交换机上配置的一致。
根据 mib 文件生成 yaml 配置文件工具：https://github.com/prometheus/snmp_exporter/tree/main/generator
关于采集的监控项是在 walk 字段下，如果要新增监控项，写在 walk 项下。我新增了交换机的 CPU 和内存信息。官方示例中的 if_mib 这个是 module 名字， if_mib 是个网络设备的规范，RFC1573

H3C 交换机配置示例

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
# WARNING: This file was auto-generated using snmp_exporter generator, manual changes will be lost.
H3C:
  walk:
  - 1.3.6.1.2.1.2.2.1.2                     #端口描述
  - 1.3.6.1.2.1.2.2.1.8                     #端口状态 1up，2down
  - 1.3.6.1.2.1.31.1.1.1.1                  #端口名称
  - 1.3.6.1.2.1.31.1.1.1.18                 #端口别名
  - 1.3.6.1.4.1.25506.2.40.2.1.2.3.1.5      #H3C端口进流量
  - 1.3.6.1.4.1.25506.2.40.2.1.2.3.1.6      #H3C端口出流量
  - 1.3.6.1.4.1.25506.8.35.18.4.3.1.13      #内存利用率
  - 1.3.6.1.4.1.25506.8.35.18.4.3.1.4       #CPU利用率
  - 1.3.6.1.4.1.25506.8.35.9.1.2.1.2        #电源状态
  get:
  - 1.3.6.1.2.1.1.1.0
  - 1.3.6.1.2.1.1.3.0
  - 1.3.6.1.2.1.1.5.0
  - 1.3.6.1.4.1.25506.8.35.18.1.1.0
  metrics:
  # 这里的name就是收集到的指标的名字
  - name: sysDescr
    oid: 1.3.6.1.2.1.1.1
    type: DisplayString
    help: A textual description of the entity - 1.3.6.1.2.1.1.1
  - name: sysUpTime
    oid: 1.3.6.1.2.1.1.3
    type: gauge
    help: The time (in hundredths of a second) since the network management portion
      of the system was last re-initialized. - 1.3.6.1.2.1.1.3
  - name: sysName
    oid: 1.3.6.1.2.1.1.5
    type: DisplayString
    help: An administratively-assigned name for this managed node - 1.3.6.1.2.1.1.5
  - name: ifOperStatus
    oid: 1.3.6.1.2.1.2.2.1.8
    type: gauge
    help: The current operational state of the interface - 1.3.6.1.2.1.2.2.1.8
    indexes:
    - labelname: ifIndex
      type: gauge
    lookups:
    - labels:
      - ifIndex
      labelname: ifAlias
      oid: 1.3.6.1.2.1.31.1.1.1.18
      type: DisplayString
    - labels:
      - ifIndex
      labelname: ifDescr
      oid: 1.3.6.1.2.1.2.2.1.2
      type: DisplayString
    - labels:
      - ifIndex
      labelname: ifName
      oid: 1.3.6.1.2.1.31.1.1.1.1
      type: DisplayString
    enum_values:
      1: up
      2: down
      3: testing
      4: unknown
      5: dormant
      6: notPresent
      7: lowerLayerDown
  - name: hh3cIfStatFlowHCInBytes
    oid: 1.3.6.1.4.1.25506.2.40.2.1.2.3.1.5
    type: counter
    help: In bytes in the specified interval - 1.3.6.1.4.1.25506.2.40.2.1.2.3.1.5
    indexes:
    - labelname: ifIndex
      type: gauge
    lookups:
    - labels:
      - ifIndex
      labelname: ifAlias
      oid: 1.3.6.1.2.1.31.1.1.1.18
      type: DisplayString
    - labels:
      - ifIndex
      labelname: ifDescr
      oid: 1.3.6.1.2.1.2.2.1.2
      type: DisplayString
    - labels:
      - ifIndex
      labelname: ifName
      oid: 1.3.6.1.2.1.31.1.1.1.1
      type: DisplayString
  - name: hh3cIfStatFlowHCOutBytes
    oid: 1.3.6.1.4.1.25506.2.40.2.1.2.3.1.6
    type: counter
    help: Out bytes in the specified interval - 1.3.6.1.4.1.25506.2.40.2.1.2.3.1.6
    indexes:
    - labelname: ifIndex
      type: gauge
    lookups:
    - labels:
      - ifIndex
      labelname: ifAlias
      oid: 1.3.6.1.2.1.31.1.1.1.18
      type: DisplayString
    - labels:
      - ifIndex
      labelname: ifDescr
      oid: 1.3.6.1.2.1.2.2.1.2
      type: DisplayString
    - labels:
      - ifIndex
      labelname: ifName
      oid: 1.3.6.1.2.1.31.1.1.1.1
      type: DisplayString  
  - name: hh3cLswSysIpAddr
    oid: 1.3.6.1.4.1.25506.8.35.18.1.1
    type: InetAddressIPv4
    help: System IP address, which is the primary IP address of the VLAN interface
      that has smallest VLAN ID and is configured IP address. - 1.3.6.1.4.1.25506.8.35.18.1.1
  - name: hh3cLswSlotMemoryRatio
    oid: 1.3.6.1.4.1.25506.8.35.18.4.3.1.13
    type: gauge
    help: The percentage of system memory in use on the board - 1.3.6.1.4.1.25506.8.35.18.4.3.1.13
    indexes:
    - labelname: hh3cLswFrameIndex
      type: gauge
    - labelname: hh3cLswSlotIndex
      type: gauge
  - name: hh3cLswSlotCpuRatio
    oid: 1.3.6.1.4.1.25506.8.35.18.4.3.1.4
    type: gauge
    help: CPU usage of the slot in accuracy of 1%, and the range of value is 1 to
      100. - 1.3.6.1.4.1.25506.8.35.18.4.3.1.4
    indexes:
    - labelname: hh3cLswFrameIndex
      type: gauge
    - labelname: hh3cLswSlotIndex
      type: gauge
  - name: hh3cDevMPowerStatus
    oid: 1.3.6.1.4.1.25506.8.35.9.1.2.1.2
    type: gauge
    help: 'Power status: active (1), deactive (2) not installed (3) and unsupported
      - 1.3.6.1.4.1.25506.8.35.9.1.2.1.2'
    indexes:
    - labelname: hh3cDevMPowerNum
      type: gauge
    enum_values:
      1: active
      2: deactive
      3: not-install
      4: unsupport
  version: 2
  max_repetitions: 25
  retries: 3
  timeout: 60s
  auth:
    community: 123456

浪潮服务器配置示例

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
# WARNING: This file was auto-generated using snmp_exporter generator, manual changes will be lost.
Inspur:
  walk:
  - 1.3.6.1.4.1.37945.2.1.5.1.1.3.19.9.65.115.115.101.116.32.84.97.103 #机器fru信息
  - 1.3.6.1.4.1.37945.2.3.1.1.1.3 #电源模块PSU当前在位状态
  - 1.3.6.1.4.1.37945.2.1.1.1.1.1.3 #CPU状态
  - 1.3.6.1.4.1.37945.2.1.2.2.1.1.3 #电压sensor健康状态,0-N/A;1-Normal;2-Warning;3-Critical
  - 1.3.6.1.4.1.37945.2.1.2.1.1.1.3 #温度sensor的健康状态,0-N/A;1-Normal;2-Warning;3-Critical
  - 1.3.6.1.4.1.37945.2.1.2.3.1.1.3 #风扇转速,0-N/A;1-Normal;2-Warning;3-Critical
  - 1.3.6.1.4.1.37945.2.1.3.1.1.1.4 #前置硬盘状态 0-N/A;1-Normal;2-Warning;3-Critical
  - 1.3.6.1.4.1.37945.2.1.6.2.1.1.9 #硬盘状态监控信息(驱动器插槽)
  - 1.3.6.1.4.1.37945.2.1.1.6.1.1.9 #电源power 0-N/A;1-Normal;2-Warning;3-Critical
  - 1.3.6.1.4.1.37945.2.1.2.5.1.1.3 #内存监控 0-N/A;1-Normal;2-Warning;3-Critical
  - 1.3.6.1.4.1.37945.2.1.6.3.1.1.4 #raid类型,比如raid1 raid5 raid10
  - 1.3.6.1.4.1.37945.2.1.6.3.1.1.2 #Raid卡健康状态信息, "Absent","Normal","Critical","N/A"
  - 1.3.6.1.4.1.37945.2.1.2.14.1.1.5 #网卡健康状态，显示为"Normal","Warning","Critical","N/A"

  metrics:
  - name: serverFRUInfoSetupAttributeValue  #机器fru信息:序列号
    oid: 1.3.6.1.4.1.37945.2.1.5.1.1.3.19.9.65.115.115.101.116.32.84.97.103
    type: DisplayString
    help: The serverFRUInfoSetupAttributeValue of this conceptual row. - 机器fru 序列号信息
    indexes:
    - labelname: inspur
      type: gauge

  - name: serverPowerSupplyMonitorPresent  #电源模块PSU当前在位状态
    oid: 1.3.6.1.4.1.37945.2.3.1.1.1.3
    type: DisplayString
    help: The serverPowerSupplyMonitorPresent of this conceptual row. - 电源模块PSU当前在位状态
    indexes:
    - labelname: inspur
      type: gauge

  - name: serverCPUInfoPresent  #CPU当前在位状态
    oid: 1.3.6.1.4.1.37945.2.1.1.1.1.1.3
    type: DisplayString
    help: The serverCPUInfoPresent of this conceptual row. - CPU当前在位状态
    indexes:
    - labelname: inspur
      type: gauge

  - name: serverRaidDiskInfoVolumeraidLevel  # raid卡类型
    oid: 1.3.6.1.4.1.37945.2.1.6.3.1.1.4
    type: DisplayString
    help: serverRaidDiskInfoVolumeraidLevel of this conceptual row. - raid卡类型
    indexes:
    - labelname: inspur
      type: gauge

  - name: serverVoltageStatus #电压sensor健康状态
    oid: 1.3.6.1.4.1.37945.2.1.2.2.1.1.3
    type: gauge
    help: The serverVoltagestatus of this conceptual row. - 电压sensor健康状态 1表示正常
    indexes:
    - labelname: inspur
      type: gauge
    enum_values:
      0: N/A
      1: Normal
      2: Warning
      3: Critical
          
          
  - name: serverTemperatureSensorStatus #温度sensor的健康状态
    oid: 1.3.6.1.4.1.37945.2.1.2.1.1.1.3
    type: gauge
    help: The serverTemperatureSensorStatus of this conceptual row. - 温度sensor的健康状态 1表示正常
    indexes:
    - labelname: inspur
      type: gauge
    enum_values:
      0: N/A
      1: Normal
      2: Warning
      3: Critical
          
          
  - name: serverFanSensorStatus #风扇转速状态
    oid: 1.3.6.1.4.1.37945.2.1.2.3.1.1.3
    type: gauge
    help: The serverFanSensorStatus of this conceptual row. - 风扇转速状态 1表示正常
    indexes:
    - labelname: inspur
      type: gauge
    enum_values:
      0: N/A
      1: Normal
      2: Warning
      3: Critical
         

  - name: serverMemoryStatus #内存监控
    oid: 1.3.6.1.4.1.37945.2.1.2.5.1.1.3
    type: gauge
    help: The serverMemoryStatus of this conceptual row. - 内存监控 1代表正常
    indexes:
    - labelname: inspur
      type: gauge
    enum_values:
      0: N/A
      1: Normal
      2: Warning
      3: Critical        
          
          
  - name: serverPowerSupplyStatus #电源power
    oid: 1.3.6.1.4.1.37945.2.1.1.6.1.1.9
    type: gauge
    help: The serverPowerSupplyStatus of this conceptual row. - 电源power 1代表正常
    indexes:
    - labelname: inspur
      type: gauge
    enum_values:
      0: N/A
      1: Normal
      2: Warning
      3: Critical       
          
  - name: serverFrontHDStatus #前置物理磁盘健康状态
    oid: 1.3.6.1.4.1.37945.2.1.3.1.1.1.4
    type: DisplayString
    help: The serverFrontHDStatus of this conceptual row. - 前置物理磁盘健康状态 Normal代表正常
    indexes:
    - labelname: inspur
      type: gauge


  - name: serverDriveSlotStatus #硬盘健康状态信息(驱动器插槽)
    oid: 1.3.6.1.4.1.37945.2.1.6.2.1.1.9
    type: DisplayString
    help: The serverDriveSlotStatus of this conceptual row. - 硬盘健康状态信息 Normal代表正常
    indexes:
    - labelname: inspur
      type: gauge
    enum_values:
      0: 0-N/A
      1: Normal
      2: Warning
      3: Critical


  - name: serverRaidLogicDiskInfoStatus #Raid卡健康状态信息
    oid: 1.3.6.1.4.1.37945.2.1.6.3.1.1.2
    type: DisplayString
    help: The serverRaidControllorStandardStatus of this conceptual row. - Raid卡健康状态信息 Optimal代表正常
    indexes:
    - labelname: inspur
      type: gauge

  - name: serverSystemNICStandardStatus #网卡监控
    oid: 1.3.6.1.4.1.37945.2.1.2.14.1.1.5
    type: DisplayString
    help: The serverSystemNICStandardStatus of this conceptual row. - 网卡健康状态信息 Normal代表正常
    indexes:
    - labelname: inspur
      type: gauge

  version: 3
  max_repetitions: 25
  retries: 3
  timeout: 60s
  auth:
    community: 123456
    security_level: authPriv
    username: sysadmin
    password: rootuser
    auth_protocol: MD5
    priv_protocol: DES
    priv_password: rootuser

验证 snmp exporter

1
curl http://localhost:9116/snmp?module=if_mib,arista_sw&target=192.0.0.8

prometheus 采集

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
- job_name: 'Inspurserver'
  scrape_interval: 60s
  scrape_timeout: 60s
  scheme: http
  file_sd_configs:
    - files:
      - /data/prometheus/conf.d/inspur_server.yml
      refresh_interval: 30s
  metrics_path: /snmp
  params:
    module: [Inspur]
  relabel_configs:
    - source_labels: [__address__]
      target_label: __param_target
    - source_labels: [__param_target]
      target_label: instance
    - target_label: __address__
      replacement: 10.200.4.64:9130 

- job_name: 'h3cswitch'
  scrape_interval: 60s
  scrape_timeout: 60s
  scheme: http
  file_sd_configs:
    - files:
      - /data/prometheus/conf.d/h3c_switch.yml
      refresh_interval: 30s
  metrics_path: /snmp
  params:
    module: [H3C]
  relabel_configs:
    - source_labels: [__address__]
      target_label: __param_target
    - source_labels: [__param_target]
      target_label: instance
    - target_label: __address__
      replacement: 10.200.4.64:9131

具体的机器配置文件在： /data/prometheus/conf.d/inspur_server.yml

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
- targets: ['100.200.1.23']
  labels:
    app: "lvs01"
    addr: "100.200.1.23"
    env: prod
    dept: hardware
    project: "hardware"
    ip: "172.16.1.11"
    type: "hardware"
    hardware: "server"
    
- targets: ['100.200.1.24']
  labels:
    app: "lvs02"
    addr: "100.200.1.24"
    env: prod
    dept: bi
    project: "bi"
    ip: "172.16.1.12"
    type: "hardware"
    hardware: "server"