Prometheus动态发现监控targets——基于文件的服务发现

为实现Prometheus监控目标配置的动态加载，可通过基于文件的服务发现完成配置

1 Kafka服务的自动发现配置

Prometheus官方exporter链接：

https://github.com/danielqsj/kafka_exporter

在kafka节点上运行docker版kafka-exporter

docker run -d -p 9308:9308 danielqsj/kafka-exporter --kafka.server=kafka:9092

创建targets文件夹：

mkdir -p /etc/promethues/targets/kafka

创建组件targets的yml文件：

vim /etc/promethues/targets/kafka
- targets:
  - "kafka1:9308"
  - "kafka2:9308"
  - "kafka3:9308"

修改/etc/prometheus/prometheus.yml:

  ...
  - job_name: 'kafka'
    file_sd_configs:
      - files:
        - targets/kafka/*.yml
        refresh_interval: 5m

2 MySQL服务的自动发现配置

Prometheus官方exporter链接：

https://github.com/prometheus/mysqld_exporter

在kafka节点上运行docker版mysql-exporter，并对应双实例

docker run -d   -p 9104:9104   -e DATA_SOURCE_NAME="exporter:pwd@(mysql-1:3306)/"   prom/mysqld-exporter
# 双实例
docker run -d   -p 9105:9104   -e DATA_SOURCE_NAME="exporter:pwd@(mysql-1:13306)/"   prom/mysqld-exporter

创建targets文件夹：

mkdir -p /etc/promethues/targets/mysql

创建组件targets的yml文件：

- targets:
  - "mysql-1:9104"
  - "mysql-1:9105"

修改/etc/prometheus/prometheus.yml:

- job_name: 'mysql'
    file_sd_configs:
      - files:
        - targets/mysql/*.yml
        refresh_interval: 5m

3 Redis Cluster服务的自动发现配置

Prometheus官方exporter链接：

https://github.com/oliver006/redis_exporter

在redis节点上运行docker版redis-exporter

docker run -d --name redis_exporter -p 9121:9121 oliver006/redis_exporter

创建targets文件夹：

mkdir -p /etc/promethues/targets/redis

创建组件targets的yml文件：

- targets:
  - redis://redis-1:16379
  - redis://redis-2:16379
  - redis://redis-3:16379

修改/etc/prometheus/prometheus.yml:

  ...
  - job_name: 'redis_exporter_targets'
    file_sd_configs:
      - files:
        - targets/redis/redis.yml
    metrics_path: /scrape
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: 10.252.210.144:9121

  ## config for scraping the exporter itself
  - job_name: 'redis_exporter'
    static_configs:
      - targets:
        - 10.252.210.144:9121