The monitoring of Doris study notes

背景

Doris可以使用Prometheus和GrafanaMonitor and collect,Official website to download the latest version.

1. Prometheus官网下载：https://prometheus.io/download/;
2. Grafana官网下载：https://grafana.com/grafana/download.

Doris的监控数据通过FE和BE的http接口向外暴露.监控数据以key-valueThe text form of external show.每个keyThere could be differentLabel加以区分.When a user build goodDoris 后,可以在浏览器,Through the following interface to access monitoring data：

1. Frontend: fe_host:fe_http_port/metrics,如http://scentos:8030/metrics;
2. Backend: be_host:be_web_server_port/metrics,如 http://scentos:8040/metrics

The whole monitoring architecture below：

Prometheus

首先下载压缩包（https://github.com/prometheus/prometheus/releases/download/v2.26.0/prometheus-2.26.0.linux-amd64.tar.gz）,上传,解压,重命名：

[[email protected] szc]# tar -zxvf prometheus-2.26.0.linux-amd64.tar.gz
[[email protected] szc]# mv prometheus-2.26.0.linux-amd64/ prometheus-2.26.0/
[[email protected] szc]# cd prometheus-2.26.0/

修改prometheus.yml,配置两个targets,分别表示FE和BE,并定义labels和groups：

[[email protected] prometheus-2.26.0]# vim prometheus.yml
...............
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus-doris'


    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.


    static_configs:
    - targets: ['scentos:8030']
      labels:
          group: fe
    - targets: ['scentos:8040']
      labels:
          group: be

启动Prometheus：

[[email protected] prometheus-2.26.0]# nohup ./prometheus --config.file=./prometheus.yml

在浏览器访问ip:9090,并查看Status->Targets：

便可以看到FE和BE已经上线：

点击一个,结果如下：

Grafana

Download and install and start the：

[[email protected] szc]# wget https://dl.grafana.com/enterprise/release/grafana-enterprise-7.5.2-1.x86_64.rpm
[[email protected] szc]# yum install grafana-enterprise-7.5.2-1.x86_64.rpm
[[email protected] szc]# service grafana-server start

访问ip:3000,用户名密码都是admin：

第一次访问要修改密码,不过可以点击下面的skip跳过这一步,就进入grafana的主界面：

然后,添加数据源：


选中Prometheus,点击Select,然后配置URL即可：

Click the save and test below,A data source is normal：

然后添加Dashboard,点击导入：
通过面板jsonImport the content of the need to enter in the see baidu network location：链接：https://pan.baidu.com/s/1OTaQd3CZSSKmsJFwhn6HrQ ,提取码：y4p1
再点击加载：

In the next step,palo选择上一步创建的Prometheus数据源,点击导入：

In the next step,palo选择上一步创建的Prometheus数据源,点击导入：