[cloud resident co creation] detailed introduction to DWS alarm service DMS and cluster connection mode

DWS It is a distributed database with analysis and mixed load capability , Support x86 and Kunpeng Hardware architecture , Support row storage and column storage , Provide GB~PB Level data analysis ability 、 Multimode analysis and real-time processing capability , For data warehouse 、 The data mart 、 Real time analysis 、 Real time decision making and mixed load scenarios , Widely used in cars 、 manufacture 、 retail 、 logistics 、 Internet 、 Finance 、 The government 、 Telecommunications and other industries analysis and decision-making system .

As mentioned above ,DWS The application scenario of is very important , So whether the database is working properly 、 Whether there is a failed node 、 Slow query, etc , How to react quickly and repair , It is an important issue concerned by many users .

Hua Wei Yun DWS To this end, we launched DMS, This is a product that provides monitoring 、 analysis 、 Cloud native database monitoring and management service with alarm identification and other functions .

DMS With eyes 、 brain 、 Three core parts of the hand .
eye ： Collect and store database operation status data .

brain ： According to the monitoring data , Identify the abnormal state of the database , Locate the root cause of the abnormal state , And give the solution

hand ： According to the solution , Perform O & M operations , Fix the problem .

The following is a detailed introduction

DWS Four basic abilities

1. Alarm information statistics

DMS Alarm information statistics function , Can provide the past 7 Trend of alarm generation within days , And the number and distribution of alarms not eliminated in the current system , It supports filtering alarm statistics according to the cluster .

2. Warning notice

The notification channel includes the SMS platform 、 Mail, etc. , Easy to operate 、dba Personnel quickly perceive the occurrence of the problem , In a timely manner to repair , Avoid affecting the normal operation of the business .

3. Alarm rules

At present DMS Provides 20 Multiple alarm rules , These rules are enabled by default , It supports modification and deactivation .

Users can modify the threshold according to their actual business conditions , Set alarm suppression conditions, etc , It is convenient to filter some alarms that are not concerned or have a short cycle , It supports binding to specific clusters , The configuration method is very flexible .

4. Key information monitoring

Currently, the online monitoring is mainly related to hardware resources , for example cpu Usage rate 、 Log disk condition 、 Swap partition disks, etc .
It also includes some more advanced and detailed information , For example, query statement accumulation 、 Query statements with a large number of triggers .
For example, resource pool after job submission 20 No change in minutes , There will be an alarm , Prompt the user for troubleshooting .

DMS Six overview topic pages

DMS On the entry page , Distribute by topic , It shows the usage and performance of resources in each dimension of the cluster , And present them in the form of cards .

1. State of the cluster

Cluster status includes the past in the cluster 24 The percentage of hours in normal state , And the proportion of abnormal states .
And analyze the degradation of each proportion , How much to catch up with .
It also includes DWS Subdivide database instances DN Current state 、 Active / standby switching times, etc .

2. Alarm Statistics

Alarm statistics , The current alarm is displayed 、 Alarms have not been eliminated in the past and alarm generation trends , It is convenient for users to quickly confirm the number and distribution of alarms .

3. Cluster resources

Contains cpu、 disk 、 Usage of basic hardware resources such as memory .
It also includes 24h An average value at the cluster level within , as well as top5 Resource consumption of nodes, etc .

4. Business load

Business load , It shows Sql Accumulation 、Qps、dbs Statistics 、 Workload queue queuing, etc , It is convenient for the user to confirm the operation performance of the job , Quickly locate problem jobs , And timely adjust and repair .

5. database

The database page shows the current capacity of the database 、 Monitoring of capacity of each mode , And current usage top5 Of schema.

6. Query statistics

The query statistics page shows 24h Total number of queries in 、 The average time taken 、 Total transactions, etc .
Monitoring of queries and sessions , You need to open the session collection item in advance .
The real-time session tab displays the applications currently connected to the database , Include user name 、 Conversation time 、 client ip、 Access CN etc. , We can talk in real time ID Jump to the corresponding ID In the current query of

DMS Special function

Query execution plan

By querying ID, Go to the query details page , Query the execution status through the table , And through the visual page , see SQL Implementation plan .

History query

The history query page will query the completed execution status , Provide richer information than real-time query .
Support query ID, View execution SQL More details such as resource usage of .

Slow instance query

DMS Can be in the cluster CN Automatically configure and pull up the slow instance detection script on the node , Periodically collect the cache table of the script , Report the detected slow instance data . The user can view... On the interface 24 Number of slow instances detected in hours , And the distribution status information in the time dimension , More quickly locate the slow node that slows down the entire cluster , And analyze the root cause .

DMS Can be in the cluster CN Node , Automatically configure and pull up the slow instance detection script .

DMS You can display user-defined workload queue names , real time / Historical resources , Show the work on the workload queue .

Performance monitoring

DMS Performance monitoring is also provided , It is convenient to use the trend chart to monitor each indicator data .

DMS Four tools

SQL The diagnosis

After real-time query monitoring and historical query monitoring are enabled ,DMS Provides answers to questions SQL The diagnostic function of , Will affect the performance in the past period of time sql Analyze , Give the corresponding diagnosis , Remind the user to modify .

DLL to examine

DDL Auditing is used to evaluate DDL Normative detection of metadata , It is convenient for users to perceive potential table definition problems in advance .
For the failed audit items , You can click to view , Go to the details page .

SQL probe

User configured probe SQL, Timing detection probe SQL execution time , Support for probes that exceed the alarm threshold SQL Report an alarm .

For configuration SQL Cluster of probes , Support to configure alarm items .

Load analysis

Upgrade to the latest version of dmsagent after , Cloud data warehouse can provide related functions , Provide performance data collection and analysis for the database , Users can take snapshots of load information , Collect the load information data of the cluster in the specified time period , Two load information snapshots can form a load diagnosis report within this time period .

Load diagnosis report WDR You can provide performance data for a specified period of time , With HTML Present to users in the form of Web reports , It can help users find exceptions 、 Diagnosis problem 、 Optimize performance, etc , Its content is rich and intuitive , It is a sharp tool for database tuning .
The load information snapshot page displays the basic information of the cluster load information snapshot , Support manual trigger creation and related parameter configuration .

Complimentary gift ： Connect DWS Clustered 3 Ways of planting

in addition , This article comes with how to quickly apply DWS Experience , It is convenient for you to quickly go to the cloud , Application worry free .
Here are three common DWS How to connect ：

Gsql Command line

Can be based on linux platform , Remote connection cluster .

dataStudio The graphical interface

This is based on windows Of sql Client tools , It can operate and run more intuitively SQL Script .

Jdbc drive

Used to make calls in code to connect to the database , Is a choice that developers often use .

Let's introduce in detail the commonly used Gsql Command mode , To understand DWS Connection process .

GSQL How to connect

Download client

Download the correct... From the official website gsql Installation package .
The common problem is the version problem , Therefore, pay attention to the correct version .

Get ready linux The server

Can be gsql It is installed on the following two types of servers ：

1. Huawei cloud elastic cloud server ECS, The connection address can use the intranet address and the public address , Good connectivity .
2. have linux The server , Select the public network address for the connection address , Bandwidth is limited by the local network .

Here is the concept of link address ：
Intranet address ： Addresses that can access connections in the same private network
for example CN Address 、 Intranet domain name address
Public address ： In the private network , Or the Internet .

Install client

In the corresponding linux On the machine , Execute the installation command , Install the client .

Connect clusters

Use gsql The client starts the command to connect .

summary

You can see DWS Of DMS The alarm service is very powerful , Under the guarantee of alarm service , Store and use through a specific connection DWS data , It will be very convenient , Worry free in the cloud .

---

Developer forum link ：https://bbs.huaweicloud.com/forum/forumdisplay-fid-598.html

This article participates in Huawei cloud community 【 Content co creation 】 Activity number 17 period .
https://bbs.huaweicloud.com/blogs/358780

Original video link address ：
https://bbs.huaweicloud.com/live/cloud_live/202205251900.html
theory + Practice , Easily solve common problems of cloud data warehouse
Send a set of environment , Teach you how to put data into the cloud , Analyze worry free