Watson K's Secret Diary

1

Emergency situation — Sudden monitoring alarm

Vuvuzel ~~ Vuvuzel ~~

Midnight ,KMonitor The life linkage system will alarm immediately after it detects that the memory pressure of jinxiaocang is too high ,120 The command center received an alarm , An ambulance was quickly sent to send jinxiaocang to the emergency department of Xihong municipal hospital , The patient is in critical condition. Please ask Watson ·K The doctor went to the consulting room 1 Have a consultation , Doctor Watson ·K Took the KMonitor Memory alarm list , Look carefully .

KMonitor Memory monitoring diagram 、 Alarm list

“ Generally, the sudden increase in query volume leads to a sudden increase in memory pressure , Try increasing physical memory first .” 

Watson ·K The doctor inserted a new memory module into jinxiaocang . Look at the slowly decreasing pressure value in the memory monitoring diagram , He patted Jin xiaocang gently and comforted him ：“ Don't panic , Just a sudden increase in the number of queries , Just add a memory module .”

And then , Jinxiaocang takes the medical record and breathes a sigh of relief , I thought it was good that my body was built in KMonitor chip , It can be linked with the hospital in real time , Find and deal with problems in time .

2

Hard core follow-up — Handle faults efficiently

Two weeks later , Jinxiaocang appeared again in the database outpatient Hall of the municipal hospital , This time he seemed to look a little dull , Enter the consulting room slowly .

Today is Watson ·K The doctor sits on the table , Jinxiaocang said ：“ Dr. , A week ago, the customer added the business module of the application system , I began to feel stupid , I don't know what's wrong .”

Watson ·K The doctor checked the basic state of Qijin xiaocang ： The tongue coating is dark 、 The pulse fluctuates slightly slower .

“ From these symptoms , It is basically determined that a large number of database links have been suddenly added in the recent week , This leads to excessive query pressure , The resulting lock competition is particularly prominent , meanwhile CPU There should be a bottleneck .” 

Watson ·K Doctors rely on years of clinical experience to slowly analyze , At the same time, he said ,“ Make another KMonitor Check , The inspection report issued by it is more detailed , The root cause of the problem can be determined and the remedy can be applied to the case , By the way, check the recent memory problems , See if there are any abnormal fluctuations .” Watson ·K The doctor simply listed the problems found so far in the medical record .

And then , He led Jin xiaocang into the examination room .

“ Lie down and don't move , Calm down and , Deep breathing ……”, And he said , Watson ·K The doctor is operating the newly introduced KMonitor The equipment does a full body scan for jinxiaocang . A moment later , Inspection reports are printed out automatically .

Watson ·K The doctor stared at KMonitor Memory check report issued , It seems that the new business modules are still under great pressure on the memory , The memory utilization rate has reached 95% 了 .

Then , Watson ·K The doctor examined KMonitor Output KingbaseES Performance report , In the last two weeks , Database links continue to grow , Cache hit rate decreases gradually , It shows that the early diagnosis direction is correct , Improving memory capacity solves some problems .

Then Watson ·K The doctor looked at the overall performance pressure trend chart in the past month , Thinking in my heart “ The pressure continues to grow , Consider expanding the capacity of nodes , The situation of the read-write separation cluster , The standby node can share some query pressure .”

Finally, Watson ·K The doctor passed KMonitor Checked jinxiaocang's SQL Inquiry , The query report shows “ The response time jitter is the most serious ”“ The statement with the slowest average query time ” Etc , Watson ·K The doctor analyzed them sentence by sentence ：

SQL Statement jitter should be related to hardware resource pressure , When the pressure is high, the corresponding time for querying the database will increase , This needs to be solved by upgrading the hardware or expanding the capacity .

slow SQL The problem of , The first two statements are perf Table in the query , Response time up to 1s many , It seems that the table is too large and there is no index .

Watson ·K According to the doctor KMonitor Inspection report , The medical record has been adjusted , At the same time, remind jinxiaocang ：“KMonitor yes KingbaseES Special inspection tools for , You can have a physical examination , Discover hidden dangers in advance , A situation like yours needs to be checked regularly , If you feel unwell, see a doctor in time .”

Jinxiaocang expanded a node according to the medical records , Then I asked a masseur for several tables with large capacity （ such as perf surface ） Partitioned and re indexed , Adjusted database parameters , New link pool module , Seems to have returned to the previous carefree happy time , The customer complaint rate has dropped a lot .

3

Physical examination diary — Estimate potential risks

After a month , Watson ·K The doctor is sitting as usual , Jinxiaocang looks at Watson ·K The doctor said ：“ Dr Watson , I am much better now , But yesterday my heart beat faster , I hung up your number immediately , Come and see what happened ？”

Watson ·K The doctor stared at the previous medical records and was lost in thought ： Is this abnormal condition a side effect of the recent frequent hardware replacement , But according to the upgrade report, I have done the compatibility stress test .“ It can't be a precursor of organic disease , Only do it again KMonitor Checked .”

Jinxiaocang is still lying KMonitor In the inspection cabin , Watson next to me ·K The doctor looked at it KMonitor Spit out an inspection report .

Suddenly, this server resource monitoring report caused Watson ·K Doctor's attention , In yesterday, 12:00 when CPU、 Memory 、 Disk pressure spikes , The strange thing is that the disk read / write rate is very low, but the disk utilization rate is as high as 75%.

Watson ·K Doctors use KMonitor The disk inspection tool of has made a comprehensive scan of all disks , I found a hard disk appeared more than ten times C5 Warning , This is the warning prompt for the bad track of the hard disk , Watson ·K The doctor suddenly realized , It seems that it is the culprit that causes the heart rate to accelerate , Thanks to KMonitor This integrated monitoring platform , Otherwise, it will be troublesome to locate this problem .

“ The reason why your heart beats faster has been found , This hard disk is about to go bad ……” Watson ·K The doctor finally analyzed all the reports , The final conclusion is given , I also felt a sigh of relief .

“ Bad track , It turned out to be evil ……” Jinxiaocang seems to have heard the talisman ,“ Fortunately, I came to the hospital for examination , Otherwise, the consequences of the loss accident will be unimaginable , My year-end performance was ruined .K Doctor, this examination equipment is really powerful , This kind of problem can be found out ！”

Watson ·K Doctors always have a headache for missing patients , It is difficult to repair the lost number problem , On the other hand, there is no good means to prevent .

But the good thing is KMonitor Monitoring tools , Early warning can be given ：“ This is a newly imported equipment KMointor, Continue to come to the hospital for physical examination regularly , It will warn many diseases in advance ; In your body KMonitor The chip has been monitoring various indicators , In case of any abnormal condition, it will give an alarm in time , Our hospital will also receive warning messages , Timely provide you with targeted solutions .”

Jinxiaocang did not hesitate to replace the hard disk and restore it with the backup set , Thanks a lot KMonitor Deal with hidden dangers as soon as possible , Nip in the bud . Walk out of jinxiaocang of the hospital , The corners of the mouth are slightly raised , The whole person seems to be reborn , Because it knows what's inside the body KMonitor The chip is guarding itself in real time .

Watson ·K The doctor looked at jinxiaocang leaving , Pick up the phone ：“ Sherlock Holmes ·K sir , I'm Watson , I am back ！”.

Conclusion

The current epidemic situation is still grim , Countless enterprises 、 Families and individuals are shrouded in the great shadow of the epidemic .

In this invisible battle , Front line epidemic prevention and control workers silently stick to their posts , Do a good job of health protection for the public .

However , In the past, the database running around various customer sites was operated and maintained DBA, Activities affected by the epidemic are limited , Only remotely intervene when the customer asks for help , Unable to periodically patrol . therefore , Problems that can be found and solved during periodic inspection , For example, the database performance is degraded 、 Hardware resources are alarmed 、CPU High utilization rate 、 Insufficient disk space 、 The network delay is too long , Implement operation and maintenance for the database isolated at home DBA for , It's out of reach , Only when these problems turn into accidents can we put out fires everywhere .

Renmin Jincang KMonitor Born at this time , Aspire to be the lone brave behind the database , Escort the users who purchase and use the gold warehouse database , Always pay attention to the health status of their Jincang database in the production environment , In case of any problem, give an alarm in time , help DBA Deal with hidden dangers with users as soon as possible , Nip in the bud .

The health guardian of the database ——KMonitor, Hold your post silently in silence , Ensure the healthy operation of the database , Protect the security of user data .

END