当前位置:网站首页>线上故障突突突?如何紧急诊断、排查与恢复
线上故障突突突?如何紧急诊断、排查与恢复
2022-07-05 01:24:00 【InfoQ】
概述
1 分钟发现
监控
告警
- 集成事件后管理更高效。
- 告警管理默认支持一键化集成阿里云常见的监控工具,并支持更多的监控工具手动接入,方便统一维护。
- 事件接入模块稳定,能提供 7x24 小时的无间断事件处理服务。
- 处理海量事件数据时可以保证低延时。
- 及时准确地将告警通知给联系人。
- 配置通知规则,对事件合并后再发送告警通知,减少运维人员出现通知疲劳的情况。
- 根据告警的紧急程度选择邮件、短信、电话、钉钉等不同的通知方式,来提醒联系人处理告警。
- 通过升级通知对长时间没有处理的告警进行多次提醒,保证告警及时解决。
- 帮助您快速便捷地管理告警。
- 联系人能通过钉钉随时处理告警。
- 使用通用告警格式,联系人能更好的分析告警。
- 多个联系人通过钉钉协同处理。
- 统计告警数据,实时分析处理情况,改进告警处理效率。
5 分钟定位故障
服务实例隔离与诊断
- 实践
Arthas 诊断
- JVM 概览
- 线程耗时分析
- 方法执行分析
- 对象查看器
- 实时看板
- 性能分析
10 分钟恢复
离群实例摘除
服务熔断与降级
流控、扩容、重启、回滚
- 流量控制:根据流量、并发线程数、响应时间等指标,把随机到来的流量调整成合适的形状,即流量塑形。通过流控能力,为服务接口配置流控规则,让容量范围内的请求通过,多余的请求被拒绝,相当于安全气囊的作用。层层防护,在 Nginx/Ingress 网关层进行粗粒度保护,在微服务层进行 API、接口、方法、参数粒度控制。避免应用被瞬时的流量高峰冲垮,从而保障应用的高可用性。
- 扩容:水平横向扩容提升集群可用性
- 重启:重新启动 JVM 进程,从而暂时消除长时间运行累积的问题如内存泄露等
- 回滚:消除变更引入的问题
基于同可用区优先的一键切流
尾
边栏推荐
- User login function: simple but difficult
- 无心剑英译席慕容《无怨的青春》
- Database postragesql client authentication
- Remote control service
- Delaying wages to force people to leave, and the layoffs of small Internet companies are a little too much!
- Implementation steps of master detail detail layout mode of SAP ui5 application
- Package What is the function of JSON file? What do the inside ^ angle brackets and ~ tilde mean?
- Compare whether two lists are equal
- Intel sapphire rapids SP Zhiqiang es processor cache memory split exposure
- Database postragesql client connection default
猜你喜欢
[untitled]
How to safely eat apples on the edge of a cliff? Deepmind & openai gives the answer of 3D security reinforcement learning
Armv8-a programming guide MMU (3)
Async/await you can use it, but do you know how to deal with errors?
Detailed explanation of multi-mode input event distribution mechanism
Daily question brushing record (13)
FEG founder rox:smartdefi will be the benchmark of the entire decentralized financial market
MySQL REGEXP:正则表达式查询
Wechat applet: new independent backstage Yuelao office one yuan dating blind box
ROS command line tool
随机推荐
Global and Chinese markets of radiation linear accelerators 2022-2028: Research Report on technology, participants, trends, market size and share
142. Circular linked list II
Introduction to the gtid mode of MySQL master-slave replication
Wechat applet: independent background with distribution function, Yuelao office blind box for making friends
潘多拉 IOT 开发板学习(RT-Thread)—— 实验4 蜂鸣器+马达实验【按键外部中断】(学习笔记)
The performance of major mainstream programming languages is PK, and the results are unexpected
Basic operations of database and table ----- delete index
Discrete mathematics: reasoning rules
How to use words to describe breaking change in Spartacus UI of SAP e-commerce cloud
BGP comprehensive experiment
Expansion operator: the family is so separated
19. Delete the penultimate node of the linked list
Wechat applet: new independent backstage Yuelao office one yuan dating blind box
Async/await you can use it, but do you know how to deal with errors?
Jcenter () cannot find Alibaba cloud proxy address
Introduction to the gtid mode of MySQL master-slave replication
Wechat applet: wechat applet source code download new community system optimized version support agent member system function super high income
node工程中package.json文件作用是什么?里面的^尖括号和~波浪号是什么意思?
SAP ui5 application development tutorial 107 - trial version of SAP ui5 overflow toolbar container control introduction
Roads and routes -- dfs+topsort+dijkstra+ mapping