当前位置:网站首页>2020-08-15: under what circumstances should data tasks be optimized?
2020-08-15: under what circumstances should data tasks be optimized?
2020-11-06 21:55:00 【Fuda Dajia architect's daily question】
Fogo's answer 2020-08-16:
Know the answer
1. Data task execution is too slow , The speed can't meet the report requirement , For example, hourly reports , Execution time exceeded 1 Hour , The report task of the next hour came again .
2. Taking up too much resources , When you run this mission , The resources of the whole cluster have been consumed , Or eat a lot , Affect the normal online business , This requires optimization . It is generally considered to move out to other clusters first , Stop the impact on online business , Optimization after .
3. There's something wrong with the accuracy of the data analysis , For example, new types of online business fields have been added , For example, the original type The fields are only 1,2,3, Now a new one has been added 4,5,6, This leads to inaccurate data analysis , At this time, it is necessary to optimize the field types that may be extended in the future .
版权声明
本文为[Fuda Dajia architect's daily question]所创,转载请带上原文链接,感谢
边栏推荐
- Hdu3974 assign the task segment tree DFS order
- Road to simple HTML + JS to achieve the most simple game Tetris
- Python basic data type -- tuple analysis
- An article takes you to understand CSS gradient knowledge
- An article takes you to understand CSS pagination examples
- Git rebase is in trouble. What to do? Waiting line
- Method of code refactoring -- Analysis of method refactoring
- How to make characters move
- An article will take you to understand SVG gradient knowledge
- Stickinengine architecture 11 message queue
猜你喜欢
ES6 learning notes (5): easy to understand ES6's built-in extension objects
预留电池接口,内置充放电电路及电量计,迅为助力轻松搞定手持应用
Mongo user rights login instruction
ES6 learning notes (3): teach you to use js object-oriented thinking to realize the function of adding, deleting, modifying and checking tab column
2020 database technology conference helps technology upgrade
移动端像素适配方案
ORA-02292: 违反完整约束条件 (MIDBJDEV2.SYS_C0020757) - 已找到子记录
Flink's datasource Trilogy: direct API
Cloudquery v1.2.0 release
Big data processing black Technology: revealing the parallel computing technology of Pb level data warehouse gaussdb (DWS)
随机推荐
All the way, I was forced to talk about C code debugging skills and remote debugging
How about small and medium-sized enterprises choose shared office?
Qt音视频开发46-视频传输UDP版
Pn8162 20W PD fast charging chip, PD fast charging charger scheme
Summary of front-end performance optimization that every front-end engineer should understand:
The role of theme music in games
Zero basis to build a web search engine of its own
What the hell is fastthreadlocal? The existence of ThreadLocal!!
This project allows you to quickly learn about a programming language in a few minutes
Vue communication and cross component listening state Vue communication
2020-08-15:什么情况下数据任务需要优化?
统计项目代码行数
2020-08-29:进程线程的区别,除了包含关系之外的一些区别,底层详细信息?
The Interpreter pattern of behavior pattern
Contract trading system development | construction of smart contract trading platform
消防器材RFID固定资产管理系统
es创建新的索引库并拷贝旧的索引库 实践亲测有效!
Count the number of project code lines
List to map (split the list according to the key, and the value of the same key is a list)
Axios learning notes (2): easy to understand the use of XHR and how to package simple Axios