当前位置:网站首页>2020-08-15: under what circumstances should data tasks be optimized?
2020-08-15: under what circumstances should data tasks be optimized?
2020-11-06 21:55:00 【Fuda Dajia architect's daily question】
Fogo's answer 2020-08-16:
Know the answer
1. Data task execution is too slow , The speed can't meet the report requirement , For example, hourly reports , Execution time exceeded 1 Hour , The report task of the next hour came again .
2. Taking up too much resources , When you run this mission , The resources of the whole cluster have been consumed , Or eat a lot , Affect the normal online business , This requires optimization . It is generally considered to move out to other clusters first , Stop the impact on online business , Optimization after .
3. There's something wrong with the accuracy of the data analysis , For example, new types of online business fields have been added , For example, the original type The fields are only 1,2,3, Now a new one has been added 4,5,6, This leads to inaccurate data analysis , At this time, it is necessary to optimize the field types that may be extended in the future .
版权声明
本文为[Fuda Dajia architect's daily question]所创,转载请带上原文链接,感谢
边栏推荐
- 非易失性MRAM存储器应用于各级高速缓存
- win7 APPCRASH(解决方法)(转)
- An article will introduce you to HTML tables and their main attributes
- STM32F030C6T6兼容替换MM32SPIN05PF
- #JVM 类加载机制
- Utility class functions (continuous update)
- Common mathematical basic formulas of recursive and backtracking algorithms
- Bitcoin once exceeded 14000 US dollars and is about to face the test of the US election
- Git rebase is in trouble. What to do? Waiting line
- DC-1 target
猜你喜欢

ES6 learning notes (3): teach you to use js object-oriented thinking to realize the function of adding, deleting, modifying and checking tab column

The 4th China BIM (digital construction) manager Summit Forum will be held in Hangzhou in 2020

JVM memory allocation - xms128m - xmx512m - XX: permsize = 128M - XX: maxpermsize = 512M

Interviewer: how about shardingsphere

谷歌浏览器实现视频播放加速功能

This project allows you to quickly learn about a programming language in a few minutes

STM32F030F4P6兼容灵动微MM32F031F4P6

Count the number of project code lines

GitHub: the foundation of the front end

With this artifact, quickly say goodbye to spam messages
随机推荐
2020-08-24:什么是小文件?很多小文件会有什么问题?很多小文件怎么解决?(大数据)
Big data processing black Technology: revealing the parallel computing technology of Pb level data warehouse gaussdb (DWS)
Pn8162 20W PD fast charging chip, PD fast charging charger scheme
Common syntax corresponding table of mongodb and SQL
Road to simple HTML + JS to achieve the most simple game Tetris
The essence of transaction and the principle of deadlock
Summary of front-end performance optimization that every front-end engineer should understand:
es创建新的索引库并拷贝旧的索引库 实践亲测有效!
2020-09-04:函数调用约定了解么?
list转换map(根据key来拆分list,相同key的value为一个list)
How to prepare for the system design interview
Es create a new index database and copy the old index library, practice pro test effective!
An article taught you to download cool dog music using Python web crawler
Detect certificate expiration script
Using iceberg on kubernetes to create a new generation of cloud original data Lake
Git rebase is in trouble. What to do? Waiting line
Using an example to understand the underlying processing mechanism of JS function
Interviewer: how about shardingsphere
Message queue - Analysis
Erd-online free online database modeling tool