当前位置:网站首页>海量数据TopN问题
海量数据TopN问题
2022-07-28 09:54:00 【Schuyler_yuan】
1. 在十万的数字中找出前100?
答:快排patition+二分,堆
2. 10亿的数字找前10万,空间给1亿?
答:(分治法加堆),时间复杂度klogk
3. 100亿数字找前10亿,空间1亿?
答:这个问题不是算法问题了,应该是在问工程上的实现,基本得靠切分到多台机器并行运算来解决,具体怎么做,看下那个64马找前四的问题。
总之,对于海量数据问题,都是用的“map-reduce”的思想来分而治之,分开局部处理,之后再汇总起来计算。
参考:
海量数据中的TOPK问题小结 - Excaliburer - 博客园
边栏推荐
- 我用小程序容器让移动研发效率提升了5倍!
- Status Notice ¶
- [learning notes] border and period
- [ESP32][esp-idf][LVGL7.9] 使用oled iic编译失败
- Edge team explains how to improve the comprehensive performance experience through disk cache compression technology
- PHP connection MySQL native code
- Xiao Hei stands up again and looks at leetcode:653. Sum of two IV - enter BST
- JWT login authentication + token automatic renewal scheme, well written!
- Cloudcompare & PCL matching point sampling consistency suppression
- [openharmony] [rk2206] build openharmony compiler (2)
猜你喜欢

LSA and optimization of OSPF

建筑建材行业B2B电子商务网站方案:赋能建材企业转型升级,实现降本提效

Installing MySQL for Linux operating system (centos7)

我用小程序容器让移动研发效率提升了5倍!
JWT 登录认证 + Token 自动续期方案,写得太好了!

Joint search set

高温天气筑牢安全生产防线,广州海珠区开展加油站应急演练
![[learning notes] border and period](/img/a4/5493f7eefc7dd0e38bc9a53a92b87b.png)
[learning notes] border and period
Edge team explains how to improve the comprehensive performance experience through disk cache compression technology

arthas使用教程
随机推荐
PHP Basics
腾讯技术专家:解密亿级用户产品 微信、QQ、王者荣耀...全面上云实践!
总线相关概念集合
Several innovative economic models of platofarm have inspired the current metacosmic market
Which strings will be resolved to null by fastjason?
PHP 常用的数组整理
3 minutes to tell you how to become a hacker | zero foundation to hacker getting started guide, you only need to master these five abilities
2021.07.13 我们是这样崩的
图解 3 种主流企业架构模式(建议收藏!)
(十)defer关键字
为报复公司解雇,我更改了项目的所有代码注释!
j s的数组方法,循环
Experiment 4 uses fdisk to manage hard disk
Illustrate three mainstream enterprise architecture models (recommended collection!)
7.27 minimum spanning tree phased test problem solution
Being on duty less than 8 hours a day and being dismissed? Tencent's former employees recovered 13million overtime pay, etc., and the court won a compensation of 90000 in the final judgment
19. 删除链表的倒数第 N 个结点
office2013以上输入数学公式
每天在岗不足8小时被辞?腾讯前员工追讨1300万加班费等,法院终审获赔9万
Redis interview questions must be known and learned