当前位置:网站首页>海量数据TopN问题
海量数据TopN问题
2022-07-28 09:54:00 【Schuyler_yuan】
1. 在十万的数字中找出前100?
答:快排patition+二分,堆
2. 10亿的数字找前10万,空间给1亿?
答:(分治法加堆),时间复杂度klogk
3. 100亿数字找前10亿,空间1亿?
答:这个问题不是算法问题了,应该是在问工程上的实现,基本得靠切分到多台机器并行运算来解决,具体怎么做,看下那个64马找前四的问题。
总之,对于海量数据问题,都是用的“map-reduce”的思想来分而治之,分开局部处理,之后再汇总起来计算。
参考:
海量数据中的TOPK问题小结 - Excaliburer - 博客园
边栏推荐
- 并查集
- Skiasharp's WPF self drawn drag ball (case version)
- 判断字符串是不是回文
- 每天在岗不足8小时被辞?腾讯前员工追讨1300万加班费等,法院终审获赔9万
- What are the advantages of MRO purchasing website for industrial products? One article will help you understand
- 【学习笔记】border与period
- Tencent technical experts: decrypt the 100 million user products wechat, QQ, King glory... Comprehensively practice on the cloud!
- LIBCMTD.lib
- Have you ever seen this kind of dynamic programming -- the stock problem of state machine dynamic programming (Part 2)
- Flink - checkpoint Failure reason: Not all required tasks are currently running
猜你喜欢

Thinking and summary of technical personnel | R & D Efficiency

博弈论 1.Introduction(组合游戏基本概念、对抗搜索、Bash游戏、Nim游戏)

Read Plato farm's eplato and the reason for its high premium

pkg打包node工程

Espresso systems, which has just obtained financing, has both intellectual property rights and team ethics in trouble

二分、三分、01分数规划 【第I弹】
![[esp32][esp idf] esp32s3 quickly build lvglv7.9](/img/39/8efef047d0a9223b97819a54b5edf8.png)
[esp32][esp idf] esp32s3 quickly build lvglv7.9

我用小程序容器让移动研发效率提升了5倍!
![[ESP32][esp-idf] esp32s3快速搭建LVGLV7.9](/img/39/8efef047d0a9223b97819a54b5edf8.png)
[ESP32][esp-idf] esp32s3快速搭建LVGLV7.9

Digital construction of pharmaceutical industry is on the verge
随机推荐
Espresso systems, which has just obtained financing, has both intellectual property rights and team ethics in trouble
j s的数组方法,循环
PHP连接mysql原生代码
PHP 基础
Take you to wechat applet development in 3 minutes
关于软考高级要不要报班学习
Sizebasedtriggingpolicy introduction
Include and require include_ Once and require_ Once difference
二分、三分、01分数规划【第III弹】
基于ModelArts续写最伟大的作品【玩转华为云】
SQL Server、MySQL主从搭建,EF Core读写分离代码实现
OSPF expansion configuration, routing principles, anti ring and re release
ASP. Net core 6 framework unveiling example demonstration [29]: building a file server
JWT login authentication + token automatic renewal scheme, well written!
Plato farm - a farm meta universe game with Plato as the goal
LIBCMTD.lib
[esp32][esp idf] ap+sta realizes wireless bridging and transferring WiFi signals
(十)defer关键字
【MySQL】MySQL错误“ERROR 2006 (HY000):MySQL server has gone away”
OSPF的LSA及优化