当前位置：网站首页>The difference between groupByKey and reduceBykey

The difference between groupByKey and reduceBykey

2022-08-01 21:32:00 【xiexiexie0520】

What is the difference between groupByKey and reduceBykey?

groupByKey

groupByKey.png

reduceBykey

reduceBykey.png

Differences:

  • reduceByKey will perform pre-aggregation on the map side, which can reduce the amount of data transmitted during the shuffle process and improve execution efficiency. GroupByKey cannot be pre-aggregated
  • In some business scenarios, reduceByKey cannot be implemented, and groupByKey needs to be used
  • Use reduceBykey instead of groupByKey
原网站

版权声明
本文为[xiexiexie0520]所创，转载请带上原文链接，感谢
https://yzsam.com/2022/213/202208012121457621.html

边栏推荐

猜你喜欢

随机推荐