当前位置:网站首页>Learn spark computing framework in practice (00)
Learn spark computing framework in practice (00)
2022-06-29 10:29:00 【X.IO】
Spark Programming based :00. A preliminary understanding
Reference books : Xiamen University - Lin Ziyu -Spark Programming based
————————————————————
Prerequisite courses :( Current situation : understand )
1. Introduction to big data technology :《 Principle and application of big data technology 》
2. Principle of database system :( Understanding relational databases and SQL sentence )
3. Programming ability :( Understand the basics of object-oriented programming , Such as Java、C++)
————————————————————
《Spark Programming based 》 brief introduction :
With Scala As a development Spark The programming language of the application .
The whole book consists of 8 Chapter :
1. Overview of big data technology
2.Scala Language foundation
3.Spark Design and operation principle of
4.Spark Environment construction and use methods
5.RDD Programming
6.Spark SQL
7.Spark Streaming
8.Spark MLlib
————————————————————
Course experiment :
Experiment 1 :Linux System installation and common commands
Experiment two :Scala Basic programming practice
Experiment three :Spark and Hadoop Installation
Experiment four :RDD Basic programming practice
Experiment five :Spark SQL Basic programming practice
Experiment six :Spark Streaming Basic programming practice
Experiment seven :Spark Machine learning library MLlib Programming practice
Comprehensive experiment :
Case a : Data analysis and prediction of Taobao's double 11
Case 2 :Spark+Kafka Build real-time analytics Dashboard Case study
( Continuous updating 、 Improving ...)
边栏推荐
猜你喜欢

1146 Topological Order (25 分)

基辅周边的凄美废墟——切尔诺贝利的安全前往指南!

《CLR via C#》读书笔记-CLR寄宿与AppDomain

HDU 6778 car (group enumeration -- > shape pressure DP)

Nacos environmental isolation

QGIS mapping

MySQL innodb每行数据长度的限制

MySQL InnoDB data length limit per row

SeaweedFS安全配置(Security Configuration)

Related problems of pointer array, array pointer and parameter passing
随机推荐
To 3 --- 最后的编程挑战
1098 insertion or heap sort (25 points)
[51nod 1215] array width
2020-9-14 introduction to advertising system
攻防世界-Re-insfsay
L1-009 sum of N numbers (20 points)
两个栈的模拟题
F5 big IP Icontrol rest command execution (cve-2022-1388)
完全二叉树的权值 递归做法 ——最后的编程挑战
Win32Exception (0x80004005): 组策略阻止了这个程序。要获取详细信息,请与系统管理员联系。
C#中IEqualityComparer接口的实现
解决zxing的QR码包含中文时乱码的问题
C language library function --strstr()
Nacos registry cluster
Add/modify/drop column of alter table operation in MySQL
Ural1517 freedom of choice [suffix array: longest common continuous substring]
《CLR via C#》读书笔记-加载与AppDomain
Dsolve function of sympy
L2-031 深入虎穴 (25 分)
Related problems of pointer array, array pointer and parameter passing