UDF and analysis case of sparksql, 220725,

 

 

 

 

 

 

 

 

mysql5 and 8, Different class names ,,,

 

 

 

 

Metastore Provide metadata interface , Provide... For external computing engines ,, share ,,

 

 

The cartesian product

 DSL：DataFrame

spark Temporary warehouse ,,

 

 

 

 

 

  Data decryption , Customized operation ,,

 

Have configuration metastore, Start... First meta, Restart hive,,

I haven't seen direct startup before hiveserver2 The situation of    Not necessarily Metastore, For sharing ,,

 

"null" , None

in total 13 position , In Milliseconds ,,

from_unixtime

 unix_timestamp

DataFrame

 

 

 

  Every time xxx, Need to group ,,,

sum() over(partition by Province ）

  Or province 、 Number of orders

Add orderby, To the current line ,,

 

 

 

  It must be opened first ThriftServer

 

 

 

 

 

 

 

 

 

 

 

 

 review,,

 

 

  Have time to review 2 After watching ：：：：