130 pages of PPT from the brick boss introduces the new features of Apache spark 3.2 & 3.3 in depth

this paper PPT The material comes from DATA + AI SUMMIT 2022 6 month 29 Day title is 《Data Deep Dive into the New Features of Apache Spark 3.2 and 3.3》 Shared full text PPT, about 130 page , Sharers come from several bricks Daniel Tenedorio、 Fanwenchen, Li Xiao and other big men . The video corresponding to this article will be uploaded later , Stay tuned Big data of past memory WeChat official account .

Apache Spark It has become to perform data engineering on a single node or cluster 、 The most widely used computing engine in data science and machine learning .Spark The month of maven The number of downloads has grown rapidly to 2000 Ten thousand times . Ben PPT Will discuss Spark 3.2 and 3.3 Advanced features and improvements in . And introduce the following functions in depth ：

• stay Apache Spark Up lead in pandas API To unify different data scales API;

• complete ANSI SQL Compatibility mode , simplify SQL Workload migration ;

• Adaptive query execution can be used in production environments to accelerate at run time Spark SQL;

• introduce RocksDB State storage , Make state processing more scalable .

About this article PPT Please add fangzhen0219  Wechat access to .