Sqlization is the first step in ETL incremental production. What are the core capabilities of such an architecture?

SQL Turn to be ETL The first step in incremental production , What are the core capabilities of such an architecture ？

---

Take the answer 1：

There are three core competencies , Namely ：

First of all , Flink Of SQL The ability to align Spark.

second , our Table Format This layer needs to be able to support Upsert/Delete Such a real-time operation of primary key update .

Third , our Table Format Can support full and incremental read .

Excerpt from above 《 Open source big data foresight and application practice 》 e-book , Click on https://developer.aliyun.com/topic/download?id=1153 The finished version can be downloaded

---