[azure data platform] ETL tool (8) - ADF dataset and link service

This paper belongs to 【Azure Data Platform】 series .
Continued above ：【Azure Data Platform】ETL Tools (7)——ADF copy data Detailed explanation
In this paper, ADF Data set of And link services

sketch

ADF It is mainly used to process data , Source and target of data processing . Based on the popularity of big data cloud computing era , Data sources and targets have been widely distributed around the world , It also includes cloud and local .
Mentioned earlier ,ADF It operates on a pipeline basis , While the pipeline is running , Can operate on data , Those “ data ” How to define ？ This involves data sets . Datasets define the output and input of data . Identify data from different data sources .
Before we talk about datasets , First, let's talk about link services （ Chinese version of ADF Call it a linked service , But I prefer to use link services （linked services））. It connects data storage to services , Link services are similar to connection strings . Defines the necessary information for external access to data . Datasets represent data structures in linked datastores , The link service defines the connection to the data source .

The most common cases are from Blob Copy data to SQL DB in , Then you need to create two link services （1 Created for Blob,1 Yes SQL DB）, Then two data sets （1 Definitions blob File format ,1 Definition Azure DB Data table in ）

The following figure shows the pipe 、 Activities 、 The relationship between datasets and linked services ：

New dataset

You can create datasets in different places ：

Because there are many kinds of data sets , Usually it will be faster to search .

When a specific data set is selected , According to its kind , There are other options , For example, I chose Blob Storage , The next step is to select the data format type in the storage ：

Then select or create a new link service ：

According to different choices , There will be further options available ：

After successful configuration , Can be used in subsequent sources and targets .