[metadata]linkedin datahub

Function Overview

DataHub Is a modern data catalog , Used to support end-to-end data discovery 、 Data observability and data governance . This extensible metadata platform is Build... For developers Of , The complexity of the data ecosystem used to control its rapid growth , And leverage the full value of data within their organization for data practitioners

framework

Datahub Components

Metadata ingestion architecture

Support push 、 Pull 、 Asynchronous and synchronous models

Service Architecture

  The main services are gms, It reveals a REST API And a GraphQL API, Used to execute on metadata CRUD operation . Metadata services also expose search and graphical queries API, To support secondary index style queries 、 Full text search query . Besides ,datahub-frontend The service exposes a on top of the metadata graph GraphQL API