Fudan released its first review paper on the construction and application of multimodal knowledge atlas, comprehensively describing the existing mmkg technology system and progress

The article links ：https://arxiv.org/pdf/2202.05786.pdf

In recent years , Knowledge engineering, with the rapid growth of knowledge map, has sprung up again . However , Most of the existing knowledge maps are expressed by pure symbols , This undermines the machine's ability to understand the real world . The multimodality of knowledge map is an inevitable step to realize human-machine intelligence . The result of this effort is a multimodal knowledge map (MMKGs). In this study , We first give the definition of multimodal tasks composed of text and images , Then, the multimodal tasks and techniques are preliminarily discussed . then , We systematically reviewed MMKG Challenges in construction and Application 、 Progress and opportunities , The advantages and disadvantages of different solutions are analyzed in detail . We're going to talk to MMKG Relevant open research questions to complete this review .