Multi-Modal Knowledge Graph Construction and Application: A Survey

Recent years have witnessed the resurgence of knowledge engineering which is featured by fast growth graphs. However, most existing graphs are represented with pure symbols, hurts machine's capability to understand real world. The multi-modalization an inevitable key step towards realization human-level machine intelligence. results this endeavor Multi-modal Knowledge Graphs (MMKGs). In survey on MMKGs constructed texts and images, we first give definitions MMKGs, followed preliminaries multi-modal tasks techniques. We then systematically review challenges, progresses opportunities construction application respectively, detailed analyses strength weakness different solutions. finalize open research problems relevant MMKGs.