Academic Journal of Computing & Information Science, 2023, 6(8); doi: 10.25236/AJCIS.2023.060809.
Wanting Wang, Shishu Yin
School of Management Science and Engineering, Anhui University of Finance and Economics, Bengbu, 233000, Anhui, China
With the rapid development of the application of information technology in the medical field and the gradual improvement of medical information storage standards, medical data presents a multi-modal form while growing rapidly. For managing, organizing and analyzing multi-modal medical data effectively, this paper takes children's medical data as an example, and uses the computer vision processing technology to realize knowledge acquisition, knowledge extraction, entity linking, knowledge storage of multi-modal children's medical data. The structured and unstructured medical data are organized together to achieve the multi-modal children's medical information knowledge graph.
Multi-modality; Children's healthcare; Knowledge graph; Modeling; Evaluation
Wanting Wang, Shishu Yin. A Modeling Study of a Multi-modal Knowledge Graph of Children's Medical Information. Academic Journal of Computing & Information Science (2023), Vol. 6, Issue 8: 75-81. https://doi.org/10.25236/AJCIS.2023.060809.
[1] Wang Meng, Qi Guilin, Wang Haofen, et al. Richpedia: a compre-hensive multi-modal knowledge graph[C]//Proc of Joint International Semantic Technology Conference. Cham: Springer, 2019:130-145.
[2] Sun Rui, Cao Xuezhi, Zhao Yan, et al. Multi-modal knowledge graphsfor recommender systems[C]//Proc of the 29th ACM International Con-ference on Information & Knowledge Management. 2020:1405-1414.
[3] Li Xingyuan, Wang Peng, Shen Mu, etc. A Preliminary Study on the Construction of multi-modal Knowledge Graph for Epilepsy Related Papers[J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(04):19-24.DOI:10.13190/j.jbupt. 2021-187.
[4] A. Singhal, Introducing the knowledge graph: Things, not strings, May 2012. [Online]. Available from: http://googleblog.blogspot.com/2012/05/introducingknowledge-graph-things-not.html.
[5] Bollacker K, Evans C, Paritosh P, et al. Freebase: a collaboratively created graph database for structuring human knowledge[C]//27th ACM SIGMOD International Conference on Management of Data, 2008:1247-1250.
[6] Auer S, Bizer C, Kobilarov G, et al. Dbpedia: a nuc-leus for a web of open data[M]. Springer, Berlin, Heidel-Berg, 2007:722-735.
[7] Suchanek F M, Kasneci G, Weikum G. Yago: a core of semantic knowledge[C]//16th International Conference on World Wide Web (WWW), 2007:697-706.
[8] Chen Ye, Zhou Gang, Lu Jicang. A review of research on multi-modal knowledge graph construction and application[J]. Computer Application Research, 2021, 38(12):3535-3543. DOI:10.19734/j.issn. 1001-3695.2021.05.0156.
[9] Peng Jinghui, Wang Zhen, Li Yue, Hou Ping. Research on multi-modal knowledge graph technology in equipment field[J]. Journal of Ordnance Equipment Engineering, 2022, 43(11):136-140+153.
[10] Wen Y, Fan C, Chen G, et al. A survey on named entityrecognition. Proceedings of the 8th International Conferenceon Communications, Signal Processing, and Systems. Urumqi: Springer, 2019. 1803–1810.
[11] Li Huayu, Fu Yafeng, Yan Yang, et al. Construction of multi-modal domain knowledge graph based on LEBERT[J]. Computer System Applications, 2022, 31(11):79-90. DOI:10.15888/j.cnki.csa. 008799.
[12] Wei Xi, Zhang Tianzhu, Li Yan, et al. Multi-modality cross attentionnetwork for image and sentence matching[C]//Proc of IEEE/CVF Con-ference on Computer Vision and Pattern Recognition. 2020:10941-10950.