基于语义一致性约束的中草药数据关联标注算法
Chinese herbal medicine data association annotation algorithm based on semantic consistency constraint
投稿时间: 2022/8/20 0:00:00
DOI:
中文关键词: 语义一致性约束;注意力机制;图像标注
英文关键词: Semantic consistency constraint; attention mechanism; image annotation
基金项目: 揭榜挂帅重点研发课题(课题编号:2021YFF0901702)
姓名 单位
沈贵华 中国文物信息咨询中心
张炼 北京邮电大学人工智能学院
姜博 北京邮电大学人工智能学院
点击数:508 下载数:553
中文摘要:

中草药数据具有丰富的数字化资源,利用标注的方法对中草药的类别和功能进行分析是一种能够实现文化识别、文化解读、文化传承的科学技术方法。本文将研究内容聚焦于中草药领域的书籍图像数据,实现了对图文混排的中草药书籍数据的数字图文处理与关联标注。在本文中提出了基于语义一致性约束的中草药关联标注算法,针对中草药图片存在的类间差距较小,图像多形态等问题综合使用了特征提取模型,注意力机制等结构,并针对中草药数据的特点对经典标注模型结构进行优化,实现中草药图像的标注任务。

英文摘要:

Chinese herbal medicine data is rich in digital resources. Using annotation to analyze the categories and functions of Chinese herbal medicine is a scientific and technological method that can realize cultural identification, cultural interpretation and cultural inheritance. This paper focuses on the book image data in the field of Chinese herbal medicine, and realizes the digital image and text processing and associated annotation of the Chinese herbal medicine book data with mixed text and text. In this paper, a Chinese Herbal Medicine Association annotation algorithm based on semantic consistency constraint is proposed. Aiming at the problems of small gap between classes and multi morphology of images in Chinese herbal medicine images, the structure of feature extraction model and attention mechanism are comprehensively used. According to the characteristics of Chinese herbal medicine data, the structure of classical annotation model is optimized to realize the annotation task of Chinese herbal medicine images.

参考文献: