引用本文:张广朋,张冬明,张菁,王川宁,王立冬,邹学强.基于数据合成和度量学习的台标检测与识别.软件学报,2022,33(9):3180-3194
【打印本页】   【下载PDF全文】   查看/发表评论  【EndNote】   【RefMan】   【BibTex】
←前一篇|后一篇→ 过刊浏览    高级检索
本文已被:浏览 2118次   下载 5930 本文二维码信息
码上扫一扫!
分享到: 微信 更多
基于数据合成和度量学习的台标检测与识别
张广朋1, 张冬明2, 张菁1, 王川宁1, 王立冬3, 邹学强2
1.北京工业大学 信息学部, 北京 100124;2.国家计算机网络应急技术处理协调中心, 北京 100029;3.北京广播电视台, 北京 100022
摘要:
台标是视频的重要语义信息, 其检测与识别面临类别多、结构复杂、区域小、信息量低、背景干扰大等难题. 为提高模型的泛化能力, 提出将台标图像叠加到背景图像中合成台标数据, 来构建训练数据集. 进一步, 提出两阶段可伸缩台标检测与识别(scalable logo detection and recognition, SLDR)方法, 其采用batch-hard度量学习方法快速训练匹配模型, 确定台标类别. SLDR的检测与识别分离机制使得其可将检测目标扩展到未知类别. 实验结果表明, 合成数据可以有效提升模型的泛化能力和检测精度. 实验亦显示SLDR方法在不更新检测模型的情况下, 即可获得与端到端模型相当的精度.
关键词:  数据合成  度量学习  可伸缩  台标检测和识别
DOI:10.13328/j.cnki.jos.006619
分类号:TP391
基金项目:国家重点研发计划(2018YFB080402); 国家自然科学基金(61672495, 61971016); 北京市自然科学基金-市教委联合资助项目(KZ201910005007)
TV Logo Detection and Recognition Based on Data Synthesis and Metric Learning
ZHANG Guang-Peng1, ZHANG Dong-Ming2, ZHANG Jing1, WANG Chuan-Ning1, WANG Li-Dong3, ZOU Xue-Qiang2
1.Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China;2.National Computer Network Emergency Response Technical Team/Coordination Center of China, Beijing 100029, China;3.Beijing Radio & Television Station, Beijing 100022, China
Abstract:
A TV logo represents important semantic information of videos. However, its detection and recognition are faced with many problems, including varied categories, complex structures, limited areas, low information content, and severe background disturbance. To improve the generalization ability of the detection model, this study proposes synthesizing TV logo data to construct a training dataset by superimposing TV logo images on background images. Further, a two-stage scalable logo detection and recognition (SLDR) method is put forward, which uses the batch-hard metric learning method to rapidly train the matching model and determine the category of TV logos. In addition, the detection targets can be expanded to unknown categories due to the separation mechanism of detection and recognition in SLDR. The experimental results reveal that synthetic data can effectively improve the generalization ability and detection precision of models, and the SLDR method can achieve comparable precision with the end-to-end model without updating the detection model.
Key words:  data synthesis  metric learning  scalable  TV logo detection and recognition

引用本文:
【打印本页】   【下载PDF全文】   查看/发表评论  【EndNote】   【RefMan】   【BibTex】
←前一篇|后一篇→ 过刊浏览    高级检索
本文已被:浏览次   下载  
分享到: 微信 更多
摘要:
关键词:  
DOI:
分类号:
基金项目:
Abstract:
Key words: