检索结果-内蒙古大学图书馆

Debiased Video-Text Retrieval via Soft positive Sample Calibration

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 2023年第9期33卷 5257-5270页

作者： Zhang, Huaiwen Yang, Yang Qi, Fan Qian, Shengsheng Xu, Changsheng Inner Mongolia Univ Coll Comp Sci Hohhot 010021 Peoples R China Natl & Local Joint Engn Res Ctr Intelligent Inform Hohhot 010021 Peoples R China Inner Mongolia Key Lab Mongolian Informat Proc Tec Hohhot 010021 Peoples R China Tianjin Univ Technol Sch Comp Sci & Engn Tianjin 300384 Peoples R China Chinese Acad Sci Inst Automat Natl Lab Pattern Recognit Beijing 100190 Peoples R China Univ Chinese Acad Sci Sch Artificial Intelligence Beijing 100049 Peoples R China

With the emergence of enormous videos on various video apps, semantic video-text retrieval has become a critical task for improving the user experience. The primary paradigm for video-text retrieval learns the semantic video-text representations in a common space by pulling the positive samples close to the query and pushing the negative samples away. However, in practice, the video-text datasets contain only the annotations of positive samples. The negative samples are randomly drawn from the entire dataset. There may exist soft positive samples, which are sampled as negatives but share the same semantics as positive samples. Indiscriminately enforcing the model to push all the negative samples away from the query leads to inaccurate supervision and then misleads the video-text feature representation learning. In this paper, we introduce debiased video-text retrieval objectives that calibrate the punishment of soft positive samples. In particular, we propose a novel uncertainty measure framework to estimate the credibility of negative samples for each instance. Then, the reliability of negative samples is used to find the soft positive samples and rescale their contribution within video-text retrieval losses, including triplet loss and contrastive loss. Experimental results on five widely used datasets demonstrate that our debiased video-text retrieval objectives achieve significant performance improvements and establish a new state-of-the-art.

关键词： debias soft positive samples

来源：评论

学校读者我要写书评

暂无评论

Robust Video-Text Retrieval Via Noisy pair Calibration

引用

IEEE TRANSACTIONS ON MULTIMEDIA 2023年 25卷 8632-8645页

作者： Zhang, Huaiwen Yang, Yang Qi, Fan Qian, Shengsheng Xu, Changsheng Inner Mongolia Univ Coll Comp Sci Mongolia 010031 Peoples R China Natl & Local Joint Engn Res Ctr Intelligent Inform Mongolia 010031 Peoples R China Inner Mongolia Key Lab Mongolian Informat Proc Tec Hohhot 010021 Peoples R China Tianjin Univ Technol Sch Comp Sci & Engn Tianjin 300384 Peoples R China Chinese Acad Sci Inst Automat Natl Lab Pattern Recognit Beijing 100190 Peoples R China Univ Chinese Acad Sci Sch Artificial Intelligence Beijing 100049 Peoples R China

Video-text retrieval is a fundamental task in managing the emerging massive amounts of video data. The main challenge focuses on learning a common representation space for videos and queries where the similarity measurement can reflect the semantic closeness. However, existing video-text retrieval models may suffer from the following noise in the common space learning procedure: First, the video-text correspondences in positive pairs may not be exact matches. The crowdsourcing annotation for existing datasets leads to inevitable tagging noise for non-expert annotators. Second, the learning of video-text representation is based on the negative samples randomly sampled. Instances that are semantically similar to the query may be incorrectly categorized as negative samples. To alleviate the adverse impact of these noisy pairs, we propose a novel robust video-text retrieval method that protects the model from noisy positive and negative pairs by identifying and calibrating noisy pairs with their uncertainty score. In particular, we propose a noisy pair identifier, which divides the training dataset into noisy and clean subsets based on the estimated uncertainty of each pair. Then, with the help of uncertainties, we calibrate the two types of noisy pairs with an adaptive margin triplet loss and a weighted triplet loss function, respectively. To verify the effectiveness of our methods, we conduct extensive experiments on three widely used datasets. Experimental results show that the proposed robust video-text retrieval methods successfully identify and calibrate the noisy pairs and improve retrieval performance.

关键词： Noise calibration uncertainty video text retrieval

来源：评论

学校读者我要写书评

暂无评论

Optimal Design of Thermal Cycling Reliability for plastic Ball Grid Array Assembly Via Finite Element Method and Taguchi Method

引用

JOURNAL OF ELECTRONIC pACKAGING 2024年第1期146卷 011009-011009页

作者： Gao, Chao Huang, Chunyue Ying, Liang Guilin Univ Elect Technol Sch Mech & Elect Engn 1 Jinji Rd Guilin 541004 Peoples R China Chengdu Univ Inst Higher Educ Sichuan Prov Key Lab Pattern Recognit & Intelligent Informat Pr 2025 Chengluo Ave Chengdu 610106 Peoples R China

A finite element simulation analysis model was developed for a plastic ball grid array (pBGA) assembly to analyze its behavior under thermal cyclic loading conditions. The stress distribution in the SAC305 solder joints at different locations within the array was investigated by using ANAND constitutive equations. Subsequently, the thermal fatigue life of the key solder joints was quantified. The study also examined the influence of the solder joint diameter, substrate thickness, solder joint height, printed circuit board (pCB) thickness, and mold compound height on solder joint stress. Optimization of assembly parameters was achieved through the application of the Taguchi method. An extensive analysis was conducted using different assembly parameter combinations, employing the L9(34) orthogonal array design to explore the thermal cycling effects. The computed average Von Mises stress Delta sigma for the critical thin-layer elements of solder joints located in hazardous positions within the assembly was notably affected by variations in the solder joint height, substrate thickness, solder joint diameter, and mold compound height. This impact ranked in descending order of significance as solder joint height, substrate thickness, solder joint diameter, and mold compound height. The optimal parameter combination determined was a solder joint height of 0.70 mm, a solder joint diameter of 0.85 mm, a substrate thickness of 0.51 mm, and a mold compound height of 1.12 mm. Implementing this optimized configuration led to a significant 4.07% reduction in average stress Delta sigma for the critical thin-layer elements within hazardous solder joints. Moreover, the extension of the thermal fatigue life was notably improved, achieving an impressive 51.72% increase.

关键词： pBGA assembly ANAND thermal cyclic Taguchi method optimization

来源：评论

学校读者我要写书评

暂无评论

Double Rabi splitting in methylene blue dye-Ag nanocavity

引用

NANOpHOTONICS 2022年第3期11卷 603-611页

作者： Han, Xiaobo Li, Fang He, Zhicong Liu, Yahui Hu, Huatian Wang, Kai Lu, peixiang Wuhan Inst Technol Hubei Key Lab Opt Informat & Pattern Recognit Wuhan 430205 Peoples R China Wuhan Inst Technol Sch Opt Informat & Energy Engn Sch Mech & Elect Engn Wuhan 430205 Peoples R China Huazhong Univ Sci & Technol Wuhan Natl Lab Optoelect Wuhan 430074 Peoples R China Huazhong Univ Sci & Technol Sch Phys Wuhan 430074 Peoples R China Guangdong Intelligent Robot Inst Dongguan 523808 Peoples R China

We demonstrate a double Rabi splitting totaling 348 meV in an Ag nanocavity embedding of methylene blue (MB) dye layer, which is ascribed to the equilibrium state of monomer and dimer coexistence in MB dye. At low dye concentration, the single-mode strong coupling between the monomer exciton in MB dye and the Ag nanocavity is observed. As the dye concentration is increased, three hybridized plexciton states are observed, indicating a double Rabi splitting (178 and 170 meV). Furthermore, the double anti-crossing behavior of the three hybrid states is observed by tuning the Ag nanocube size, which validates the multi-mode strong coupling regime. It shows clear evidence on the diverse exciton forms of dye molecules, both of which can interact with plasmonic nanocavity, effectively. Therefore, it provides a good candidate for realizing the multi-mode strong coupling.

关键词： dimer exciton double Rabi splitting methylene blue plasmonic nanocavity strong coupling

来源：评论

学校读者我要写书评

暂无评论

Bridging Text and Video: A Universal Multimodal Transformer for Audio-Visual Scene-Aware Dialog

引用

IEEE-ACM TRANSACTIONS ON AUDIO SpEECH AND LANGUAGE pROCESSING 2021年 29卷 2476-2483页

作者： Li, Zekang Li, Zongjia Zhang, Jinchao Feng, Yang Zhou, Jie Chinese Acad Sci Inst Comp Technol Key Lab Intelligent Informat Proc Beijing 100190 Peoples R China Peking Univ Sch EECS Beijing 100080 Peoples R China Tencent Inc WeChat AI Pattern Recognit Ctr Beijing 100080 Peoples R China

Audio-Visual Scene-Aware Dialog (AVSD) is a task to generate responses when chatting about a given video, which is organized as a track of the 8th Dialog System Technology Challenge (DSTC8). There are two challenges in this task: 1) making effective interaction among different modalities;2) better understanding dialogues and generating informative responses. To tackle the challenges, we propose a universal multimodal transformer and introduce the multi-task learning method to learn joint representations among different modalities as well as generate informative and fluent responses by leveraging the pre-trained language model. Our method extends the natural language generation pre-trained model to multimodal dialogue generation task, which allows fine-tuning language models to capture information across both visual and textual modalities. Our system achieves the best performance in the objective evaluation in both DSTC7-AVSD and DSTC8-AVSD dataset and achieves an impressive 98.4% of the human performance based on human ratings in the DSTC8-AVSD challenge.

关键词： Task analysis Feature extraction Visualization Speech processing History Social networking (online) pattern recognition Dialogue System Multimodal Natural Language processing Video Understanding

来源：评论

学校读者我要写书评

暂无评论

The optical soliton solutions of nonlinear Schr?dinger equation with quintic non-Kerr nonlinear term

引用

RESULTS IN pHYSICS 2023年 48卷

作者： Zhang, Kun Han, Tianyong Chengdu Univ Coll Comp Sci Chengdu 610106 Peoples R China Chengdu Univ Inst Higher Educ Sichuan Prov Key Lab Pattern Recognit & Intelligent Informat Pr Chengdu 610106 Peoples R China

The purpose of this paper is to study the optical soliton solutions of nonlinear Schrodinger equation with quintic non-Kerr nonlinear term describing the nonlinear wave state of optical solitons, which is a noteworthy and important model in optical fiber communication. By using the polynomial complete discrimination system, the various optical soliton solutions of the nonlinear Schrodinger equation are obtained including the trigonometric function solution, the hyperbolic function solution and the Jacobian elliptic function solution. Finally, the graphs of some obtained solutions are drawn by setting values to the parameters.

关键词： Nonlinear Schr?dinger equation Optical soliton solution Complete discrimination system Quintic non-Kerr nonlinear term

来源：评论

学校读者我要写书评

暂无评论

New traveling wave solutions and dynamic behavior analysis of the nonlinear Rangwala-Rao model

引用

RESULTS IN pHYSICS 2023年 54卷

作者： peng, Chen Li, Zhao Chengdu Univ Coll Comp Sci Chengdu 610106 Peoples R China Chengdu Univ Inst Higher Educ Sichuan Prov Key Lab Pattern Recognit & Intelligent Informat Pr Chengdu 610106 Peoples R China

This work investigates the nonlinear Rangwala-Rao equation, which stems from the mixed derivative nonlinear Schrodinger equation. For retrieving new exact solutions to the equation, the complete discriminant system for polynomial method is employed. In results, some novel traveling wave solutions, including solitary wave solutions, triangular function solutions, periodic solutions and Jacobi elliptic function solutions are obtained and demonstrated through numerical simulations. The bifurcations of phase velocity fields are depicted to reveal the dynamic behavior of the Rangwala-Rao equation using the qualitative theory of dynamical systems. Furthermore, considering external perturbation, the chaotic motions of the perturbed Rangwala-Rao equation are investigated.

关键词： Rangwala-Rao equation Traveling wave solutions Complete discriminant system for polynomial method Qualitative analysis Bifurcation

来源：评论

学校读者我要写书评

暂无评论

Accurate Registration of Cross-Modality Geometry via Consistent Clustering

引用

IEEE TRANSACTIONS ON VISUALIZATION AND COMpUTER GRApHICS 2024年第7期30卷 4055-4067页

作者： Zhao, Mingyang Huang, Xiaoshui Jiang, Jingen Mou, Luntian Yan, Dong-Ming Ma, Lei Chinese Acad Sci Beijing Acad Artificial Intelligence Inst Automat Beijing 100045 Peoples R China Chinese Acad Sci Inst Automat Natl Lab Pattern Recognit Beijing 100045 Peoples R China Shanghai AI Lab Shanghai 200433 Peoples R China Chinese Acad Sci State Key Lab Multimodal Artificial Intelligence Inst Automat Beijing 100045 Peoples R China Univ Chinese Acad Sci Sch AI Beijing 101408 Peoples R China Beijing Univ Technol Beijing Inst Artificial Intelligence Beijing Key Lab Multimedia & Intelligent Software Beijing 100021 Peoples R China Peking Univ Natl Biomed Imaging Ctr Beijing 100871 Peoples R China Peking Univ Sch Comp Sci Beijing Acad Artificial Intelligence Beijing 100871 Peoples R China Peking Univ Sch Comp Sci Natl Key Lab Multimedia Informat Proc Beijing 100871 Peoples R China

The registration of unitary-modality geometric data has been successfully explored over past decades. However, existing approaches typically struggle to handle cross-modality data due to the intrinsic difference between different models. To address this problem, in this article, we formulate the cross-modality registration problem as a consistent clustering process. First, we study the structure similarity between different modalities based on an adaptive fuzzy shape clustering, from which a coarse alignment is successfully operated. Then, we optimize the result using fuzzy clustering consistently, in which the source and target models are formulated as clustering memberships and centroids, respectively. This optimization casts new insight into point set registration, and substantially improves the robustness against outliers. Additionally, we investigate the effect of fuzzier in fuzzy clustering on the cross-modality registration problem, from which we theoretically prove that the classical Iterative Closest point (ICp) algorithm is a special case of our newly defined objective function. Comprehensive experiments and analysis are conducted on both synthetic and real-world cross-modality datasets. Qualitative and quantitative results demonstrate that our method outperforms state-of-the-art approaches with higher accuracy and robustness. Our code is publicly available at https://***/zikai1/CrossModReg.

关键词： point cloud compression Geometry Three-dimensional displays Laser radar Tensors Clustering algorithms Solid modeling Cross-modality geometry point cloud registration 3D reconstruction adaptive fuzzy clustering CAD

来源：评论

学校读者我要写书评

暂无评论

Chaotic pattern, phase portrait, sensitivity and optical soliton solutions of coupled conformable fractional Fokas-Lenells equation with spatio-temporal dispersion in birefringent fibers

引用

RESULTS IN pHYSICS 2023年 47卷

作者： Li, Zhao Fan, Wenjie Miao, Fang Chengdu Univ Coll Comp Sci Chengdu 610106 Peoples R China Chengdu Univ Inst Higher Educ Sichuan Prov Key Lab Pattern Recognit & Intelligent Informat Pr Chengdu 610106 Peoples R China

In this paper, coupled conformable fractional Fokas-Lenells equation with spatio-temporal dispersion is introduced, which is usually used to simulate the propagation model of pulses' temporal evolution in birefringent fibers. Firstly, the traveling wave transformation is applied to convert the conformable time-space fractional Fokas-Lenells model into two-dimensional planar dynamic system. Secondly, the qualitative analysis of the coupled conformable fractional Fokas-Lenells equation with spatio-temporal dispersion is discussed by using the plane dynamics system. Moreover, two-dimensional phase portraits, three-dimensional phase portraits, poincare sections and sensitivity analysis of its perturbed system are drawn by using the Maple mathematical software. Finally, the optical soliton solutions of the coupled conformable fractional Fokas-Lenells equation with spatio-temporal dispersion are obtained by using planar dynamical system method.

关键词： Fokas-Lenells poincar? sections planar dynamic system Chaotic

来源：评论

学校读者我要写书评

暂无评论

Dynamic effects on traveling wave solutions of the space-fractional long-short-wave interaction system with multiplicative white noise

引用

RESULTS IN pHYSICS 2023年 53卷

In this paper, the stochastic space-fractional long-short-wave interaction system (SF-LSWIS) with multiplicative white noise is considered. The stochastic exact solutions, including triangular function solutions, hyperbolic function solutions, and Jacobi elliptic function solutions, are obtained via the complete discriminant system for polynomial method. For this purpose, the traveling wave transformation is applied to carry out the ordinary differential equation of this model, which is also converted to a dynamical system. Thereafter, qualitative behavior and bifurcation of the phase portraits of the dynamical system are investigated using the qualitative theory of dynamical systems. The chaotic behaviors of the system considering external periodic perturbation are studied. Furthermore, the 3D surface, graphs of contour plots, and level curves of some exact solutions are depicted by choosing proper parameter values. The influence and effect of fractional derivatives and noise strength on the solutions are also studied.

关键词： Traveling wave solution Bifurcation Stochastic fractional long-short-wave interaction equations Conformable fractional derivative Complete discriminant system for polynomial method

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：