检索结果-内蒙古大学图书馆

IEEE International Conference on Systems, Man and Cybernetics

作者： Qiyu Hong Zhenyi Chen Chen Dong Qiancheng Xiong College of Computer and Data Science Fuzhou University Fuzhou China Key Lab of Information Security of Network Systems Fuzhou University Fujian Key Laboratory of Network Computing and Intelligent Information Processing Fuzhou University University of South Florida Tampa United States

ISBN: (纸本)9781665442084

Industry 4.0 intends to realize mass individualization production driven by customers’ demands, thus generating several advanced manufacturing modes. However, the existing modes have disadvantages such as low customer participation, low response for modifications in real-time, and low utilization of distributed idle productivity resources. The above deficiencies would not cater to the idea of Industry 4.0 well, making the cost of individualization products too high or the degree of individualization too low. In this paper, a customer highly involved dynamic demand-driven smart manufacturing mode and a mathematical model are presented for mass individualization production. Under this mode, customers can be prosumers, participating in the whole production process and proposing modifications. Meanwhile, multiple distributed idle productivity resources are employed with dynamic demand-driven manufacturing. In consequence of the mathematical model and algorithms, the multiple task allocation among multiple factories problem is solved, maximizing the total profit of available factories with high efficiency and low resource waste. Experiments and comparisons are made about the feasibility and efficiency of the algorithms.

关键词： Productivity Heuristic algorithms Dynamic scheduling Real-time systems Production facilities Mathematical models Fourth Industrial Revolution

来源：评论

学校读者我要写书评

暂无评论

CoSign: Exploring Co-occurrence Signals in Skeleton-based Continuous Sign Language Recognition

CoSign: Exploring Co-occurrence Signals in Skeleton-based Co...

引用

International Conference on Computer Vision (ICCV)

作者： Peiqi Jiao Yuecong Min Yanan Li Xiaotao Wang Lei Lei Xilin Chen Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China University of Chinese Academy of Sciences Beijing China Xiaomi Inc. China

The co-occurrence signals (e.g., hand shape, facial expression, and lip pattern) play a critical role in Continuous Sign Language Recognition (CSLR). Compared to RGB data, skeleton data provide a more efficient and concise option, and lay a good foundation for the co-occurrence exploration in CSLR. However, skeleton data are often used as a tool to assist visual grounding and have not attracted sufficient attention. In this paper, we propose a simple yet effective GCN-based approach, named CoSign, to incorporate Co-occurrence Signals and explore the potential of skeleton data in CSLR. Specifically, we propose a group-specific GCN to better exploit the knowledge of each signal and a complementary regularization to prevent complex co-adaptation across signals. Furthermore, we propose a two-stream framework that gradually fuses both static and dynamic information in skeleton data. Experimental results on three public CSLR datasets (PHOENIX14, PHOENIX14-T and CSL-Daily) show that the proposed CoSign achieves competitive performance with recent video-based approaches while reducing the computation cost during training.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Improving Bert Fine-Tuning via Stabilizing Cross-Layer Mutual information

Improving Bert Fine-Tuning via Stabilizing Cross-Layer Mutua...

引用

International Conference on Acoustics, Speech, and Signal processing (ICASSP)

作者： Jicun Li Xingjian Li Tianyang Wang Shi Wang Yanan Cao Chengzhong Xu Dejing Dou Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences University of Chinese Academy of Sciences Big Data Lab Baidu Research State Key Lab of IOTSC University of Macau University of Alabama at Birmingham Institute of Information Engineering Chinese Academy of Sciences

Fine-tuning pre-trained language models, such as BERT, has shown enormous success among various NLP tasks. Though simple and effective, the process of fine-tuning has been found unstable, which often leads to unexpected poor performance. To increase stability and generalizability, most existing works resort to maintaining the parameters or representations of pre-trained models during fine-tuning. Nevertheless, very little work explores mining the reliable part of pre-learned information that can help to stabilize fine-tuning. To address this challenge, we introduce a novel solution in which we fine-tune BERT with stabilized cross-layer mutual information. Our method aims to preserve the reliable behaviors of cross-layer information propagation, instead of preserving the information itself, of the pre-trained model. Therefore, our method circumvents the domain conflicts between pre-trained and target tasks. We conduct extensive experiments with popular pre-trained BERT variants on NLP datasets, demonstrating the universal effectiveness and robustness of our method.

关键词： Cross layer design Bit error rate Signal processing Stability analysis Robustness Acoustics Behavioral sciences

来源：评论

学校读者我要写书评

暂无评论

TCTS: A Task-Consistent Two-Stage Framework for Person Search

TCTS: A Task-Consistent Two-Stage Framework for Person Searc...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Cheng Wang Bingpeng Ma Hong Chang Shiguang Shan Xilin Chen University of Chinese Academy of Sciences Beijing China Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China Peng Cheng Laboratory Shenzhen China

ISBN: (数字)9781728171685

ISBN: (纸本)9781728171692

The state of the art person search methods separate person search into detection and re-ID stages, but ignore the consistency between these two stages. The general person detector has no special attention on the query target; The re-ID model is trained on hand-drawn bounding boxes which are not available in person search. To address the consistency problem, we introduce a Task-Consist Two-Stage (TCTS) person search framework, includes an identity-guided query (IDGQ) detector and a Detection Results Adapted (DRA) re-ID model. In the detection stage, the IDGQ detector learns an auxiliary identity branch to compute query similarity scores for proposals. With consideration of the query similarity scores and foreground score, IDGQ produces query-like bounding boxes for the re-ID stage. In the re-ID stage, we predict identity labels of detected bounding boxes, and use these examples to construct a more practical mixed train set for the DRA model. Training on the mixed train set improves the robustness of the re-ID stage to inaccurate detection. We evaluate our method on two benchmark datasets, CUHK-SYSU and PRW. Our framework achieves 93.9% of mAP and 95.1% of rank1 accuracy on CUHK-SYSU, outperforming the previous state of the art methods.

关键词： Detectors Proposals Task analysis Adaptation models Feature extraction Search problems Training

来源：评论

学校读者我要写书评

暂无评论

SASA-Net: A spatial-aware self-attention mechanism for building protein 3D structure directly from inter-residue distances

SASA-Net: A spatial-aware self-attention mechanism for build...

引用

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Tiansu Gong Fusong Ju Shiwei Sun Dongbo Bu Chinese Academy of Sciences Key Lab of Intelligent Information Processing Institute of Computing Technology Beijing China University of Chinese Academy of Sciences Beijing China Zhongke Big Data Academy Zhengzhou Henan China

ISBN: (纸本)9781665429825

Protein structure prediction has achieved considerable progresses mainly due to the increased accuracy of inter-residue distance estimation and the application of deep learning *** of the distance-based ab initio prediction approaches adopt a two-step diagram: constructing a potential function based on the estimated inter-residue distances, and then build a 3D structure that minimizes the potential function. These approaches have proven very promising; however, they still suffer from several limitations, especially the inaccuracies incurred by the handcrafted potential ***, we present SASA-Net, a deep learning-based approach that directly learns protein 3D structure from the estimated inter-residue distances. Unlike the existing approach simply representing protein structures as coordinates of atoms, SASA-Net represents protein structures using pose of residues, i.e., the coordinate system of each individual residue in which all backbone atoms of this residue are fixed. The key element of SASA-Net is a spatial-aware self-attention mechanism, which is able to adjust a residue’s pose according to all other residues’ features and the estimated distances between residues. By iteratively applying the spatial-aware self-attention mechanism, SASA-Net continuously improves the structure and finally acquires a structure with high accuracy. Using the CATH35 proteins as representatives, we demonstrate that SASA-Net is able to accurately and efficiently build structures from the estimated inter-residue distances. The high accuracy and efficiency of SASA-Net enables an end-to-end neural network model for protein structure prediction through combining SASA-Net and an neural network for inter-residue distance prediction. Source code of SASA-Net is available at https://*** gongtiansu/SASA-Net/

关键词： Proteins Deep learning Protein engineering Solid modeling Three-dimensional displays Conferences Neural networks

来源：评论

学校读者我要写书评

暂无评论

KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigation

KERM: Knowledge Enhanced Reasoning for Vision-and-Language N...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Xiangyang Li Zihan Wang Jiahao Yang Yaowei Wang Shuqiang Jiang Key Lab of Intelligent Information Processing Laboratory of the Chinese Academy of Sciences (CAS) Institute of Computing Technology Beijing China University of Chinese Academy of Sciences Beijing China Peng Cheng Laboratory Shenzhen China

Vision-and-language navigation (VLN) is the task to enable an embodied agent to navigate to a remote location following the natural language instruction in real scenes. Most of the previous approaches utilize the entire features or object-centric features to represent navigable candidates. However, these representations are not efficient enough for an agent to perform actions to arrive the target location. As knowledge provides crucial information which is complementary to visible content, in this paper, we propose a Knowledge Enhanced Reasoning Model (KERM) to leverage knowledge to improve agent navigation ability. Specifically, we first retrieve facts (i.e., knowledge described by language descriptions) for the navigation views based on local regions from the constructed knowledge base. The re-trieved facts range from properties of a single object (e.g., color, shape) to relationships between objects (e.g., action, spatial position), providing crucial information for VLN. We further present the KERM which contains the purification, fact-aware interaction, and instruction-guided aggregation modules to integrate visual, history, instruction, and fact features. The proposed KERM can automatically select and gather crucial and relevant cues, obtaining more accurate action prediction. Experimental results on the REVERIE, R2R, and SOON datasets demonstrate the effectiveness of the proposed method. The source code is available at https://***/XiangyangLi20/KERM.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Learn over Past, Evolve for Future: Forecasting Temporal Trends for Fake News Detection

arXiv

引用

arXiv 2023年

作者： Hu, Beizhe Sheng, Qiang Cao, Juan Zhu, Yongchun Wang, Danding Wang, Zhengjia Jin, Zhiwei Key Lab of Intelligent Information Processing of Chinese Academy of Sciences Institute of Computing Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China ZhongKeRuijian Technology Co. Ltd China

Fake news detection has been a critical task for maintaining the health of the online news ecosystem. However, very few existing works consider the temporal shift issue caused by the rapidly-evolving nature of news data in practice, resulting in significant performance degradation when training on past data and testing on future data. In this paper, we observe that the appearances of news events on the same topic may display discernible patterns over time, and posit that such patterns can assist in selecting training instances that could make the model adapt better to future data. Specifically, we design an effective framework FTT (Forecasting Temporal Trends), which could forecast the temporal distribution patterns of news data and then guide the detector to fast adapt to future distribution. Experiments on the real-world temporally split dataset demonstrate the superiority of our proposed framework. The code is available at https://***/ICTMCG/FTTACL23. © 2023, CC BY-NC-SA.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Patch Is Not All You Need

arXiv

引用

arXiv 2023年

作者： Li, Changzhen Zhang, Jie Wei, Yang Ji, Zhilong Bai, Jinfeng Shan, Shiguang Key Lab of Intelligent Information Processing Chinese Academy of Sciences Institute of Computing Technology China University of Chinese Academy of Sciences China Hangzhou lnstitute for Advanced Study UCAS School of Intelligent Scienceand Technology China Tomorrow Advancing Life China

Vision Transformers have achieved great success in computer visions, delivering exceptional performance across various tasks. However, their inherent reliance on sequential input enforces the manual partitioning of images into patch sequences, which disrupts the image’s inherent structural and semantic continuity. To handle this, we propose a novel Pattern Transformer (Patternformer) to adaptively convert images to pattern sequences for Transformer input. Specifically, we employ the Convolutional Neural Network to extract various patterns from the input image, with each channel representing a unique pattern that is fed into the succeeding Transformer as a visual token. By enabling the network to optimize these patterns, each pattern concentrates on its local region of interest, thereby preserving its intrinsic structural and semantic information. Only employing the vanilla ResNet and Transformer, we have accomplished state-of-the-art performance on CIFAR-10 and CIFAR-100, and have achieved competitive results on ImageNet. Copyright © 2023, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Visual Alignment Constraint for Continuous Sign Language Recognition

Visual Alignment Constraint for Continuous Sign Language Rec...

引用

International Conference on Computer Vision (ICCV)

作者： Yuecong Min Aiming Hao Xiujuan Chai Xilin Chen Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China University of Chinese Academy of Sciences Beijing China Agricultural Information Institute Chinese Academy of Agricultural Sciences Beijing China

ISBN: (纸本)9781665428132

Vision-based Continuous Sign Language Recognition (CSLR) aims to recognize unsegmented signs from image streams. Overfitting is one of the most critical problems in CSLR training, and previous works show that the iterative training scheme can partially solve this problem while also costing more training time. In this study, we revisit the iterative training scheme in recent CSLR works and realize that sufficient training of the feature extractor is critical to solving the overfitting problem. Therefore, we propose a Visual Alignment Constraint (VAC) to enhance the feature extractor with alignment supervision. Specifically, the proposed VAC comprises two auxiliary losses: one focuses on visual features only, and the other enforces prediction alignment between the feature extractor and the alignment module. Moreover, we propose two metrics to reflect overfitting by measuring the prediction inconsistency between the feature extractor and the alignment module. Experimental results on two challenging CSLR datasets show that the proposed VAC makes CSLR networks end-to-end trainable and achieves competitive performance.

关键词： Training Measurement Visualization Image recognition Costing Gesture recognition Assistive technologies

来源：评论

学校读者我要写书评

暂无评论

Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration

arXiv

引用

arXiv 2024年

作者： Wen, Zhuofan Gui, Shangtong Feng, Yang Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences China State Key Lab of Processors Institute of Computing Technology Chinese Academy of Sciences China Key Laboratory of Al Safety Chinese Academy of Sciences China University of Chinese Academy of Sciences Beijing China

Inference acceleration of large language models (LLMs) has been put forward in many application scenarios and speculative decoding has shown its advantage in addressing inference acceleration. Speculative decoding usually introduces a draft model to assist the base LLM where the draft model produces drafts and the base LLM verifies the draft for acceptance or rejection. In this framework, the final inference speed is decided by the decoding speed of the draft model and the acceptance rate of the draft provided by the draft model. Currently the widely used draft models usually generate draft tokens for the next several positions in a non-autoregressive way without considering the correlations between draft tokens. Therefore, it has a high decoding speed but an unsatisfactory acceptance rate. In this paper, we focus on how to improve the performance of the draft model and aim to accelerate inference via a high acceptance rate. To this end, we propose a CTC-based draft model which strengthens the correlations between draft tokens during the draft phase, thereby generating higher-quality draft candidate sequences. Experiment results show that compared to strong baselines, the proposed method can achieve a higher acceptance rate and hence a faster inference speed. Copyright © 2024, The Authors. All rights reserved.

关键词： Decoding

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：