检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Hsu, HsiaoYuan He, Xiangteng Peng, Yuxin Kong, Hao Zhang, Qing Wangxuan Institute of Computer Technology Peking University China National Key Laboratory forMultimedia Information Processing School of Computer Science Peking University China Meituan China

Content-aware visual-textual presentation layout aims at arranging spatial space on the given canvas for pre-defined elements, including text, logo, and underlay, which is a key to automatic template-free creative graphic design. In practical applications, e.g., poster designs, the canvas is originally non-empty, and both inter-element relationships as well as inter-layer relationships should be concerned when generating a proper layout. A few recent works deal with them simultaneously, but they still suffer from poor graphic performance, such as a lack of layout variety or spatial non-alignment. Since content-aware visual-textual presentation layout is a novel task, we first construct a new dataset named PKU PosterLayout, which consists of 9,974 poster-layout pairs and 905 images, i.e., non-empty canvases. It is more challenging and useful for greater layout variety, domain diversity, and content diversity. Then, we propose design sequence formation (DSF) that reorganizes elements in layouts to imitate the design processes of human designers, and a novel CNN-LSTM-based conditional generative adversarial network (GAN) is presented to generate proper layouts. Specifically, the discriminator is design-sequence-aware and will supervise the"design" process of the generator. Experimental results verify the usefulness of the new benchmark and the effectiveness of the proposed approach, which achieves the best performance by generating suitable layouts for diverse canvases. The dataset and the source code are available at https://***/PKU-ICSTMIPL/PosterLayout-CVPR2023. Copyright © 2023, The Authors. All rights reserved.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

Suppress content shift: better diffusion features via off-the-shelf generation techniques 24

Suppress content shift: better diffusion features via off-th...

引用

Proceedings of the 38th International Conference on Neural information processing Systems

作者： Benyuan Meng Qianqian Xu Zitai Wang Zhiyong Yang Xiaochun Cao Qingming Huang Institute of Information Engineering CAS and School of Cyber Security University of Chinese Academy of Sciences Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS and Peng Cheng Laboratory Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS School of Computer Science and Tech. University of Chinese Academy of Sciences School of Cyber Science and Tech. Shenzhen Campus of Sun Yat-sen University School of Computer Science and Tech. University of Chinese Academy of Sciences and Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS and Key Laboratory of Big Data Mining and Knowledge Management CAS

ISBN: (纸本)9798331314385

Diffusion models are powerful generative models, and this capability can also be applied to discrimination. The inner activations of a pre-trained diffusion model can serve as features for discriminative tasks, namely, diffusion feature. We discover that diffusion feature has been hindered by a hidden yet universal phenomenon that we call content shift. To be specific, there are content differences between features and the input image, such as the exact shape of a certain object. We locate the cause of content shift as one inherent characteristic of diffusion models, which suggests the broad existence of this phenomenon in diffusion feature. Further empirical study also indicates that its negative impact is not negligible even when content shift is not visually perceivable. Hence, we propose to suppress content shift to enhance the overall quality of diffusion features. Specifically, content shift is related to the information drift during the process of recovering an image from the noisy input, pointing out the possibility of turning off-the-shelf generation techniques into tools for content shift suppression. We further propose a practical guideline named GATE to efficiently evaluate the potential benefit of a technique and provide an implementation of our methodology. Despite the simplicity, the proposed approach has achieved superior results on various tasks and datasets, validating its potential as a generic booster for diffusion features. Our code is available at https://***/Darkbblue/diffusion-content-shift.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Domain Adversarial Interaction Network for Cross-Domain Fault Diagnosis 4th

Domain Adversarial Interaction Network for Cross-Domain Fau...

引用

4th International Conference on Machine Learning for Cyber Security, ML4CS 2022

作者： Lu, Weikai Chen, Jian Zheng, Hao Fan, Haoyi Wei, Eng Yee Cao, Xinrong Zhang, Deyang School of Electronic Electrical Engineering and Physics Fujian University of Technology Fuzhou350118 China Fujian Provincial Key Laboratory of Information Processing and Intelligent Control College of Computer and Control Engineering Minjiang University Fuzhou350121 China School of Computer and Artificial Intelligence Zhengzhou University Zhengzhou450001 China School of Computer Sciences Universiti Sains Malaysia Penang11800 Malaysia Henan Provincial Institute of Scientific and Technical Information Zhengzhou450003 China

ISBN: (纸本)9783031200984

Intelligent fault diagnosis has been widely used in the industry and plays a crucial role in the health management of machinery. In recent years, unsupervised domain adaptation (UDA) has been applied to fault diagnosis, showing excellent performance under variable working conditions. However, most existing UDA-based methods do not consider the temporal relations in the fault signal, resulting in sub-optimal performance. In this paper, we proposed a domain adversarial interaction network (DAIN) to solve this problem. By downsampling sub-sequences of fault signals and interacting with their features, DAIN can obtain feature representations containing the temporal relations. In addition, domain adversarial learning and maximum mean discrepancy (MMD) are applied to DAIN to align the domain discrepancy and distribution discrepancy of source and target domains. We conducted extensive experiments on the public Paderborn University (PU) dataset, and the results demonstrate that the proposed method can achieve higher cross-domain fault diagnosis accuracy than the existing methods. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Failure analysis

来源：评论

学校读者我要写书评

暂无评论

Inferring DTIs Based on Similarity Clustering and CaGCN-DTI Model from Heterogeneous Network

Inferring DTIs Based on Similarity Clustering and CaGCN-DTI ...

引用

2021 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2021

作者： Li, Aoxing Lin, Xiaoli Yu, Haiping Wuhan University of Science and Technology Hubei Key Laboratory of Intelligent Information Processing and Real-time Industrial System School of Computer Science and Technology Wuhan China Huanggang Normal University Hubei Key Laboratory of Intelligent Information Processing and Real-time Industrial System School of Computer Science Wuhan China

ISBN: (纸本)9781665401265

Although much progress has been made in new drug development, it is still a costly, complicated and less efficient process. Therefore, drug repositioning studies are highly desirable. So far, many methods based on known drug-target interactions (DTIs) have been designed to detect potential DTIs, but there are many challenges for improving the performance of prediction DTIs. This paper proposes a new method (CaGCN-DTI) for DTIs prediction, which uses a heterogeneous network that incorporates a wide variety of biological data (drug, target, disease, and side effect) to discover potential interactions between drugs and targets. First, the drug-protein similarity network is preprocessed by Spectral clustering, then the graph convolutional network (GCN) combined with attention mechanism and random walk with restart (RWR) is used to aggregate message transmission to the network. Finally, the embedding vectors are used to discover potential DTIs by matrix decomposition. Experiments are performed based on ten-fold cross-validation, and the results show that CaGCN-DTI outperforms other previous methods in terms of AUC and AUPR. © 2021 IEEE.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

HCU-Net: An Efficient Fully Convolutional Neural Network for Thyroid Nodules Ultrasound Image Segmentation

HCU-Net: An Efficient Fully Convolutional Neural Network for...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Mengxi Ren Jun Liu School of Computer Science and Technology Wuhan University of Science and Technology Wuhan China Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System Wuhan University of Science and Technology Wuhan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

Thyroid nodules, which can manifest as solitary or multiple growths, are among the most prevalent diseases with a high incidence rate. When examining thyroid nodules, ultrasound is typically the first step. Ultrasound image segmentation of thyroid nodules can assist physicians in diagnosis. However, the following three factors limit the development of thyroid nodule segmentation: (1) most of the existing studies optimize the segmentation of single nodules, and the incidence of multiple nodules is higher, so the segmentation of multiple nodules is also very important; (2) the ultrasound image of thyroid nodules is difficult to segment because of its low resolution and fuzzy boundary; (3) Due to the small data set of thyroid nodule ultrasound, in such a small dataset, attention mechanisms may be prone to overfitting, resulting in poorer generalization performance. Therefore, the attention-based model may not be suitable for the segmentation of thyroid nodules. Hence, we propose Hybrid Convolutional U-Net (HCU-Net), a simple and strong fully convolutional neural network for the segmentation of single or multiple thyroid nodules. HCU-Net incorporates a large receptive field to ensure accurate and stable segmentation. Specifically, we design Hybrid Branch Block to enhance the network's feature extraction capability for single or multiple nodules in ultrasound images by integrating multi-scale features. Furthermore, we add Enhanced ConvNeXt Blocks to the U-Net's final layer, enabling the extraction of global contextual information for segmentation performance. The Experimental results show that our proposed method can effectively improve these issues on two publicly available datasets. In addition, compared to attention-based models, our network is simpler and more suitable for small datasets like ultrasound images.

关键词： Image segmentation Ultrasonic imaging Image resolution Medical services Feature extraction Convolutional neural networks Medical diagnostic imaging Thyroid Overfitting Diseases

来源：评论

学校读者我要写书评

暂无评论

HPC-Atlas:Computationally Constructing A Comprehensive Atlas of Human Protein Complexes

引用

Genomics, Proteomics & Bioinformatics 2023年第5期21卷 976-990页

作者： Yuliang Pan Ruiyi Li Wengen Li Liuzhenghao Lv Jihong Guan Shuigeng Zhou Department of Computer Science and Technology College of Electronic and Information EngineeringTongji UniversityShanghai 201804China Translational Medical Center for Stem Cell Therapy Shanghai East HospitalSchool of MedicineTongji UniversityShanghai 200120China Shanghai Key Laboratory of Intelligent Information Processing School of Computer ScienceFudan UniversityShanghai 200433China

A fundamental principle of biology is that proteins tend to form complexes to play important roles in the core functions of *** a complete understanding of human cellular functions,it is crucial to have a comprehensive atlas of human protein ***,we still lack such a comprehensive atlas of experimentally validated protein complexes,which prevents us from gaining a complete understanding of the compositions and functions of human protein complexes,as well as the underlying biological *** fill this gap,we built Human Protein Complexes Atlas(HPC-Atlas),as far as we know,the most accurate and comprehensive atlas of human protein complexes available to *** integrated two latest protein interaction networks,and developed a novel computational method to identify nearly 9000 protein complexes,including many previously uncharacterized *** with the existing methods,our method achieved outstanding performance on both testing and independent ***,with HPC-Atlas we identified 751 severe acute respiratory syndrome coronavirus 2(SARS-CoV-2)-affected human protein complexes,and 456 multifunctional proteins that contain many potential moonlighting *** results suggest that HPC-Atlas can serve as not only a computing framework to effectively identify biologically meaningful protein complexes by integrating multiple protein data sources,but also a valuable resource for exploring new biological *** HPCAtlas webserver is freely available at http://***/HPC-Atlas.

关键词： Human protein complex Protein interaction network SARS-CoV-2-affected complex Multifunctional protein Complex identification method

来源：评论

学校读者我要写书评

暂无评论

Balance Multi-Head Attention based on Software and Hardware Co-design 9

Balance Multi-Head Attention based on Software and Hardware ...

引用

9th IEEE International Conference on Cyber Security and Cloud Computing and 8th IEEE International Conference on Edge Computing and Scalable Cloud, CSCloud-EdgeCom 2022

作者： Xu, Dian Hu, Wei Liu, Fang Fan, Zimeng Shi, Qingsong Wuhan University of Science and Technology Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System College of Computer Science Wuhan China Wuhan University Department of Information Engineering Wuhan Institute of City School of Computer Science Wuhan China Zhejiang University College of Computer Science Hangzhou China

ISBN: (数字)9781665480666

ISBN: (纸本)9781665480666

Recently, the Transformer-based models have achieved leading results in many research areas such as natural language processing and computer vision. However, since Transformer-based models have a huge computational complexities, optimization for Transformer is the focus of current research. the core of Transformer models is the attention module, and in this paper we propose a software and hardware co-designed attention module, which reduces the computational units of the multi-head attention module by balancing the The inference time of the attention module is reduced by balancing the computational units of multiple attention modules. At the same time, we design the corresponding structure on FPGA, which accelerate 14.6x inference time in comparison with the original attention module implementation on GPU. We applied this attention module to multiple visual Transformer models and tested the accuracy difference between the balanced multi-head attention module-based model and the original model on CIFAR-10, and obtained a result of 80.46%, which lower from the original version by 0.18%. © 2022 IEEE.

关键词： Field programmable gate arrays (FPGA)

来源：评论

学校读者我要写书评

暂无评论

NB-GTR: Narrow-Band Guided Turbulence Removal

NB-GTR: Narrow-Band Guided Turbulence Removal

引用

Conference on computer Vision and Pattern Recognition (CVPR)

作者： Yifei Xia Chu Zhou Chengxuan Zhu Minggui Teng Chao Xu Boxin Shi National Key Laboratory for Multimedia Information Processing School of Computer Science Peking University National Engineering Research Center of Visual Technology School of Computer Science Peking University National Key Lab of General AI School of Intelligence Science and Technology Peking University

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

The removal of atmospheric turbulence is crucial for long-distance imaging. Leveraging the stochastic nature of atmospheric turbulence, numerous algorithms have been developed that employ multi-frame input to mitigate the tur-bulence. However, when limited to a single frame, existing algorithms face substantial performance drops, partic-ularly in diverse real-world scenes. In this paper, we propose a robust solution to turbulence removal from an RGB image under the guidance of an additional narrow-band image, broadening the applicability of turbulence mitigation techniques in real-world imaging scenarios. Our approach exhibits a substantial suppression in the magnitude of tur-bulence artifacts by using only a pair of images, thereby enhancing the clarity and fidelity of the captured scene.

关键词： computer vision Prevention and mitigation Face recognition computer network reliability Imaging Reliability theory

来源：评论

学校读者我要写书评

暂无评论

Rethink Video Retrieval Representation for Video Captioning

SSRN

引用

SSRN 2024年

作者： Tian, Mingkai Li, Guorong Qi, Yuankai Wang, Shuhui Sheng, Quan Z. Huang, Qingming School of Computer Science and Technology Key Lab of Big Data Mining and Knowledge Management University of Chinese Academy of Sciences China School of Computing Macquarie University Australia Key Laboratory of Intelligent Information Processing Institute of Computer Technology Chinese Academy of Sciences China

Video captioning, a challenging task targeting the automatic generation of accurate and comprehensive descriptions based on video content, has witnessed substantial success recently driven by bridging video representations and textual semantics. Inspired by the nature of the video retrieval task, which learns visual features strongly related to text queries, we propose to take advantage of visual representation learning from the video retrieval framework to tackle video captioning tasks. However, a simple direct application of video retrieval models performs poorly due to the weak ability to capture sufficient video details and temporal information required for video captioning. To increase the attention on details, we propose a learnable token shift module, which flexibly captures subtle movements in local regions across the temporal sequence. Furthermore, we devise a Refineformer, which learns to integrate local video tokens strongly related to desired captions via a cross-attention mechanism. Extensive experiments on MSVD, MSR-VTT and VATEX demonstrate the favorable performance of our method. © 2024, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Embedded Feature Similarity Optimization with Specific Parameter Initialization for 2D/3D Medical Image Registration

Embedded Feature Similarity Optimization with Specific Param...

引用

International Conference on Acoustics, Speech, and Signal processing (ICASSP)

作者： Minheng Chen Zhirun Zhang Shuheng Gu Youyong Kong School of Computer Science and Engineering Southeast University China Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing School of Computer Science and Engineering Southeast University China Ministry of Education Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University) Nanjing China

We present a novel deep learning-based framework: Embedded Feature Similarity Optimization with Specific Parameter Initialization (SOPI) for 2D/3D medical image registration which is a most challenging problem due to the difficulty such as dimensional mismatch, heavy computation load and lack of golden evaluation standard. The framework we design includes a parameter specification module to efficiently choose initialization pose parameter and a fine-registration module to align images. The proposed framework takes extracting multi-scale features into consideration using a novel composite connection encoder with special training techniques. We compare the method with both learning-based methods and optimization-based methods on a in-house CT/X-ray dataset as well as simulated data to further evaluate performance. Our experiments demonstrate that the method in this paper has improved the registration performance, and thereby outperforms the existing methods in terms of accuracy and running time. We also show the potential of the proposed method as an initial pose estimator. The code is available at https://***/m1nhengChen/SOPI

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：