检索结果-内蒙古大学图书馆

CRD-CGAN:category-consistent and relativistic constraints for diverse text-to-image generation

Frontiers of computer science 2024年第1期18卷 61-75页

作者： Tao HU Chengjiang LONG Chunxia XIAO College of Intelligent Systems Science and Engineering Hubei Minzu UniversityEnshi 445000China School of Computer Science Wuhan UniversityWuhan 430072China Key Laboratory of Performing Art Equipment&System Technology Ministry of Culture and TourismBeijing 100007China Meta Reality Labs BurlingameCA94010USA

Generating photo-realistic images from a text description is a challenging problem in computer *** works have shown promising performance to generate synthetic images conditional on text by Generative Adversarial Networks(GANs).In this paper,we focus on the category-consistent and relativistic diverse constraints to optimize the diversity of synthetic *** on those constraints,a category-consistent and relativistic diverse conditional GAN(CRD-CGAN)is proposed to synthesize K photo-realistic images *** use the attention loss and diversity loss to improve the sensitivity of the GAN to word attention and ***,we employ the relativistic conditional loss to estimate the probability of relatively real or fake for synthetic images,which can improve the performance of basic conditional ***,we introduce a category-consistent loss to alleviate the over-category issues between K synthetic *** evaluate our approach using the Caltech-UCSD Birds-200-2011,Oxford 102 flower and MS COCO 2014 datasets,and the extensive experiments demonstrate superiority of the proposed method in comparison with state-of-the-art methods in terms of photorealistic and diversity of the generated synthetic images.

关键词： text-to-image diverse conditional GAN relativi-stic category-consistent

来源：评论

学校读者我要写书评

暂无评论

Towards Practical Facial Video-based Remote Heart Rate Estimation via Cross Domain rPPG Adaptation 23

Towards Practical Facial Video-based Remote Heart Rate Estim...

引用

Proceedings of the 2023 10th International Conference on Biomedical and Bioinformatics Engineering

作者： Ze Yang Haofei Wang Feng Lu Qinping Zhao the State Key Laboratory of Virtual Reality Technology and Systems and the School of Computer Science and Engineering at Beihang University China Peng Cheng Laboratory China the State Key Laboratory of Virtual Reality Technology and Systems and the School of Computer Science and Engineering at Beihang University China and Peng Cheng Laboratory China

ISBN: (纸本)9798400708343

Remote photoplethysmography (rPPG) is a non-contact technology that can estimate heart rate using facial video and holds significant potential for health monitoring. Despite the latest deep learning-based rPPG approaches can predict high-quality rPPG signal under similar scenarios, these methods often suffer from degraded performance when encountering variations in subjects, environments, or illumination conditions in target domains. To address this challenge, we propose an uncertainty-guided self-training approach that leverages model uncertainty and periodic priors to enhance generalization across different domains without requiring labels in the target domain. We iteratively update the model using pseudo-labels generated from its own predictions on unlabelled data in the target domain, with varying confidence levels informed by the model’s uncertainty estimation. To achieve this, we modify a standard Convolutional Neural Network (CNN) into a Bayesian Neural Network (BNN) for uncertainty estimation, which guides the assignment of pseudo-labels with varying confidence levels. By employing the adversarially learned periodic priors of rPPG signals shared across domains as regularization terms, we further stabilize the model adaptation process. We evaluate the proposed method on two public datasets (PURE and UBFC-rPPG) across five cross-domain tasks. Experimental results demonstrate improved performance over the baselines, with gains ranging from 60.5% to 97.2%, outperforming existing methods in generalization performance for rPPG-based heart rate measurement.

关键词： heart rate estimation remote photoplethysmography unsupervised domain adaptation

来源：评论

学校读者我要写书评

暂无评论

The Power of Age-based Reward in Fresh Information Acquisition 42

The Power of Age-based Reward in Fresh Information Acquisiti...

引用

42nd IEEE International Conference on computer Communications, INFOCOM 2023

作者： Wang, Zhiyuan Meng, Qingkai Zhang, Shan Luo, Hongbin Beihang University School of Computer Science and Engineering Beijing China Beihang University State Key Laboratory of Virtual Reality Technology and Systems China Beihang University Institute of Artificial Intelligence Beijing China State Key Laboratory of Software Development Environment China

ISBN: (纸本)9798350334142

Many Internet platforms collect fresh information of various points of interest (PoIs) relying on users who happen to be nearby the PoIs. The platform will offer reward to incentivize users and compensate their costs incurred from information acquisition. In practice, the user cost (and its distribution) is hidden to the platform, thus it is challenging to determine the optimal reward. In this paper, we investigate how the platform dynamically rewards the users, aiming to jointly reduce the age of information (AoI) and the operational expenditure (OpEx). Due to the hidden cost distribution, this is an online non-convex learning problem with partial feedback. To overcome the challenge, we first design an age-based rewarding scheme, which decouples the OpEx from the unknown cost distribution and enables the platform to accurately control its OpEx. We then take advantage of the age-based rewarding scheme and propose an exponentially discretizing and learning (EDAL) policy for platform operation. We prove that the EDAL policy performs asymptotically as well as the optimal decision (derived based on the cost distribution). Simulation results show that the age-based rewarding scheme protects the platform's OpEx from the influence of the user characteristics, and verify the asymptotic optimality of the EDAL policy. © 2023 IEEE.

关键词： Simulation platform

来源：评论

学校读者我要写书评

暂无评论

Color liquid crystal grating based color holographic 3D display system with large viewing angle

引用

Light(science & Applications) 2024年第1期13卷 103-112页

作者： Di Wang Yi-Long Li Fan Chu Nan-Nan Li Zhao-Song Li Sin-Doo Lee Zhong-Quan Nie Chao Liu Qiong-Hua Wang School of Instrumentation and Optoelectronic Engineering Beihang UniversityBeijing 100191China State Key Laboratory of Virtual Reality Technology and Systems Beihang UniversityBeijing 100191China Display Technology Research Center Seoul National UniversityGwanak-ro 1Gwanak-guSeoul 08826Republic of Korea Key Lab of Advanced Transducers and Intelligent Control System Ministry of EducationTaiyuan University of TechnologyTaiyuan 030024China

Holographic 3D display is highly desirable for numerous applications ranging from medical treatments to military ***,it is challenging to simultaneously achieve large viewing angle and high-fidelity color reconstruction due to the intractable constraints of existing ***,we conceptually propose and experimentally demonstrate a simple and feasible pathway of using a well-designed color liquid crystal grating to overcome the inevitable chromatic aberration and enlarge the holographic viewing angle,thus enabling large-viewing-angle and color holographic 3D *** use of color liquid crystal grating allows performing secondary diffraction modulation on red,green and blue reproduced images simultaneously and extending the viewing angle in the holographic 3D display *** principle,a chromatic aberration-free hologram generation mechanism in combination with the color liquid crystal grating is proposed to pave the way for on such a superior holographic 3D *** proposed system shows a color viewing angle of~50.12°,which is about 7 times that of the traditional system with a single spatial light *** work presents a paradigm for achieving desirable holographic 3D display,and is expected to provide a new way for the wide application of holographic display.

关键词： holographic angle crystal

来源：评论

学校读者我要写书评

暂无评论

Audio-Driven Talking Face Video Generation with Emotion

Audio-Driven Talking Face Video Generation with Emotion

引用

virtual reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE Conference on

作者： Jiadong Liang Feng Lu State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China

ISBN: (数字)9798350374490

ISBN: (纸本)9798350374506

Vivid talking face generation has potential applications in virtual reality. Existing methods can generate talking faces that are synchronized with the audio, but typically ignore the accurate expression of emotions. In this paper, we propose an advanced two-step framework to synthesize talking face videos with vivid emotional appearances. The first step is designed to generate emotional fine-grained landmarks, including the normalized landmarks, gaze, and head pose. In the second step, we map the facial landmarks to latent key points, which are then fed into the pre-trained model to generate high-quality face images. Extensive experiments demonstrate the effectiveness of our method.

关键词： Solid modeling Three-dimensional displays Conferences virtual reality User interfaces Digital humans Synchronization

来源：评论

学校读者我要写书评

暂无评论

"dongba Script Character Construction Space": VR science-based interactive experience of pictographs in intangible cultural heritage 23

"dongba Script Character Construction Space": VR science-bas...

引用

2023 SIGGRAPH Asia 2023 XR, SA 2023

作者： Lu, Yulu Dai, Wensi Yan, Shuo School of New Media Art and Design Beihang University Beijing China State Key Laboratory of Virtual Reality Technology and Systems Beihang University China

ISBN: (纸本)9798400703164

The "Dongba Script Character Construction Space"is an interactive science VR experience based on the Dongba script of the Naxi people in Yunnan Province, China, which provides an immersive virtual reality experience based on the traditional Yiyin script theory. [Selmanović et al., 2020] Specifically, this work combines the character construction characteristics of "pictogram", "simple ideographs"and "compound ideographs"to explore the meaning and visual symbolic characteristics of Naxi pictograms through three interesting forms of interaction, and provides more possibilities for the inheritance and development of Dongba in the future by using various forms of interaction. © 2023 Owner/Author.

关键词： virtual reality

来源：评论

学校读者我要写书评

暂无评论

GraphFed: A Personalized Subgraph Federated Learning Framework for Non-IID Graphs 20

GraphFed: A Personalized Subgraph Federated Learning Framewo...

引用

20th IEEE International Conference on Mobile Ad Hoc and Smart systems, MASS 2023

作者： Deng, Pan Liu, Xuefeng Niu, Jianwei Hu, Chunming Zhongguancun Laboratory Beijing China Zhengzhou University Research Institute of Industrial Technology School of Information Engineering Zhengzhou University Zhengzhou China State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China

ISBN: (纸本)9798350324334

Recently, federated graph learning has attracted significant attention, as subgraphs of a global graph may often distribute across different institutions and are subject to privacy restrictions. However, inevitable data heterogeneity among sub-graphs can lead to poor performance of Graph Neural Networks (GNNs) trained by vanilla federated learning algorithm, which has been neglected before. To address this problem we look at subgraphs and find that there are usually overlapping nodes among them. Inspired by the common overlapping nodes among subgraphs, we propose GraphFed, a subgraph federated learning framework which solve the challenge in terms of both data augmentation and personalized federated learning. GraphFed uses common overlapping nodes among subgraphs to locate lost node information and applies data augmentation by retrieving lost nodes and forming common node sets that mitigates data distribution difference. Furthermore, GraphFed treats the overlapping nodes as bridges to calculate the distance among different subgraphs, which implies the similarity of the graph data distribution. Then, we use the distance to perform personalized federated learning. Empirical results and analysis on three real-world graph datasets with graph federated learning settings demonstrate the effectiveness of our proposed framework. © 2023 IEEE.

关键词： Graph neural networks

来源：评论

学校读者我要写书评

暂无评论

Super-resolution of Solar Magnetograms Using Deep Learning

引用

Research in Astronomy and Astrophysics 2022年第8期22卷 218-229页

作者： Fengping Dou Long Xu Zhixiang Ren Dong Zhao Xinze Zhang State Key Laboratory of Space Weather National Space Science CenterChinese Academy of SciencesBeijing 100190China University of Chinese Academy of Sciences Beijing 100049China Peng Cheng National Laboratory Shenzhen 518000China State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and EngineeringBeihang UniversityBeijing 100191China

Currently,data-driven models of solar activity forecast are investigated extensively by using machine *** model training,it is highly demanded to establish a large database which may contain observations coming from different instruments with different spatio-temporal *** this paper,we employ deep learning models for super-resolution(SR)of magnetogram of Michelson Doppler Imager(MDI)in order to achieve the same spatial resolution of Helioseismic and Magnetic Imager(HMI).First,a generative adversarial network(GAN)is designed to transfer characteristics of MDI onto downscaled HMI,getting low-resolution HMI magnetogram in the same domain as ***,with the paired low-resolution and high-resolution HMI magnetograms,another GAN is trained in a supervised learning way,which consists of two streams,one is for generating high-fidelity image content,the other is explicitly optimized for generating elaborate image ***,these two streams work together to guarantee both high-fidelity and photorealistic super-resolved *** results demonstrate that the proposed method can generate super-resolved magnetograms with perceptual-pleasant visual ***,the best PSNR,LPIPS,RMSE,comparable SSIM and CC are obtained by the proposed *** source code and data set can be accessed via https://***/filterbank/SPSR.

关键词： techniques:image processing Sun:magnetic fields Sun:atmosphere

来源：评论

学校读者我要写书评

暂无评论

A Spatial-Spectral Decoupling Fusion Framework for Visible and Near-Infrared Images 5

A Spatial-Spectral Decoupling Fusion Framework for Visible a...

引用

5th ACM International Conference on Multimedia in Asia, MMAsia 2023

作者： Tang, Zhenglin Hu, Hai-Miao Beijing Key Laboratory of Digital Media School of Computer Science and Engineering Beihang University Beijing China Hangzhou Innovation Institute of Beihang University Hangzhou China State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing China

ISBN: (纸本)9798400702051

The visible and near-infrared image fusion aims to generate an image that integrates complementary information from images captured in different spectral bands. However, existing fusion methods either only focus on the fusion of spatial information, or fuse spatial and spectral information without decoupling, resulting in undesirable effects such as halo artifacts, information loss, and inferior visual quality. To address these issues, we propose a Spatial-Spectral Decoupling Fusion (SSDF) framework that can effectively fuse the spatial and spectral information of visible and near-infrared images. The SSDF framework decomposes the image pairs into two main branches: the Spatial Feature Enhancement (SFE) branch and the Spectral Characteristic Preservation (SCP) branch. The SFE branch enhances the salient details in the fused image by exploiting the contrast between spatial features and generating region-based fusion weights, while the SCP branch preserves the intrinsic spectral characteristics of the scene by fusing the reflectance characteristics of visible and near-infrared images. The final image is obtained by combining the spatial and spectral information. We conduct extensive experiments to show that our SSDF method can achieve superior fusion performance in subjective visual quality and objective metrics compared with state-of-the-art methods. © 2023 Copyright held by the owner/author(s).

关键词： Image fusion

来源：评论

学校读者我要写书评

暂无评论

OpenSN: An Open Source Library for Emulating LEO Satellite Networks

引用

IEEE Transactions on Parallel and Distributed systems 2025年第08期36卷 1574-1590页

作者： Lu, Wenhao Wang, Zhiyuan Zhang, Hefan Zhang, Shan Luo, Hongbin Beihang University School of Computer Science and Engineering Beijing 100191 China Zhongguancun Laboratory State Key Laboratory of Virtual Reality Technology and Systems Beijing 100191 China State Key Laboratory of Software Development Environment China

Low- earth-orbit (LEO) satellite constellations (e.g., Starlink) are becoming a necessary component of future Internet. There have been increasing studies on LEO satellite networking. It is a crucial problem how to evaluate these studies in a systematic and reproducible manner. In this paper, we present OpenSN, i.e., an open source library for emulating large-scale satellite network (SN). Different from Mininet-based SN emulators (e.g., LeoEM), OpenSN adopts container-based virtualization, thus allows for running distributed routing software on each node, and can achieve horizontal scalability via flexible multi-machine extension. Compared to other container-based SN emulators (e.g., StarryNet), OpenSN streamlines the interaction with Docker command line interface and significantly reduces unnecessary operations of creating virtual links. These modifications improve emulation efficiency and vertical scalability on a single machine. Furthermore, OpenSN separates user-defined configuration from container network management via a key-Value Database that records the necessary information for SN emulation. Such a separation architecture enhances the function extensibility. To sum up, OpenSN exhibits advantages in efficiency, scalability, and extensibility, thus is a valuable open source library that empowers research on LEO satellite networking. Experiment results show that OpenSN constructs mega-constellations 5X-10X faster than StarryNet, and updates link state 2X-4X faster than LeoEM. We also verify the scalability of OpenSN by successfully emulating the five-shell Starlink constellation with a total of 4408 satellites. © 1990-2012 IEEE.

关键词： Container low- earth-orbit satellite constellations satellite network emulator

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：