检索结果-内蒙古大学图书馆

Previs-Real:Interactive virtual previsualization system for news shooting rehearsal and evaluation

虚拟现实与智能硬件（中英文） 2024年第6期6卷 527-549页

作者： Che QU Shaocong WANG Chao ZHOU Tongchen ZHAO Rui GUO Cheng Wa WONG Chi DENG Bin JI Yuhui WEN Yuanchun SHI Yong-Jin LIU Department of Film and Television Technology Beijing Film AcademyBeijing 100088China Department of Computer Science and Technology MOE-Key Laboratory of Pervasive ComputingTsinghua UniversityBeijing 100084China School of Social Sciences Tsinghua UniversityBeijing 100084China News Production and Broadcasting First Division China Media GroupBeijing 100038China School of Computer and Information Technology Bejing Jiaotong UniversityBejing 100044China Beijing Key Laboratory of Traffic Data Analysis and Mining Beijing Jiaotong UniversityBeijing 100044China

Background In the demanding field of live news broadcasting,the intricate studio production procedures and tight schedules pose significant challenges for physical rehearsals by *** paper explores the design and implementation of a lightweight virtual news previsualization system,leveraging virtual production technology and interaction design methods to address the lack of fidelity in presentations and manipulations,and the quantitative feedback of rehearsal effects in previous virtual *** Our system,Previs-Real,is informed by user investigation with professional cameramen and studio technicians,and adheres to principles of high fidelity,accurate replication of actual hardware operations,and real-time feedback on rehearsal *** system's software and hardware development are implemented based on Unreal Engine and accompanying toolsets,incorporating cutting-edge modeling and camera calibration *** We validated Previs-Real through a user study,demonstrating superior performance in previsualization shooting tasks using the virtual system compared to traditional camera *** findings,supported by both objective performance metrics and subjective responses,underline Previs-Real's effectiveness and potential in transforming news broadcasting *** Previs-Real eliminates the requirement for complex equipment interconnections and team coordination inherent in a physical studio by implementing methodologies complying the above principles,objectively resulting in a lightweight design of applicable version of virtual news previsualization *** offers a novel solution to the challenges in news studio previsualization by focusing on key operational features rather than full environment *** design approach is equally effective in the process of designing lightweight systems in other fields.

关键词： News broadcast Previsualization Human computer interaction design User-centered design Interface evaluation

来源：评论

学校读者我要写书评

暂无评论

Tm-net: Deep generative networks for textured meshes

引用

ACM Transactions on Graphics 2021年第6期40卷 1-15页

作者： Gao, Lin Wu, Tong Yuan, Yu-Jie Lin, Ming-Xian Lai, Yu-Kun Zhang, Hao Beijing Key Laboratory of Mobile Computing and Pervasive Device Institute of Computing Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China School of Computer Science and Informatics Cardiff University United Kingdom School of Computing Science Simon Fraser University Canada

We introduce TM-NET, a novel deep generative model for synthesizing textured meshes in a part-aware manner. Once trained, the network can generate novel textured meshes from scratch or predict textures for a given 3D mesh, without image guidance. Plausible and diverse textures can be generated for the same mesh part, while texture compatibility between parts in the same shape is achieved via conditional generation. Specifically, our method produces texture maps for individual shape parts, each as a deformable box, leading to a natural UV map with limited distortion. The network separately embeds part geometry (via a PartVAE) and part texture (via a TextureVAE) into their respective latent spaces, so as to facilitate learning texture probability distributions conditioned on geometry. We introduce a conditional autoregressive model for texture generation, which can be conditioned on both part geometry and textures already generated for other parts to achieve texture compatibility. To produce high-frequency texture details, our TextureVAE operates in a high-dimensional latent space via dictionary-based vector quantization. We also exploit transparencies in the texture as an effective means to model complex shape structures including topological details. Extensive experiments demonstrate the plausibility, quality, and diversity of the textures and geometries generated by our network, while avoiding inconsistency issues that are common to novel view synthesis methods. © 2021 ACM.

关键词： Textures

来源：评论

学校读者我要写书评

暂无评论

Mesh-based Gaussian Splatting for Real-time Large-scale Deformation

arXiv

引用

arXiv 2024年

作者： Gao, Lin Yang, Jie Zhang, Bo-Tao Sun, Jia-Mu Yuan, Yu-Jie Fu, Hongbo Lai, Yu-Kun The Beijing Key Laboratory of Mobile Computing and Pervasive Device China The University of Chinese Academy of Sciences Beijing China The Beijing Key Laboratory of Mobile Computing and Pervasive Device Chinese Academy of Sciences Beijing China City University of Hong Kong Hong Kong The School of Computer Science & Informatics Cardiff University United Kingdom

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a scene. Nevertheless, it is challenging for users to directly deform or manipulate these implicit representations with large deformations in the real-time *** Splatting (GS) has recently become a promising method with explicit geometry for representing static scenes and facilitating high-quality and real-time synthesis of novel views. However, it cannot be easily deformed due to the use of discrete Gaussians and lack of explicit topology. To address this, we develop a novel GS-based method that enables interactive deformation. Our key idea is to design an innovative mesh-based GS representation, which is integrated into Gaussian learning and manipulation. 3D Gaussians are defined over an explicit mesh, and they are bound with each other: the rendering of 3D Gaussians guides the mesh face split for adaptive refinement, and the mesh face split directs the splitting of 3D Gaussians. Moreover, the explicit mesh constraints help regularize the Gaussian distribution, suppressing poor-quality Gaussians (e.g., misaligned Gaussians, long-narrow shaped Gaussians), thus enhancing visual quality and avoiding artifacts during deformation. Based on this representation, we further introduce a large-scale Gaussian deformation technique to enable deformable GS, which alters the parameters of 3D Gaussians according to the manipulation of the associated mesh. Our method benefits from existing mesh deformation datasets for more realistic data-driven Gaussian deformation. Extensive experiments show that our approach achieves high-quality reconstruction and effective deformation, while maintaining the promising rendering results at a high frame rate (65 FPS on average on a single commodity GPU). Copyright © 2024, The Authors. All rights reserv

关键词： Topology

来源：评论

学校读者我要写书评

暂无评论

An Approach of Analyzing Classroom Student Engagement in Multimodal Environment by Using Deep Learning

An Approach of Analyzing Classroom Student Engagement in Mul...

引用

IEEE International WIE Conference on Electrical and computer Engineering (WIECON-ECE)

作者： Nishat Sultana Nuha Tanjim Mahmud Noortaz Rezaoana Mohammad Shahadat Hossain Karl Andersson Department of Computer Science and Engineering University of Chittagong Chittagong Bangladesh Department of Computer Science and Engineering Rangamati Science and Technology University Rangamati Bangladesh Pervasive and Mobile Computing Laboratory Luleå University of Technology Sweden

Student engagement refers to the level of involve-ment, interest, attention, and active participation that students demonstrate during their learning experiences. As the engage-ment rate increases the learning rate, teachers always try to mea-sure the engagement rate in the classroom in various ways. This paper introduces a multimodal approach for detecting student engagement, a vital aspect of effective learning. Leveraging Convolutional Neural Networks (CNNs), video and audio data are integrated to capture comprehensive insights into engagement levels. The objective is to classify student engagement into three categories: highly engaged, engaged, and not engaged. Separate unimodal models are employed for speech and video data., achieving notable accuracies of 92.87 % and 94.77 %, respectively, in recognizing engagement levels. The combined model, achieved through feature-level fusion, yields a competitive accuracy of 69.36%, benefiting from the strengths of both modalities. Al-though the combined model exhibits slightly lower test accuracy compared to the individual speech and video models, its enhanced interpretability and comprehensive insights make it a promising avenue for future research.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Skinned motion retargeting with dense geometric interaction perception 24

Skinned motion retargeting with dense geometric interaction ...

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Zijie Ye Jia-Wei Liu Jia Jia Shikun Sun Mike Zheng Shou Department of Computer Science and Technology BNRist Tsinghua University and Key Laboratory of Pervasive Computing Ministry of Education Show Lab National University of Singapore

ISBN: (纸本)9798331314385

Capturing and maintaining geometric interactions among different body parts is crucial for successful motion retargeting in skinned characters. Existing approaches often overlook body geometries or add a geometry correction stage after skeletal motion retargeting. This results in conflicts between skeleton interaction and geometry correction, leading to issues such as jittery, interpenetration, and contact mismatches. To address these challenges, we introduce a new retargeting framework, MeshRet, which directly models the dense geometric interactions in motion retargeting. Initially, we establish dense mesh correspondences between characters using semantically consistent sensors (SCS), effective across diverse mesh topologies. Subsequently, we develop a novel spatio-temporal representation called the dense mesh interaction (DMI) field. This field, a collection of interacting SCS feature vectors, skillfully captures both contact and non-contact interactions between body geometries. By aligning the DMI field during retargeting, MeshRet not only preserves motion semantics but also prevents self-interpenetration and ensures contact preservation. Extensive experiments on the public Mixamo dataset and our newly-collected ScanRet dataset demonstrate that MeshRet achieves state-of-the-art performance. Code available at https://***/abcyzj/MeshRet.

关键词：

来源：评论

学校读者我要写书评

暂无评论

A Novel Two-Stream Algorithm for Spatio-Temporal Fusion in Remote Sensing

引用

IEEE Geoscience and Remote Sensing Letters 2025年

作者： Wang, Shiying Zou, Xuechao Wang, Wentao Liu, Yao Zhang, Shun Cao, Tengfei Tao, Pin Qinghai University School of Computer Technology and Application Xining China Qinghai University Intelligent Computing and Application Laboratory of Qinghai Province China School of Computer Science & Technology Beijing China Tsinghua University Department of Computer Science and Technology Beijing China Ministry of Education Key Laboratory of Pervasive Computing China

The spatio-temporal fusion technology can effectively solve the problem of missing time series data. However, existing algorithms often struggle to accurately capture surface feature changes and fine details. To overcome these limitations, this paper introduces FemSTF, a flexible two-stream algorithm for remote sensing spatio-temporal fusion, which consists of three main stages: image sharpening, image fusion, and edge optimization. In the first stage, techniques such as interpolation, classification, and blending are employed to address missing pixel values caused by minimal input data. In the second stage, a two-stream strategy is introduced to enhance fusion accuracy, enabling the algorithm to capture regional detail changes with high sensitivity to surface variations. The third stage focuses on edge optimization, generating high-resolution predictive images under minimal input conditions (three images) while retaining rich texture and edge details. Notably, FemSTF achieves a performance comparable to that of methods requiring five input images. Experimental results demonstrate that FemSTF outperforms mainstream algorithms across multiple datasets. Ablation experiments confirm the effectiveness of the two-stream strategy, highlighting its role in enhancing remote sensing data processing accuracy. This study offers an efficient solution for spatio-temporal fusion, demonstrating great potential in the field. © 2004-2012 IEEE.

关键词： Spatio-temporal data

来源：评论

学校读者我要写书评

暂无评论

GeneCompass:deciphering universal gene regulatory mechanisms with a knowledge-informed cross-species foundation model

引用

细胞研究（英文版） 2024年第12期34卷 830-845页

作者： Xiaodong Yang Guole Liu Guihai Feng Dechao Bu Pengfei Wang Jie Jiang Shubai Chen Qinmeng Yang Hefan Miao Yiyang Zhang Zhenpeng Man Zhongming Liang Zichen Wang Yaning Li Zheng Li Yana Liu Yao Tian Wenhao Liu Cong Li Ao Li Jingxi Dong Zhilong Hu Chen Fang Lina Cui Zixu Deng Haiping Jiang Wentao Cui Jiahao Zhang Zhaohui Yang Handong Li Xingjian He Liqun Zhong Jiaheng Zhou Zijian Wang Qingqing Long Ping Xu The X-Compass Consortiudm Hongmei Wang Zhen Meng Xuezhi Wang Yangang Wang Yong Wang Shihua Zhang Jingtao Guo Yi Zhao Yuanchun Zhou Fei Li Jing Liu Yiqiang Chen Ge Yang Xin Li Baoyang Hu Wei Li Fei Gao Leqian Yu Qi Gu Weiwei Zhai Zhengting Zou Jingqi Yu Wenhui Wu Xinxin Lin Yu Zou Yongshun Ren Fan Li Yixiao Zhao Yike Xin Longfei Han Shuyang Jiang Kai Ma Qicheng Chen Haoyuan Wang Huanhuan Wu Chaofan He Yilong Hu Shuyu Guo Yiyun Li Zaitian Wang Huimin He Shan Zong Jiajia Wang Yan Chen Chunyang Zhang Chengrui Wang Ran Zhang Meng Xiao Yining Wang Xin Qin Jiaxin Qin Chenhao Li Zhufeng Xu Zeyuan Zhang Xiaoning Qi Wuliang Huang Yaoru Luo Qinxuan Luo Ziwen Liu Teng Wang Yiming Huang Shirui Li Kangning Dong Qunlun Shen State Key Laboratory of Stem Cell and Reproductive Biology Institute of ZoologyChinese Academy of SciencesBeijingChina Beijing Key Laboratory of Mobile Computing and Pervasive Device Institute of Computing TechnologyChinese Academy of SciencesBeijingChina University of Chinese Academy of Sciences BeijingChina State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of AutomationChinese Academy of SciencesBeijingChina School of Artificial Intelligence University of Chinese Academy of SciencesBeijingChina State Key Laboratory of Stem Cell and Reproductive Biology Institute of ZoologyChinese Academy of SciencesBeijingChina Institute for Stem Cell and Regenerative Medicine Chinese Academy of SciencesBeijingChina Beijing Institute for Stem Cell and Regenerative Medicine BeijingChina Beijing Key Laboratory of Mobile Computing and Pervasive Device Institute of Computing TechnologyChinese Academy of SciencesBeijingChina University of Chinese Academy of Sciences BeijingChina Research Center for Ubiquitous Computing Systems Institute of Computing TechnologyChinese Academy of SciencesBeijingChina University of Chinese Academy of Sciences BeijingChina Computer Network Information Center Chinese Academy of SciencesBeijingChina Institute of Automation Chinese Academy of SciencesBeijingChina Beijing Key Laboratory of Mobile Computing and Pervasive Device Institute of Computing TechnologyChinese Academy of SciencesBeijingChina University of Chinese Academy of Sciences BeijingChina Computer Network Information Center Chinese Academy of SciencesBeijingChina State Key Laboratory of Stem Cell and Reproductive Biology Institute of ZoologyChinese Academy of SciencesBeijingChina University of Chinese Academy of Sciences BeijingChina University of Chinese Academy of Sciences BeijingChina CEMS NCMISHCMSMDISRCSDSAcademy of Mathematics and Systems ScienceChinese Academy of SciencesBeijingChina State Key Laboratory of Stem Cell and Reproductive Biology Institute of Zoology

Deciphering universal gene regulatory mechanisms in diverse organisms holds great potential for advancing our knowledge of fundamental life processes and facilitating clinical ***,the traditional research paradigm primarily focuses on individual model organisms and does not integrate various cell types across *** breakthroughs in single-cell sequencing and deep learning techniques present an unprecedented opportunity to address this *** this study,we built an extensive dataset of over 120 million human and mouse single-cell *** data preprocessing,we obtained 101,768,420 single-cell transcriptomes and developed a knowledge-informed cross-species foundation model,named *** pre-training,GeneCompass effectively integrated four types of prior biological knowledge to enhance our understanding of gene regulatory mechanisms in a self-supervised *** fine-tuning for multiple downstream tasks,GeneCompass outperformed state-of-the-art models in diverse applications for a single species and unlocked new realms of cross-species biological *** also employed GeneCompass to search for key factors associated with cell fate transition and showed that the predicted candidate genes could successfully induce the differentiation of human embryonic stem cells into the gonadal ***,GeneCompass demonstrates the advantages of using artificial intelligence technology to decipher universal gene regulatory mechanisms and shows tremendous potential for accelerating the discovery of critical cell fate regulators and candidate drug targets.

关键词： knowledge model with cross-species deciphering foundation genecompass informed mechanisms regulatory

来源：评论

学校读者我要写书评

暂无评论

Plant Disease Detection in Precision Agriculture: Deep Learning Approaches

Plant Disease Detection in Precision Agriculture: Deep Learn...

引用

Intelligent Data Communication Technologies and Internet of Things (IDCIoT), International Conference on

作者： Puja Dey Tanjim Mahmud Sultana Rokeya Nahar Mohammad Shahadat Hossain Karl Andersson Department of Computer Science and Engineering University of Chittagong Chittagong Bangladesh Department of Computer Science and Engineering Rangamati Science and Technology University Rangamati Bangladesh Department of Computer Science and Engineering University of Information Technology and Sciences (UITS) Dhaka Bangladesh Pervasive and Mobile Computing Laboratory Luleå University of Technology Luleå Sweden

Plants affect economy, agriculture industry and climate of any country. Therefore it is very important to take care of plants. Like human being, plants are also infected by various disease that are resulted from virus, bacteria, and fungi. It is necessary to identify these diseases in time and cure them immediately to counteract the destruction of whole plant. In recent times, deep learning networks have attained tremendous improvement in classifying image and detecting object. Therefore, in our research, some pre-trained Convolution Neural Networks (AlexNet, VGG16, VGG19) have been utilised along with transfer learning for detecting plant diseases. First of all, pre-processing technique has been applied to improve image quality and increase the accuracy. After the training process, testing has been done for validating the results. To train these models, PlantVillage dataset has been used which contains both diseased and healthy leaves. 80% data has been utilised in training step and other 20% has been used in testing. In this research, precision, recall and f1-score are also computed besides the accuracy. Using AlexNet, VGG16, and VGG19 96.63%, 95.05%, and 95.22% testing accuracy have been achieved respectively. As we can see that among all models the modified AlexNet performed best and got 96.63% as accuracy, 92 % as precision, 91 % as recall, and 91 % as f1-score.

关键词：

来源：评论

学校读者我要写书评

暂无评论

PoseAugment: Generative Human Pose Data Augmentation with Physical Plausibility for IMU-based Motion Capture

arXiv

引用

arXiv 2024年

作者： Li, Zhuojun Yu, Chun Liang, Chen Shi, Yuanchun Department of Computer Science and Technology Tsinghua University China Key Laboratory of Pervasive Computing Ministry of Education China Qinghai University China

The data scarcity problem is a crucial factor that hampers the model performance of IMU-based human motion capture. However, effective data augmentation for IMU-based motion capture is challenging, since it has to capture the physical relations and constraints of the human body, while maintaining the data distribution and quality. We propose PoseAugment, a novel pipeline incorporating VAE-based pose generation and physical optimization. Given a pose sequence, the VAE module generates infinite poses with both high fidelity and diversity, while keeping the data distribution. The physical module optimizes poses to satisfy physical constraints with minimal motion restrictions. High-quality IMU data are then synthesized from the augmented poses for training motion capture models. Experiments show that PoseAugment outperforms previous data augmentation and pose generation methods in terms of motion capture accuracy, revealing a strong potential of our method to alleviate the data collection burden for IMU-based motion capture and related tasks driven by human poses. Copyright © 2024, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

AeroRec: An Efficient On-Device Recommendation Framework using Federated Self-Supervised Knowledge Distillation

AeroRec: An Efficient On-Device Recommendation Framework usi...

引用

IEEE Annual Joint Conference: INFOCOM, IEEE computer and Communications Societies

作者： Tengxi Xia Ju Ren Wei Rao Qin Zu Wenjie Wang Shuai Chen Yaoxue Zhang Department of Computer Science and Technology Key Laboratory of Pervasive Computing Ministry of Education BNRist Tsinghua University Meituan Beijing China Zhongguancun Laboratory Beijing China

ISBN: (数字)9798350383508

ISBN: (纸本)9798350383515

Modern recommendation systems operate entirely on the basis of central servers, requiring users to upload their behavior data from mobile devices to these servers. This practice has raised concerns about data privacy among users. Federated learning (FL), a machine learning technique designed to protect privacy, is becoming the standard solution. By combining federated learning with recommendation systems, Federated Recommendation Systems (FRS) allow users to collaboratively train a shared recommendation model without transmitting their original behavior data. However, existing federated learning solutions disregard the inherent limitations of resource-constrained mobile devices, which include limited storage space, computational overhead, and communication bandwidth. Although deploying a lightweight recommendation model can address the constraints of mobile devices, achieving satisfactory accuracy is difficult even with substantial communication overhead incurred during multiple rounds of federated learning training due to the limitations of the lightweight model’s capabilities and the sparsity of recommendation data. To address this issue, we propose AeroRec, a n e fficient on-device Feder ated Recommendation Framework. In AeroRec, we use federated self-supervised distillation to enhance the global model after each parameter aggregation in each round. This approach not only accelerates the convergence rate but also surpasses the upper limit of the lightweight model’s capability, thereby enabling a higher accuracy. We demonstrate that AeroRec outperforms several state-of-the-art FRS frameworks regarding recommendation accuracy and convergence speed through extensive experiments on three real-world datasets.

关键词： Training Accuracy Federated learning Computational modeling mobile handsets Data models Servers

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：