检索结果-内蒙古大学图书馆

A review of travel behavioural pattern using GPS dataset: A systematic literature review

学校读者我要写书评

暂无评论

Measurement: Sensors 2024年 32卷

作者： Sivalingam, Prahaladhan Asirvatham, David Marjani, Mohsen Syed Masood, Jafar Ali Ibrahim Chakravarthy, N.S. Kalyan Veerisetty, Gopinath Lestari, Martha Tri Faculty of Innovation & Technology Taylor's University Subang Jaya Malaysia Department of Internet of Things School of Computer Science and Engineering Vellore Institute of Technology Tamilnadu Vellore632 014 India Center for Data Science School of Computer Science and Engineering QIS College of Engineering and Technology Andhra Pradesh Ongole523272 India Department of Mechanical Engineering QIS College of Engineering and Technology Andhra Pradesh Ongole523272 India Department of Business Communication Telkom University Indonesia

In the last few years, the Global positioning system (GPS) has been used to study travel patterns with the advancement of data collection techniques. A GPS device precisely records the time and the location data of an individual travel. The accuracy of travel studies is usually improved by integrating travel surveys or travel activity diaries with GPS data. GPS surveys are implemented to replace paper-based techniques and reduce human error on trip-misreporting issues. Several reviews have been performed previously on GPS travel studies. Still, a detailed systematic review on the comparison of different modes and methods on the entire procedure of GPS data processing has not been thoroughly studied. This review identified 116 peer-reviewed studies and journal papers from 2013 to 2020, and 53 papers were studied. The review focused on travel behavior pattern (TBP) analysis using GPS studies only and a combination of travel surveys. Our review reveals that 53 only 40 have quality assessment scores of >50 %, meaning the remaining TBP studies are conventional methods. The study also benefits data analysis and researchers to select the most appropriate data collection techniques for studying TBP and improvise them further for meta-analysis travel behavior studies. © 2024 The Authors

关键词： Global positioning system

MMSite: a multi-modal framework for the identification of active sites in proteins 24

学校读者我要写书评

暂无评论

MMSite: a multi-modal framework for the identification of ac...

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Song Ouyang Huiyu Cai Yong Luo Kehua Su Lefei Zhang Bo Du School of Computer Science National Engineering Research Center for Multimedia Software and Institute of Artificial Intelligence Wuhan University China BioGeometry China and Mila - Québec AI Institute Canada and Université de Montréal Canada

ISBN: (纸本)9798331314385

The accurate identification of active sites in proteins is essential for the advancement of life sciences and pharmaceutical development, as these sites are of critical importance for enzyme activity and drug design. Recent advancements in protein language models (PLMs), trained on extensive datasets of amino acid sequences, have significantly improved our understanding of proteins. However, compared to the abundant protein sequence data, functional annotations, especially precise per-residue annotations, are scarce, which limits the performance of PLMs. On the other hand, textual descriptions of proteins, which could be annotated by human experts or a pretrained protein sequence-to-text model, provide meaningful context that could assist in the functional annotations, such as the localization of active sites. This motivates us to construct a ProTein-Attribute text dataset (ProTAD), comprising over 570,000 pairs of protein sequences and multi-attribute textual descriptions. Based on this dataset, we propose MMSite, a multi-modal framework that improves the performance of PLMs to identify active sites by leveraging biomedical language models (BLMs). In particular, we incorporate manual prompting and design a MACross module to deal with the multi-attribute characteristics of textual descriptions. MMSite is a two-stage ("First Align, Then Fuse") framework: first aligns the textual modality with the sequential modality through soft-label alignment, and then identifies active sites via multi-modal fusion. Experimental results demonstrate that MMSite achieves state-of-the-art performance compared to existing protein representation learning methods. The dataset and code implementation are available at https://***/Gift-OYS/MMSite.

关键词：

Ranking on Heterogeneous Manifold for Multimodal Information Retrieval 21

学校读者我要写书评

暂无评论

Ranking on Heterogeneous Manifold for Multimodal Information...

21st IEEE International Symposium on Parallel and Distributed Processing with Applications, 13th IEEE International Conference on Big data and Cloud Computing, 16th IEEE International Conference on Social Computing and Networking and 13th International Conference on Sustainable Computing and Communications, ISPA/BDCloud/SocialCom/SustainCom 2023

作者： Jin, Zhenkun Wan, Xingshi Nie, Xin Zhou, Xinlei Yi, Yuanyuan Zhou, Gefei Wuhan Business University Wuhan Research Institute of Posts and Telecommunications Wuhan China Wuhan Research Institute of Posts and Telecommunications Wuhan China Huazhong University of Science and Technology Hubei Key Laboratory of Distributed System Security Hubei Engineering Research Center on Big Data Security Wuhan China Huazhong University of Science and Technology School of Journalism and Information Communication Wuhan China Huazhong University of Science and Technology School of Computer Science & Technology Wuhan China

ISBN: (纸本)9798350329223

In light of recent advancements in Internet of Multimedia Things (IoMT) and 5G technology, both the variety and quantity of data have been rapidly increasing. Consequently, handling zero-shot cross-modal retrieval (ZSCMR) of unlabeled multi-modal data has emerged as a prominent research topic. Early models utilized generative adversarial networks and class embeddings to assist in building a common feature space. However, this approach resulted in a loss of reliability in the feature distributions of individual modalities. In this paper, we propose a method called Ranking on Heterogeneous Manifold (RHM) to address the aforementioned issue. Our model comprises three feature extractors, each dedicated to extracting features from text, images and multimodal data. Subsequently, the relationship structures derived from these feature extractors are employed to construct a heterogeneous manifold. A diffusion process is then conducted on this heterogeneous manifold, ultimately yielding the final ranking scores. Comprehensive experiments demonstrate that the proposed modal has the capability to acquire more effective knowledge representation, thus enhancing the effectiveness of ZSCMR. © 2023 IEEE.

关键词： Knowledge representation

Towards Context-aware Support for Color Vision Deficiency: An Approach Integrating LLM and AR

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Morita, Shogo Zhang, Yan Yamauchi, Takuto Chen, Sinan Li, Jialong Tei, Kenji School of Computing Tokyo Institute of Technology Tokyo Japan International Research Center for Neurointelligence the University of Tokyo Tokyo Japan Department of Computer Science and Engineering Waseda University Tokyo Japan Center of Mathematical and Data Sciences Kobe University Kobe Japan

People with color vision deficiency often face challenges in distinguishing colors such as red and green, which can complicate daily tasks and require the use of assistive tools or environmental adjustments. Current support tools mainly focus on presentation-based aids, like the color vision modes found in iPhone accessibility settings. However, offering context-aware support, like indicating the doneness of meat, remains a challenge since task-specific solutions are not cost-effective for all possible scenarios. To address this, our paper proposes an application that provides contextual and autonomous assistance. This application is mainly composed of: (i) an augmented reality interface that efficiently captures context;and (ii) a multi-modal large language model-based reasoner that serves to cognitize the context and then reason about the appropriate support contents. Preliminary user experiments with two color vision deficient users across five different scenarios have demonstrated the effectiveness and universality of our application. © 2024, CC BY.

关键词： Color

Securely Fine-tuning Pre-trained Encoders Against Adversarial Examples

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhou, Ziqi Li, Minghui Liu, Wei Hu, Shengshan Zhang, Yechao Wan, Wei Xue, Lulu Zhang, Leo Yu Yao, Dezhong Jin, Hai National Engineering Research Center for Big Data Technology and System China Services Computing Technology and System Lab. China Cluster and Grid Computing Lab. China Hubei Engineering Research Center on Big Data Security China Hubei Key Laboratory of Distributed System Security China School of Computer Science and Technology Huazhong University of Science and Technology China School of Software Engineering Huazhong University of Science and Technology China School of Cyber Science and Engineering Huazhong University of Science and Technology China School of Information and Communication Technology Griffith University Australia

With the evolution of self-supervised learning, the pre-training paradigm has emerged as a predominant solution within the deep learning landscape. Model providers furnish pre-trained encoders designed to function as versatile feature extractors, enabling downstream users to harness the benefits of expansive models with minimal effort through fine-tuning. Nevertheless, recent works have exposed a vulnerability in pre-trained encoders, highlighting their susceptibility to downstream-agnostic adversarial examples (DAEs) meticulously crafted by attackers. The lingering question pertains to the feasibility of fortifying the robustness of downstream models against DAEs, particularly in scenarios where the pre-trained encoders are publicly accessible to the attackers. In this paper, we initially delve into existing defensive mechanisms against adversarial examples within the pre-training paradigm. Our findings reveal that the failure of current defenses stems from the domain shift between pre-training data and downstream tasks, as well as the sensitivity of encoder parameters. In response to these challenges, we propose Genetic Evolution-Nurtured Adversarial Fine-tuning (Gen-AF), a two-stage adversarial fine-tuning approach aimed at enhancing the robustness of downstream models. Gen-AF employs a genetic-directed dual-track adversarial fine-tuning strategy in its first stage to effectively inherit the pre-trained encoder. This involves optimizing the pre-trained encoder and classifier separately while incorporating genetic regularization to preserve the model’s topology. In the second stage, Gen-AF assesses the robust sensitivity of each layer and creates a dictionary, based on which the top-k robust redundant layers are selected with the remaining layers held fixed. Upon this foundation, we conduct evolutionary adaptability fine-tuning to further enhance the model’s generalizability. Our extensive experiments, conducted across ten self-supervised training methods and six

关键词： Topology

A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Daizong Yang, Mingyu Qu, Xiaoye Zhou, Pan Cheng, Yu Hu, Wei Wangxuan Institute of Computer Technology Peking University No. 128 Zhongguancun North Street Beijing China The Hubei Engineering Research Center on Big Data Security School of Cyber Science and Engineering Huazhong University of Science and Technology Wuhan430074 China The Department of Computer Science and Engineering The Chinese University of Hong Kong Hong Kong

With the significant development of large models in recent years, Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across a wide range of multimodal understanding and reasoning tasks. Compared to traditional Large Language Models (LLMs), LVLMs present great potential and challenges due to its closer proximity to the multi-resource real-world applications and the complexity of multi-modal processing. However, the vulnerability of LVLMs is relatively underexplored, posing potential security risks in daily usage. In this paper, we provide a comprehensive review of the various forms of existing LVLM attacks. Specifically, we first introduce the background of attacks targeting LVLMs, including the attack preliminary, attack challenges, and attack resources. Then, we systematically review the development of LVLM attack methods, such as adversarial attacks that manipulate model outputs, jailbreak attacks that exploit model vulnerabilities for unauthorized actions, prompt injection attacks that engineer the prompt type and pattern, and data poisoning that affects model training. Finally, we discuss promising research directions in the future. We believe that our survey provides insights into the current landscape of LVLM vulnerabilities, inspiring more researchers to explore and mitigate potential safety issues in LVLM developments. The latest papers on LVLM attacks are continuously collected in https://***/liudaizong/Awesome-LVLM-Attack. Copyright © 2024, The Authors. All rights reserved.

关键词： Computational linguistics

Expediting Distributed GNN Training with Feature-only Partition and Optimized Communication Planning

学校读者我要写书评

暂无评论

Expediting Distributed GNN Training with Feature-only Partit...

IEEE Annual Joint Conference: INFOCOM, IEEE computer and Communications Societies

作者： Bingqian Du Jun Liu Ziyue Luo Chuan Wu Qiankun Zhang Hai Jin National Engineering Research Center for Big Data Technology and System Services Computing Technology and System Lab Cluster and Grid Computing Lab School of Computer Science and Technology Huazhong University of Science and Technology Wuhan China Department of Electrical and Computer Engineering The Ohio State University USA Department of Computer Science The University of Hong Kong Hong Kong School of Cyber Science and Engineering Huazhong University of Science and Technology Wuhan China

ISBN: (数字)9798350383508

ISBN: (纸本)9798350383515

Feature-only partition of large graph data in distributed Graph Neural Network (GNN) training offers advantages over commonly adopted graph structure partition, such as minimal graph preprocessing cost and elimination of cross-worker subgraph sampling burdens. Nonetheless, performance bottleneck of GNN training with feature-only partitions still largely lies in the substantial communication overhead due to cross-worker feature fetching. To reduce the communication overhead and expedite distributed training, we first investigate and answer two key questions on convergence behaviors of GNN model in feature-partition based distribute GNN training: 1) As no worker holds a complete copy of each feature, can gradient exchange among workers compensate for the information loss due to incomplete local features? 2) If the answer to the first question is negative, is feature fetching in every training iteration of the GNN model necessary to ensure model convergence? Based on our theoretical findings on these questions, we derive an optimal communication plan that decides the frequency for feature fetching during the training process, taking into account bandwidth levels among workers and striking a balance between model loss and training time. Extensive evaluation demonstrates consistent results with our theoretical analysis, and the effectiveness of our proposed design.

关键词： Training Time-frequency analysis Costs Computational modeling Distributed databases Bandwidth Graph neural networks

Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Li, Qian Ji, Cheng Guo, Shu Liang, Zhaoji Wang, Lihong Li, Jianxin School of Computer Science and Engineering Beihang University Beijing China Beijing Advanced Innovation Center for Big Data and Brain Computing Beijing China National Computer Network Emergency Response Technical Team Coordination Center of China China

Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types of information, including neighboring entities, multimodal attributes, and entity types. Directly incorporating the above information (e.g., concatenation or attention) can lead to an unaligned information space. To address these challenges, we propose a novel MMEA transformer, called MoAlign, that hierarchically introduces neighbor features, multi-modal attributes, and entity types to enhance the alignment task. Taking advantage of the transformer's ability to better integrate multiple information, we design a hierarchical modifiable self-attention block in a transformer encoder to preserve the unique semantics of different information. Furthermore, we design two entity-type prefix injection methods to integrate entity-type information using type prefixes, which help to restrict the global information of entities not present in the MMKGs. Our extensive experiments on benchmark datasets demonstrate that our approach outperforms strong competitors and achieves excellent entity alignment performance. Copyright © 2023, The Authors. All rights reserved.

关键词： Knowledge graph

Towards Context-aware Support for Color Vision Deficiency: An Approach Integrating LLM and AR

学校读者我要写书评

暂无评论

Towards Context-aware Support for Color Vision Deficiency: A...

IEEE Global Conference on Consumer Electronics (GCCE)

作者： Shogo Morita Yan Zhang Takuto Yamauchi Sinan Chen Jialong Li Kenji Tei School of Computing Tokyo Institute of Technology Tokyo Japan International Research Center for Neurointelligence University of Tokyo Tokyo Japan Department of Computer Science and Engineering Waseda University Tokyo Japan Center of Mathematical and Data Sciences Kobe University Kobe Japan

ISBN: (数字)9798350355079

ISBN: (纸本)9798350355086

People with color vision deficiency often face challenges in distinguishing colors such as red and green, which can complicate daily tasks and require the use of assistive tools or environmental adjustments. Current support tools mainly focus on presentation-based aids, like the color vision modes found in iPhone accessibility settings. However, offering context-aware support, like indicating the doneness of meat, remains a challenge since task-specific solutions are not cost-effective for all possible scenarios. To address this, our paper proposes an application that provides contextual and autonomous assistance. This application is mainly composed of: (i) an augmented reality interface that efficiently captures context; and (ii) a multi-modal large language model-based reasoner that serves to cognitize the context and then reason about the appropriate support contents. Preliminary user experiments with two color vision deficient users across five different scenarios have demonstrated the effectiveness and universality of our application.

关键词： Green products Color Faces Consumer electronics Augmented reality Context modeling