检索结果-内蒙古大学图书馆

m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yang, Jian Guo, Hongcheng Yin, Yuwei Bai, Jiaqi Wang, Bing Liu, Jiaheng Liang, Xinnian Chai, Linzheng Yang, Liqun Li, Zhoujun State Key Lab of Software Development Environment Beihang University China Department of Computer Science University of British Columbia Canada

Multilingual translation supports multiple translation directions by projecting all languages in a shared space, but the translation quality is undermined by the difference between languages in the text-only modality, especially when the number of languages is large. To bridge this gap, we introduce visual context as the universal language-independent representation to facilitate multilingual translation. In this paper, we propose a framework to leverage the multimodal prompt to guide the Multimodal Multilingual neural Machine Translation (m3P), which aligns the representations of different languages with the same meaning and generates the conditional vision-language memory for translation. We construct a multilingual multimodal instruction dataset (InstrMulti102) to support 102 languages Our method aims to minimize the representation distance of different languages by regarding the image as a central language. Experimental results show that m3P outperforms previous text-only baselines and multilingual multimodal methods by a large margin. Furthermore, the probing experiments validate the effectiveness of our method in enhancing translation under the low-resource and massively multilingual scenario. © 2024, CC BY.

关键词： Visual languages

Approximate k-Nearest Neighbor Query over Spatial Data Federation 28th

学校读者我要写书评

暂无评论

Approximate k-Nearest Neighbor Query over Spatial Data Fede...

28th International Conference on Database Systems for Advanced Applications, DASFAA 2023

作者： Zhang, Kaining Tong, Yongxin Shi, Yexuan Zeng, Yuxiang Xu, Yi Chen, Lei Zhou, Zimu Xu, Ke Lv, Weifeng Zheng, Zhiming State Key Laboratory of Software Development Environment Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing School of Computer Science and Engineering and Institute of Artificial Intelligence Beihang University Beijing China Department of Computer Science and Engineering HKUST Hong Kong Guangzhou China City University of Hong Kong Hong Kong

ISBN: (纸本)9783031306365

Approximate nearest neighbor query is a fundamental spatial query widely applied in many real-world applications. In the big data era, there is an increasing demand to scale these queries over a spatial data federation, which consists of multiple data owners, each holding a private, disjoint partition of the entire spatial dataset. However, it is non-trivial to enable approximate k-nearest neighbor query over a spatial data federation. This is because stringent security constraints are often imposed to protect the sensitive, privately owned data partitions, whereas naively extending prior secure query processing solutions leads to high inefficiency (e.g., 100 s per query). In this paper, we propose two novel algorithms for efficient and secure approximate k-nearest neighbor query over a spatial data federation. We theoretically analyze their communication cost and time complexity, and further prove their security guarantees and approximation bounds. Extensive experiments show that our algorithms outperform the state-of-the-art solutions with respect to the query efficiency and often yield a higher accuracy. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Nearest neighbor search

Permutation Invariant Training for Paraphrase Identification 48

学校读者我要写书评

暂无评论

Permutation Invariant Training for Paraphrase Identification

48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023

作者： Bai, Jun Yin, Chuantao Hong, Hanhua Zhang, Jianfei Li, Chen Wang, Yanmeng Rong, Wenge Beihang University State Key Laboratory of Software Development Environment Beijing China Beihang University School of Computer Science and Engineering Beijing China Beihang University Sino-French Engineer School Beijing China Ping An Technology Beijing China

ISBN: (纸本)9781728163277

Identifying sentences sharing similar meanings is crucial to speech and text understandings. Although currently popular cross-encoder solutions with pre-trained language models as backbone have achieved remarkable performance, they suffer from the lack of the permutation invariance or symmetry that is one of the most important inductive biases to such task. To alleviate this issue, in this research we propose a permutation invariant training framework, in which a symmetry regularization is introduced during training that forces the model to produce the same predictions for input sentence pairs in both forward and backward directions. Empirical studies exhibit improved performance over competitive baselines. © 2023 IEEE.

关键词： Paraphrase Identification Permutation Invariance Symmetry Regularization

PPIRB:Achieving an privacy-preserving image retrieval scheme Based on Blockchain 5

学校读者我要写书评

暂无评论

PPIRB:Achieving an privacy-preserving image retrieval scheme...

5th International Conference on Data science and Information Technology, DSIT 2022

作者： Yuan, Bo Peng, Jiahui Li, Chunpei Qiu, Wangjie School of Computer Science and Engineering State Key Laboratory of Software Development Environment Beihang University Beijing100191 China Guangxi Key Lab of Multi-source Information Mining Security Guangxi Normal University GuiLin China State Key Laboratory of Software Development Environment Beihang University Advanced Innovation Center for Future Blockchain and Privacy Computing Beijing100191 China

ISBN: (数字)9781665498685

ISBN: (纸本)9781665498685

With the proliferation of cloud services, the work of large-scale image retrieval is carried out on remote cloud become a trend in order to get rid of the storage burden and computation. However, traditional retrieval work based on centralized cloud services is considered to take risk in giving away users' privacy in many researches. We need a secure way for retrieving and storing images by decentralized approach. In this paper, we propose a decentralized scheme named PPIRB(An Privacy-Preserving Image Retrieval Scheme Base on Blockchain) for retrieving images based on blockchain. We used the data structure called amplifying locality sensitive hashing (ALSH) to improve search accuracy. Searchable symmetric en-cryption(SSE) and ALSH used to realize the encryption retrieval of image index on the blockchain. Our scheme also uses IPFS to replace the cloud server to realize distributed storage, and uses secret sharing scheme to realize the access control. We implemented and evaluated the scheme in Ethereum, and the results show that our scheme is efficient and accurate in finding similar images while preserving privacy. The overall overhead is reasonable. © 2022 IEEE.

关键词： Blockchain

Benchmarking the Physical-world Adversarial Robustness of Vehicle Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhang, Tianyuan Xiao, Yisong Zhang, Xiaoya Li, Hao Wang, Lu School of Computer Science and Engineering Beihang University Beijing China State Key Lab of Software Development Environment Beihang University Beijing China

Adversarial attacks in the physical world can harm the robustness of detection models. Evaluating the robustness of detection models in the physical world can be challenging due to the time-consuming and labor-intensive nature of many experiments. Thus, virtual simulation experiments can provide a solution to this challenge. However, there is no unified detection benchmark based on virtual simulation environment. To address this challenge, we proposed an instant-level data generation pipeline based on the CARLA simulator. Using this pipeline, we generated the DCI dataset and conducted extensive experiments on three detection models and three physical adversarial attacks. The dataset covers 7 continuous and 1 discrete scenes, with over 40 angles, 20 distances, and 20,000 positions. The results indicate that Yolo v6 had strongest resistance, with only a 6.59% average AP drop, and ASA was the most effective attack algorithm with a 14.51% average AP reduction, twice that of other algorithms. Static scenes had higher recognition AP, and results under different weather conditions were similar. Adversarial attack algorithm improvement may be approaching its ’limitation’. Copyright © 2023, The Authors. All rights reserved.

关键词： Pipelines

Further Explanations on "SAT Requires Exhaustive Search"

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Dong, Qingxiu Zhou, Guangyan Xu, Ke School of Computer Science Peking University China Department of Mathematics and Statistics Beijing Technology and Business University China State Key Lab of Software Development Environment Beihang University China

Recently, Xu and Zhou [2023] introduced a constructive approach for exploring computational hardness, proving that SAT requires exhaustive search. In light of certain misinterpretations concerning the contributions and proofs in that paper, we focus on providing detailed explanations in this work. We begin by delineating the core innovation of the constructive approach, shedding light on the pivotal concept of algorithm designability. We address the overlooked white-box diagonalization method and highlight the concept of an almost independent solution space. In response to specific misunderstandings, such as the concerns surrounding the assumptions of Lemma 3.1, we offer comprehensive clarifications aimed at improving the comprehension of the proof. We are grateful for the feedback received on our prior paper and hope this work can foster a more well-informed discussion. Copyright © 2024, The Authors. All rights reserved.

关键词：

On Efficient Packet Batching and Resource Allocation for GPU based NFV Acceleration 31

学校读者我要写书评

暂无评论

On Efficient Packet Batching and Resource Allocation for GPU...

31st IEEE/ACM International Symposium on Quality of Service, IWQoS 2023

作者： Zeng, Deze Zhu, Andong Gu, Lin Chen, Quan Guo, Minyi School of Computer Science China University of Geosciences Hubei Wuhan China Nanjing University State Key Lab. for Novel Software Technology Nanjing China School of Computer Science and Technology Huazhong University of Science and Technology Wuhan China Shanghai Jiao Tong University Department of Computer Science and Engineering Shanghai China

ISBN: (纸本)9798350399738

Network Function Virtualization (NFV) has already become an essential technology for improving the scalability and flexibility of modern computer networks. The performance gap has become the main issue that impedes the development of NFV. GPUs, with massive parallel processors, are advocated to accelerate the Virtualized Network Functions (VNFs). However, the special architecture and workflow of GPUs introduce new challenges, especially on the batched processing, and resource allocation. In this paper, we propose GPU-based NFV Acceleration framework (GNFA) with an efficient packet batching and resource allocation solution. Considering the increased latency caused by the accumulation of the GPU kernel invoking overhead, we first invent a latency reduction mechanism called SM Performance Compensation (SPC). A Partition and Adjustment based Batching and Resource Allocation (PABARA) algorithm that jointly considers batch size tuning and GPU thread allocation is also proposed. We have practically implemented GNFA and extensively evaluated its performance on some well-known VNFs. The experiment results show that GNFA can effectively promote the GPU resource utilization and improve the NFV performance in terms of per-packet latency. © 2023 IEEE.

关键词： Graphics processing unit

A study on the impact of pre-trained model on Just-In-Time defect prediction

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Guo, Yuxiang Gao, Xiaopeng Zhang, Zhenyu Chan, W.K. Jiang, Bo State Key Laboratory of Software Development Environment School of Computer Science and Engineering Beihang University Beijing China State Key Laboratory of Computer Science Institute of Software Chinese Academy of Sciences Beijing China Department of Computer Science City University of Hong Kong Hong Kong

Previous researchers conducting Just-In-Time (JIT) defect prediction tasks have primarily focused on the performance of individual pre-trained models, without exploring the relationship between different pre-trained models as backbones. In this study, we build six models: RoBERTaJIT, CodeBERTJIT, BARTJIT, PLBARTJIT, GPT2JIT, and CodeGPTJIT, each with a distinct pre-trained model as its backbone. We systematically explore the differences and connections between these models. Specifically, we investigate the performance of the models when using Commit code and Commit message as inputs, as well as the relationship between training efficiency and model distribution among these six models. Additionally, we conduct an ablation experiment to explore the sensitivity of each model to inputs. Furthermore, we investigate how the models perform in zero-shot and few-shot scenarios. Our findings indicate that each model based on different backbones shows improvements, and when the backbone’s pre-training model is similar, the training resources that need to be consumed are closer. We also observe that Commit code plays a significant role in defect detection, and different pre-trained models demonstrate better defect detection ability with a balanced dataset under few-shot scenarios. These results provide new insights for optimizing JIT defect prediction tasks using pre-trained models and highlight the factors that require more attention when constructing such models. Additionally, CodeGPTJIT and GPT2JIT achieved better performance than DeepJIT and CC2Vec on the two datasets respectively under 2000 training samples. These findings emphasize the effectiveness of transformer-based pre-trained models in JIT defect prediction tasks, especially in scenarios with limited training data. Copyright © 2023, The Authors. All rights reserved.

关键词： Forecasting

A study on the impact of pre-trained model on Just-In-Time defect prediction

学校读者我要写书评

暂无评论

A study on the impact of pre-trained model on Just-In-Time d...

IEEE International Conference on software Quality, Reliability and Security (QRS)

作者： Yuxiang Guo Xiaopeng Gao Zhenyu Zhang W.K. Chan Bo Jiang State Key Laboratory of Software Development Environment School of Computer Science and Engineering Beihang University Beijing China State Key Laboratory of Computer Science Institute of Software Chinese Academy of Sciences Beijing China Department of Computer Science City University of Hong Kong Hong Kong China

关键词：