检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Zhang, Shaolei Zhang, Kehao Fang, Qingkai Guo, Shoutao Zhou, Yan Liu, Xiaodong Feng, Yang Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences ICT CAS China Key Laboratory of AI Safety Chinese Academy of Sciences China University of Chinese Academy of Sciences Beijing China Research Center of Distributed Systems Institute of Computing Technology Chinese Academy of Sciences ICT CAS China

Large language models (LLMs), with their powerful generative capabilities and vast knowledge, empower various tasks in everyday life. However, these abilities are primarily concentrated in high-resource languages, leaving low-resource languages with weaker generative capabilities and relatively limited knowledge. Enhancing the multilingual capabilities of LLMs is therefore crucial for serving over 100 linguistic communities worldwide. An intuitive approach to enhance the multilingual capabilities would be to construct instruction data for various languages, but constructing instruction data for over 100 languages is prohibitively costly. In this paper, we introduce BayLing 2, which efficiently transfers generative capabilities and knowledge from high-resource languages to low-resource languages through language alignment. To achieve this, we constructed a dataset of 3.2 million instructions, comprising high-resource language instructions (Chinese and English) and cross-lingual instructions for 100+ languages and performed instruction tuning based on the dataset to facilitate the capability transfer between languages. Using Llama as the foundation model, we developed BayLing-2-7B, BayLing-2-13B, and BayLing-2-8B, and conducted a comprehensive evaluation of BayLing. For multilingual translation across 100+ languages, BayLing shows superior performance compared to open-source models of similar scale. For multilingual knowledge and understanding benchmarks, BayLing achieves significant improvements across over 20 low-resource languages, demonstrating its capability of effective knowledge transfer from high-resource to low-resource languages. Furthermore, results on English benchmarks indicate that BayLing maintains high performance in high-resource languages while enhancing the performance in low-resource languages. Demo2, homepage3, code4 and models5of BayLing are available. © 2024, CC BY-NC-ND.

关键词： Benchmarking

来源：评论

学校读者我要写书评

暂无评论

R-calculus for post three-valued description logic 7

R-calculus for post three-valued description logic

引用

7th International Conference on Fuzzy Systems and Data Mining, FSDM 2021

作者： Cao, Cungen Hu, Lanxi Sui, Yuefei Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences China School of Computer Science and Technology University of Chinese Academy of Sciences China

ISBN: (纸本)9781643682143

R-calculus is a belief revision operator satisfying AGM postulates, and belief revision in ontology engineering is ontology revision, which based logic is description logics. In Post three-valued description logic, a tableau proof system Tt will be given such that Tt is sound and complete for t-satisfiability, and nonmonotonic, that is, a theory Δis t-satisfiable if and only if Δis deducible in Tt. Based on the tableau proof system, an R-calculus Rt will be given such that a configuration Î"|C(a) is reducible to C(a),Δif and only if C(a) is t-satisfiable with Î", if and only if reduction Î"|C(a) â‡' C(a),Δis deducible in Rt. © 2021 The authors and IOS Press.

关键词： Ontology

来源：评论

学校读者我要写书评

暂无评论

RIESZ TYPE THEOREMS FOR κ-PLURIHARMONIC MAPPINGS, INVARIANT HARMONIC QUASIREGULAR MAPPINGS AND HARMONIC QUASIREGULAR MAPPINGS

arXiv

引用

arXiv 2023年

作者： Chen, Shaolin Huang, Manzi College of Mathematics and Statistics Hengyang Normal University Hunan Hengyang421002 China Hunan Provincial Key Laboratory of Intelligent Information Processing and Application 421002 China Key Laboratory of High Performance Computing and Stochastic Information Processing College of Mathematics and Statistics Hunan Normal University Hunan Changsha410081 China

The main purpose of this paper is to develop some methods to improve and generalize the main results in a recent paper by Liu and Zhu (Adv. Math., 2023, i.e., [19]). The paper consists of two parts. In the first part, we discuss the Riesz type theorem in the setting of n-dimensional complex spaces for all n ≥ 1. In this part, we first introduce the family of κ-pluriharmonic mappings of the n-dimensional complex unit ball. Then we establish two Riesz type theorems for these mappings, which are the n-dimensional versions of Theorems 1.1 and 1.2 in [19], respectively. Furthermore, even when n = 1, our first result shows that the assumption of the real parts of the mappings not being negative (or being negative) in [19, Theorem 1.1] is redundant;and our second result illustrates that the assumption of "quasiconformality" on the mappings in [19, Theorem 1.2] can be replaced by the weaker one of "quasiregularity". In the second part, we investigate the Riesz type theorem in the setting of n-dimensional real spaces for all n ≥ 2. In this part, first, we prove a Riesz type theorem for invariant harmonic quasiregular mappings of the unit n-dimensional real ball. Our result indicates that (i) the range of the parameter p discussed in [19, Theorem 1.3] can be changed from (1, 2) to (1, ∞);(ii) the assumption of the first coordinate functions of the mappings being non-zero in [19, Theorem 1.3] is redundant. In this way, we complete the discussions carried out in [19, Theorems 1.3 and 1.4]. Second, we obtain a Riesz type theorem for harmonic K-quasiregular mappings of the unit n-dimensional real ball. Our result demonstrates that the range of the parameter p discussed in [15, Theorem 2.1] can be changed from (1, 2) to (1, ∞).MSC Codes 30H10, 30C62 Copyright © 2023, The Authors. All rights reserved.

关键词： Harmonic analysis

来源：评论

学校读者我要写书评

暂无评论

Research on the Security Defense Strategy of Smart City's Substitution Computer Network in Big Data 5

Research on the Security Defense Strategy of Smart City's Su...

引用

5th International Conference on Electronics, Communication and Aerospace Technology, ICECA 2021

作者： Ye, Yuguang Quanzhou Normal University fujian Quanzhou362000 China Fujian Provincial Key Laboratory of Data Intensive Computing fujian Quanzhou362000 China Key Laboratory of Intelligent Computing and Information Processing Fujian Province University fujian Quanzhou362000 China

ISBN: (纸本)9781665435246

With the rapid development of the information technology era, the era of big data has also arrived. While computer networks are promoting the prosperity and development of society, their applications have become more extensive and in-depth. Smart city video surveillance systems have entered an era of networked surveillance and business integration. The problems are also endless. This article discusses computer network security in the era of big data, hoping to help strengthen the security of computer networks in our country. This paper studies the computer network security prevention strategies of smart cities in the era of big data. © 2021 IEEE.

关键词： Big data

来源：评论

学校读者我要写书评

暂无评论

Contrastive Learning of Person-independent Representations for Facial Action Unit Detection

arXiv

引用

arXiv 2024年

作者： Li, Yong Shan, Shiguang The Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information Ministry of Education School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing210094 China The Key Laboratory of Intelligent Information Processing Chinese Academy of Sciences Institute of Computing Technology CAS Beijing100190 China The University of Chinese Academy of Sciences Beijing100049 China Peng Cheng Laboratory Shenzhen518055 China

Facial action unit (AU) detection, aiming to classify AU present in the facial image, has long suffered from insufficient AU annotations. In this paper, we aim to mitigate this data scarcity issue by learning AU representations from a large number of unlabelled facial videos in a contrastive learning paradigm. We formulate the self-supervised AU representation learning signals in two-fold: (1) AU representation should be frame-wisely discriminative within a short video clip;(2) Facial frames sampled from different identities but show analogous facial AUs should have consistent AU representations. As to achieve these goals, we propose to contrastively learn the AU representation within a video clip and devise a cross-identity reconstruction mechanism to learn the person-independent representations. Specially, we adopt a margin-based temporal contrastive learning paradigm to perceive the temporal AU coherence and evolution characteristics within a clip that consists of consecutive input facial frames. Moreover, the cross-identity reconstruction mechanism facilitates pushing the faces from different identities but show analogous AUs close in the latent embedding space. Experimental results on three public AU datasets demonstrate that the learned AU representation is discriminative for AU detection. Our method outperforms other contrastive learning methods and significantly closes the performance gap between the self-supervised and supervised AU detection approaches. © 2024, CC BY.

关键词： Learning systems

来源：评论

学校读者我要写书评

暂无评论

BIG-MOE: BYPASS ISOLATED GATING MOE FOR GENERALIZED MULTIMODAL FACE ANTI-SPOOFING

arXiv

引用

arXiv 2024年

作者： Ma, Yingjie Yu, Zitong Lin, Xun Xie, Weicheng Shen, Linlin Great Bay University China College of Computer Science and Software Engineering Shenzhen University China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

In the domain of facial recognition security, multimodal Face Anti-Spoofing (FAS) is essential for countering presentation attacks. However, existing technologies encounter challenges due to modality biases and imbalances, as well as domain shifts. Our research introduces a Mixture of Experts (MoE) model to address these issues effectively. We identified three limitations in traditional MoE approaches to multimodal FAS: (1) Coarse-grained experts’ inability to capture nuanced spoofing indicators;(2) Gated networks’ susceptibility to input noise affecting decision-making;(3) MoE’s sensitivity to prompt tokens leading to overfitting with conventional learning methods. To mitigate these, we propose the Bypass Isolated Gating MoE (BIG-MoE) framework, featuring: (1) Fine-grained experts for enhanced detection of subtle spoofing cues;(2) An isolation gating mechanism to counteract input noise;(3) A novel differential convolutional prompt bypass enriching the gating network with critical local features, thereby improving perceptual capabilities. Extensive experiments on four benchmark datasets demonstrate significant generalization performance improvement in multimodal FAS task. The code is released at https://***/murInJ/BIGMoE. Copyright © 2024, The Authors. All rights reserved.

关键词： HTTP

来源：评论

学校读者我要写书评

暂无评论

Top-ambiguity samples matter: understanding why deep ensemble works in selective classification 23

Top-ambiguity samples matter: understanding why deep ensembl...

引用

Proceedings of the 37th International Conference on Neural information processing Systems

作者： Qiang Ding Yixuan Cao Ping Luo Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China and University of Chinese Academy of Sciences Beijing China Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China and University of Chinese Academy of Sciences Beijing China and Peng Cheng Laboratory Shenzhen China

Selective classification allows a machine learning model to reject some hard inputs and thus improve the reliability of its predictions. In this area, the ensemble method is powerful in practice, but there has been no solid analysis on why the ensemble method works. Inspired by an interesting empirical result that the improvement of the ensemble largely comes from top-ambiguity samples where its member models diverge, we prove that, based on some assumptions, the ensemble has a lower selective risk than the member model for any coverage within a range. The proof is nontrivial since the selective risk is a non-convex function of the model prediction. The assumptions and the theoretical results are supported by systematic experiments on both computer vision and natural language processing tasks.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Dual Encoders for Diffusion-based Image Inpainting

Dual Encoders for Diffusion-based Image Inpainting

引用

International Conference on Acoustics, Speech, and Signal processing (ICASSP)

作者： Dezhi Zheng Kaijun Deng Jinbao Wang Linlin Shen Computer Vision Institute School of Computer Science and Software Engineering Shenzhen University Shenzhen China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Current diffusion-based inpainting models struggle to preserve unmasked regions or generate highly coherent content. Additionally, it is hard for them to generate meaningful content for 3D inpainting. To tackle these challenges, we design a plug-and-play branch that runs through the entire generation process to enhance existing models. Specifically, we utilize dual encoders - a Convolutional Neural Network (CNN) encoder and the pre-trained Variational AutoEncoder (VAE) encoder, to encode masked images. The latent code and the feature map from the dual encoders are fed to diffusion models simultaneously. In addition, we apply Zero-padded initialization to solve the problem of mode collapse caused by this branch. Experiments on BrushBench and EditBench demonstrate that models with our plug-and-play branch can improve the coherence of inpainting, and our model achieves new state-of-the-art results.

关键词： Visualization Three-dimensional displays Codes Autoencoders Coherence Signal processing Diffusion models Decoding Convolutional neural networks Speech processing

来源：评论

学校读者我要写书评

暂无评论

An Evolutionary Multi-Objective Neural Architecture Search Approach to Advancing cognitive Diagnosis in intelligent Education

引用

IEEE Transactions on Evolutionary Computation 2024年 1-1页

作者： Yang, Shangshang Ma, Haiping Bi, Ying Tian, Ye Zhang, Limiao Jin, Yaochu Zhang, Xingyi School of Artificial Intelligence Anhui University Hefei China Institutes of Physical Science and Information Technology Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education Anhui University Hefei China School of Electrical and Information Engineering Computational Intelligence Laboratory Zhengzhou University Zhengzhou China School of Computer Science and Technology Information Materials and Intelligent Sensing Laboratory of Anhui Province Anhui University Hefei China Information Materials and Intelligent Sensing Laboratory of Anhui Province Anhui University Hefei Anhui China School of Engineering Westlake University Hangzhou China

As a pivotal technique in intelligent education systems, cognitive diagnosis (CD) serves to reveal students’ knowledge proficiency for better tackling subsequent tasks. Unfortunately, due to pursuing high model interpretability, existing manually designed models for CD often hold simplistic architectures, which cannot cope with intricate data in modern education platforms. Furthermore, the bias of human design limits the emergence of novel and effective CD models. To develop interpretable and more effective models, thus this paper proposes an evolutionary multi-objective neural architecture search (NAS) approach for CD. Specifically, we first adopt a comprehensive search space for the NAS task of CD: all candidate models can be encompassed by a general model that deals with three distinct types of inputs. Then, an innovative model interpretability objective is devised to formulate the architecture search task as a bi-objective optimization problem (BOP). To solve the BOP, we employ a multi-objective genetic programming (MOGP) as the search strategy to explore the search space. To make the employed MOGP search well, all architectures are first encoded by trees for easy optimization, and we devise a genetic operation and a population initialization strategy to expedite its convergence. Finally, the proposed approach is actually a MOGP-based NAS approach for CD. Extensive experiments show that CD models searched by the proposed approach exhibit significantly better performance than existing models and hold as good interpretability as handcrafted models. Besides, the effectiveness of the proposed MOGP search strategy, the devised objective, and tailored strategies are validated. IEEE

关键词： Computer architecture

来源：评论

学校读者我要写书评

暂无评论

Hexagonal Convolutional Neural Network for Spatial Transcriptomics Classification

Hexagonal Convolutional Neural Network for Spatial Transcrip...

引用

2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022

作者： Gao, Jing Zhang, Fa Hu, Kai Cui, Xuefeng Xiangtan University Key Laboratory of Intelligent Computing and Information Processing of Ministry of Education Xiangtan China Institute of Computing Technology Chinese Academy of Sciences Beijing China School of Medical Technology Beijing Institute of Technology Beijing China Xiangnan University Key Laboratory of Medical Imaging and Artificial Intelligence of Hunan Province Chenzhou China Shandong University School of Computer Science and Technology Qingdao China

ISBN: (纸本)9781665468190

Recent advances in spatial transcriptomics have enabled the comprehensive measurement of transcriptional profiles while retaining the spatial contextual information. Identifying spatial domains is a critical step in the analysis of spatially resolved transcriptomics. Existing unsupervised methods perform poorly on this task owing to the large amount of noise and dropout events in the transcriptomic profiles. To address this problem, we first extend an unsupervised algorithm to a supervised learning method that can identify useful features and reduce noise hindrance. Second, inspired by the classical convolution in convolutional neural networks (CNNs), we designed a regular hexagonal convolution to compensate for the missing gene expression patterns from adjacent nodes. Compared with the graph convolution in graph neural networks (GNNs), our hexagonal convolution can preserve the relative spatial location information of different nodes in graph-structured data. Third, based on the hexagonal convolution, a novel hexagonal Convolutional Neural Network (hexCNN) is proposed for spatial transcriptomics classification. Finally, we compared the proposed hexCNN with existing methods on the DLPFC dataset. The results show that hexCNN achieves a classification accuracy of 87.2% and an average Rand index (ARI) of 78.2% (1.9% and 3.3% higher than those of GNNs). © 2022 IEEE.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：