检索结果-内蒙古大学图书馆

A Survey on Fairness in Large Language Models

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Li, Yingji Du, Mengnan Song, Rui Wang, Xin Wang, Ying College of Computer Science and Technology Jilin University Changchun130012 China Department of Data Science New Jersey Institute of Technology Newark United States School of Artificial Intelligence Jilin University Changchun130012 China Key Laboratory of Symbol Computation and Knowledge Engineering Jilin University Ministry of Education Changchun130012 China

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream tasks. Unfair LLM systems have undesirable social impacts and potential harms. In this paper, we provide a comprehensive review of related research on fairness in LLMs. Considering the influence of parameter magnitude and training paradigm on research strategy, we divide existing fairness research into oriented to medium-sized LLMs under pre-training and fine-tuning paradigms and oriented to large-sized LLMs under prompting paradigms. First, for medium-sized LLMs, we introduce evaluation metrics and debiasing methods from the perspectives of intrinsic bias and extrinsic bias, respectively. Then, for large-sized LLMs, we introduce recent fairness research, including fairness evaluation, reasons for bias, and debiasing methods. Finally, we discuss and provide insight on the challenges and future directions for the development of fairness in LLMs. Copyright © 2023, The Authors. All rights reserved.

关键词： Computational linguistics

Uncertainty-based Model Acceleration for Cancer Classification in Whole-Slide Images

学校读者我要写书评

暂无评论

Uncertainty-based Model Acceleration for Cancer Classificati...

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Zeyu Gao Anyu Mao Jialun Wu Yang Li Chunbao Wang Caixia Ding Tieliang Gong Chen Li School of Computer Science and Technology Xi’an Jiaotong University Xi’an China Shaanxi Provincial Key Laboratory of Big Data Knowledge Engineering Xi’an Jiaotong University Xi’an China Department of Pathology the First Affiliated Hospital of Xi’an Jiaotong University Xi’an China Department of Pathology Shaanxi Provincial Cancer Hospital Xi’an China

ISBN: (数字)9781665468190

ISBN: (纸本)9781665468206

Computational Pathology (CPATH) offers the possibility for highly accurate and low-cost automated pathological diagnosis. However, the high time cost of model inference is one of the main issues limiting the application of CPATH methods. Due to the large size of Whole-Slide Image (WSI), commonly used CPATH methods divided a WSI into a large number of image patches at relatively high magnification, then predicted each image patch individually, which is time-consuming. In this paper, we propose a novel Uncertainty-based Model Acceleration (UMA) method for reducing the time cost of model inference, thereby relieving the deployment burden of CPATH applications. Enlightened by the slide-viewing process of pathologists, only a few high-uncertain regions are regarded as “suspicious” regions that need to be predicted at high magnification, and most of the regions in WSI are predicted at low magnification, thereby reducing the times of image patch extraction and prediction. Meanwhile, uncertainty estimation ensures prediction accuracy at low magnification. We take two fundamental CPATH classification tasks (i.e., cancer region detection and subtyping) as examples. Extensive experiments on two large-scale renal cell carcinoma classification datasets demonstrate that our UMA can significantly reduce the time cost of model inference while maintaining competitive classification performance.

关键词： Pathology Costs Uncertainty Limiting Hospitals Biological system modeling Computational modeling

Sparse Training data-Based Hyperspectral Image Super Resolution Via ANFIS Interpolation

学校读者我要写书评

暂无评论

Sparse Training Data-Based Hyperspectral Image Super Resolut...

IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)

作者： Jing Yang Changjing Shang Lu Chen Pan Su Qiang Shen School of Automation and Software Engineering Shanxi University Taiyuan China Department of Computer Science Aberystwyth University Aberystwyth UK Insti. of Big Data Science & Industry Shanxi University Taiyuan China Department of Computer Hebei Key Laboratory of Knowledge Computing for Energy & Power Baoding North China Electric Power University China

Hyperspectral image super resolution aims to improve the spatial resolution of given hyperspectral images, which has become a highly attractive topic in the field of image processing. Existing techniques typically focus on super resolution with sufficient training data. However, restricted by data acquisition conditions, certain hyperspectral images or band images are very different to obtain, resulted in insufficient training data. In order to solve this problem, a new hyperspectral image super resolution method is proposed in this paper in an effort to conduct the super resolution task over insufficient (sparse) training data, by applying the recently introduced ANFIS (Adaptive Network-based Fuzzy Inference System) interpolation method. Particularly, the training dataset is divided into several subsets. For the subsets with sufficient training data, the relevant ANFIS models are trained using standard ANFIS learning algorithm, while for the subsets with sparse training data, the corresponding ANFIS models are interpolated through the use of ANFIS interpolation. Experimental results indicate that compared with the methods using sufficient training data, the proposed method can achieve very similar result, showing its effectiveness for situations where only sparse training data is available.

关键词：

Hybrid Local Causal Discovery

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ling, Zhaolong Peng, Honghui Zhang, Yiwen Zhou, Peng Wu, Xingyu Yu, Kui Wu, Xindong School of Computer Science and Technology Anhui University Anhui Hefei230601 China School of Hong Kong Polytechnic University Department of Computing 999077 Hong Kong Key Laboratory of Knowledge Engineering with Big Data the Ministry of Education of China China School of Computer Science and Information Technology Hefei University of Technology Hefei230009 China

Local causal discovery aims to learn and distinguish the direct causes and effects of a target variable from observed data. Existing constraint-based local causal discovery methods use AND or OR rules in constructing the local causal skeleton, but using either rule alone is prone to produce cascading errors in the learned local causal skeleton, and thus impacting the inference of local causal relationships. On the other hand, directly applying score-based global causal discovery methods to local causal discovery may randomly return incorrect results due to the existence of local equivalence classes. To address the above issues, we propose a Hybrid Local Causal Discovery algorithm, called HLCD. Specifically, HLCD initially utilizes a constraint-based approach combined with the OR rule to obtain a candidate skeleton and then employs a score-based method to eliminate redundant portions in the candidate skeleton. Furthermore, during the local causal orientation phase, HLCD distinguishes between V-structures and equivalence classes by comparing the local structure scores between the two, thereby avoiding orientation interference caused by local equivalence classes. We conducted extensive experiments with seven state-of-the-art competitors on 14 benchmark Bayesian network datasets, and the experimental results demonstrate that HLCD significantly outperforms existing local causal discovery algorithms. Copyright © 2024, The Authors. All rights reserved.

关键词：

Generative AI for Deep Reinforcement Learning: Framework, Analysis, and Use Cases

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Sun, Geng Xie, Wenwen Niyato, Dusit Mei, Fang Kang, Jiawen Du, Hongyang Mao, Shiwen College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computing and Data Science Nanyang Technological University Singapore639798 Singapore School of Automation Guangdong University of Technology Guangzhou510006 China Department of Electrical and Electronic Engineering The University of Hong Kong 999077 Hong Kong Department of Electrical and Computer Engineering Auburn University Auburn36830 United States

As a form of artificial intelligence (AI) technology based on interactive learning, deep reinforcement learning (DRL) has been widely applied across various fields and has achieved remarkable accomplishments. However, DRL faces certain limitations, including low sample efficiency and poor generalization. Therefore, we present how to leverage generative AI (GAI) to address these issues above and enhance the performance of DRL algorithms in this paper. We first introduce several classic GAI and DRL algorithms and demonstrate the applications of GAI-enhanced DRL algorithms. Then, we discuss how to use GAI to improve DRL algorithms from the data and policy perspectives. Subsequently, we introduce a framework that demonstrates an actual and novel integration of GAI with DRL, i.e., GAI-enhanced DRL. Additionally, we provide a case study of the framework on UAV-assisted integrated near-field/far-field communication to validate the performance of the proposed framework. Moreover, we present several future directions. Finally, the related code is available at: https://***/GAI-enhanced-DRL. Copyright © 2024, The Authors. All rights reserved.

关键词： Deep reinforcement learning

A Comprehensive Survey on Underwater Image Enhancement Based on Deep Learning

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Cong, Xiaofeng Zhao, Yu Gui, Jie Hou, Junming Tao, Dacheng The School of Cyber Science and Engineering Southeast University Nanjing210000 China The School of Cyber Science and Engineering Southeast University Purple Mountain Laboratories Nanjing China Ministry of Education 210000 China The State Key Laboratory of Millimeter Waves School of Information Science and Engineering Southeast University Nanjing210096 China The College of Computing & Data Science Nanyang Technological University #32 Block N4 #02a-014 50 Nanyang Avenue Singapore639798 Singapore

Underwater image enhancement (UIE) presents a significant challenge within computer vision research. Despite the development of numerous UIE algorithms, a thorough and systematic review is still absent. To foster future advancements, we provide a detailed overview of the UIE task from several perspectives. Firstly, we introduce the physical models, data construction processes, evaluation metrics, and loss functions. Secondly, we categorize and discuss recent algorithms based on their contributions, considering six aspects: network architecture, learning strategy, learning stage, auxiliary tasks, domain perspective, and disentanglement fusion. Thirdly, due to the varying experimental setups in the existing literature, a comprehensive and unbiased comparison is currently unavailable. To address this, we perform both quantitative and qualitative evaluations of state-of-the-art algorithms across multiple benchmark datasets. Lastly, we identify key areas for future research in UIE. A collection of resources for UIE can be found at https://***/YuZhao1999/UIE. Copyright © 2024, The Authors. All rights reserved.

关键词： Network architecture

Towards 6G wireless communication networks:vision, enabling technologies, and new paradigm shifts

学校读者我要写书评

暂无评论

Science China(Information Sciences) 2021年第1期64卷 5-78页

作者： Xiaohu YOU Cheng-Xiang WANG Jie HUANG Xiqi GAO Zaichen ZHANG Mao WANG Yongming HUANG Chuan ZHANG Yanxiang JIANG Jiaheng WANG Min ZHU Bin SHENG Dongming WANG Zhiwen PAN Pengcheng ZHU Yang YANG Zening LIU Ping ZHANG Xiaofeng TAO Shaoqian LI Zhi CHEN Xinying MA Chih-Lin I Shuangfeng HAN Ke LI Chengkang PAN Zhimin ZHENG Lajos HANZO Xuemin (Sherman) SHEN Yingjie Jay GUO Zhiguo DING Harald HAAS Wen TONG Peiying ZHU Ganghua YANG Jun WANG Erik G.LARSSON Hien Quoc NGO Wei HONG Haiming WANG Debin HOU Jixin CHEN Zhe CHEN Zhangcheng HAO Geoffrey Ye LI Rahim TAFAZOLLI Yue GAO H.Vincent POOR Gerhard P.FETTWEIS Ying-Chang LIANG National Mobile Communications Research Laboratory School of Information Science and EngineeringSoutheast University Purple Mountain Laboratories Shanghai Institute of Fog Computing Technology (SHIFT) ShanghaiTech University Research Center for Network Communication Peng Cheng Laboratory State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications National Engineering Laboratory for Mobile Network Technologies Beijing University of Posts and Telecommunications National Key Laboratory of Science and Technology on Communications University of Electronic Science and Technology of China (UESTC) China Mobile Research Institute School of Electronics and Computer Science University of Southampton Department of Electrical and Computer Engineering University of Waterloo Global Big Data Technologies Centre (GBDTC) University of Technology Sydney School of Electrical and Electronic Engineering The University of Manchester LiFi Research and Development Centre Institute for Digital CommunicationsSchool of EngineeringThe University of Edinburgh Huawei Technologies Canada Co. Ltd. Huawei Technologies Department of Electrical Engineering (ISY) Link?ping University Institute of Electronics Communications & Information Technology (ECIT)Queen's University Belfast State Key Laboratory of Millimeter Waves School of Information Science and EngineeringSoutheast University School of Electrical and Computer Engineering Georgia Institute of Technology 5G Innovation Centre University of Surrey Princeton University Vodafone Chair Mobile Communications Systems Technische Universit?t Dresden Center for Intelligent Networking and Communications (CINC) University of Electronic Science and Technology of China (UESTC)

The fifth generation(5G) wireless communication networks are being deployed worldwide from 2020 and more capabilities are in the process of being standardized, such as mass connectivity, ultra-reliability,and guaranteed low latency. However, 5G will not meet all requirements of the future in 2030 and beyond, and sixth generation(6G) wireless communication networks are expected to provide global coverage, enhanced spectral/energy/cost efficiency, better intelligence level and security, etc. To meet these requirements, 6G networks will rely on new enabling technologies, i.e., air interface and transmission technologies and novel network architecture, such as waveform design, multiple access, channel coding schemes, multi-antenna technologies, network slicing, cell-free architecture, and cloud/fog/edge computing. Our vision on 6G is that it will have four new paradigm shifts. First, to satisfy the requirement of global coverage, 6G will not be limited to terrestrial communication networks, which will need to be complemented with non-terrestrial networks such as satellite and unmanned aerial vehicle(UAV) communication networks, thus achieving a space-airground-sea integrated communication network. Second, all spectra will be fully explored to further increase data rates and connection density, including the sub-6GHz, millimeter wave(mmWave), terahertz(THz),and optical frequency bands. Third, facing the big datasets generated by the use of extremely heterogeneous networks, diverse communication scenarios, large numbers of antennas, wide bandwidths, and new service requirements, 6G networks will enable a new range of smart applications with the aid of artificial intelligence(AI) and big data technologies. Fourth, network security will have to be strengthened when developing 6G networks. This article provides a comprehensive survey of recent advances and future trends in these four aspects. Clearly, 6G with additional technical requirements beyond those of 5G will enable f

关键词： 6G vision network architecture air interface and transmission technologies space-air-ground-sea integrated network all spectra artificial intelligence network security

Adaptive structure-constrained robust latent low-rank coding for image recovery

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Zhang, Zhao Wang, Lei Li, Sheng Wang, Yang Zhang, Zheng Zha, Zhengjun Wang, Meng School of Computer Science and Technology Soochow University Suzhou215006 China Key Laboratory of Knowledge Engineering with Big Data Ministry of Education Hefei University of Technology School of Computer Science and Information Engineering Hefei University of Technology Hefei China Department of Computer Science University of Georgia 549 Boyd GSRC AthensGA30602 Shenzhen China School of Information Science and Technology University of Science and Technology of China Hefei China

In this paper, we propose a robust representation learning model called Adaptive Structure-constrained Low-Rank Coding (AS-LRC) for the latent representation of data. To recover the underlying subspaces more accurately, AS-LRC seamlessly integrates an adaptive weighting based block-diagonal structure-constrained low-rank representation and the group sparse salient feature extraction into a unified framework. Specifically, AS-LRC performs the latent decomposition of given data into a low-rank reconstruction by a block-diagonal codes matrix, a group sparse locality-adaptive salient feature part and a sparse error part. To enforce the block-diagonal structures adaptive to different real datasets for the low-rank recovery, AS-LRC clearly computes an auto-weighting matrix based on the locality-adaptive features and multiplies by the low-rank coefficients for direct minimization at the same time. This encourages the codes to be block-diagonal and can avoid the tricky issue of choosing optimal neighborhood size or kernel width for the weight assignment, suffered in most local geometrical structures-preserving low-rank coding methods. In addition, our AS-LRC selects the L2,1-norm on the projection for extracting group sparse features rather than learning low-rank features by Nuclear-norm regularization, which can make learnt features robust to noise and outliers in samples, and can also make the feature coding process efficient. Extensive visualizations and numerical results demonstrate the effectiveness of our AS-LRC for image representation and recovery. Copyright © 2019, The Authors. All rights reserved.

关键词： Recovery

ADA-GAD: Anomaly-Denoised Autoencoders for Graph Anomaly Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： He, Junwei Xu, Qianqian Jiang, Yangbangyan Wang, Zitai Huang, Qingming Key Laboratory of Intelligent Information Processing Institute of Computing Technology CAS Beijing China School of Computer Science and Technology University of Chinese Academy of Sciences Beijing China Institute of Information Engineering CAS Beijing China School of Cyber Security University of Chinese Academy of Sciences Beijing China Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing China

Graph anomaly detection is crucial for identifying nodes that deviate from regular behavior within graphs, benefiting various domains such as fraud detection and social network. Although existing reconstruction-based methods have achieved considerable success, they may face the Anomaly Overfitting and Homophily Trap problems caused by the abnormal patterns in the graph, breaking the assumption that normal nodes are often better reconstructed than abnormal ones. Our observations indicate that models trained on graphs with fewer anomalies exhibit higher detection performance. Based on this insight, we introduce a novel two-stage framework called Anomaly-Denoised Autoencoders for Graph Anomaly Detection (ADA-GAD). In the first stage, we design a learning-free anomaly-denoised augmentation method to generate graphs with reduced anomaly levels. We pretrain graph autoencoders on these augmented graphs at multiple levels, which enables the graph autoencoders to capture normal patterns. In the next stage, the decoders are retrained for detection on the original graph, benefiting from the multi-level representations learned in the previous stage. Meanwhile, we propose the node anomaly distribution regularization to further alleviate Anomaly Overfitting. We validate the effectiveness of our approach through extensive experiments on both synthetic and real-world datasets. Copyright © 2023, The Authors. All rights reserved.

关键词： Anomaly detection