检索结果-内蒙古大学图书馆

Collaborative Advances in software and COmputiNg (CASCON), International Conference on

作者： Mustafa Burak Topal Aysun Bozanta Ayse Basar Computer Engineering Bogazici University Istanbul Turkiye Management Information Systems Bogazici University Istanbul Turkiye Data Science Laboratory Toronto Metropolitan University Toronto Canada

ISBN: (数字)9798331504830

ISBN: (纸本)9798331515621

In this study, we explore the performance of large language models (LLMs) and provide insights into the strengths and weaknesses of these models in sentiment analysis. In addition, we explore the impact of various instruction methods and fine-tuning techniques on the models' performance and analyze how sensitive they are to different prompts. Although there are studies comparing LLMs on sentiment analysis tasks, there is a limited number of studies on fine-tuning strategies, instruction variety, and prompt sensitivity of LLMs for sentiment analysis. For this purpose, we used Llama2-7B, Lama3-8B, Mistral-7B, Gemma-7B, and Bloom-7B and compared them with BERT and Roberta. We evaluated fine-tuned and original chat versions with zero and few-shot experiments. We generated various instruction strategies and observed their effects on the performance of the models. We also compared Quantized Low-Rank Adapters (QLoRA) fine-tuning and full fine-tuning with all parameters. The fine-tuned versions performed better compared to the original chat versions on almost all tasks. The fine-tuned and chat versions of Llama3-8B and Mistral-7B outperformed others on these tasks, while the Llama2-7B-chat model often produced invalid responses. Our research indicates that QLoRA is a practical substitute for full fine-tuning, as it lessens computational demands without sacrificing performance. Fine-tuned models were less affected by variations in test prompts compared to chat models. This is likely because their specialized training allows them to better handle queries within their domain. In this exploratory study, we provide insights into the potential of LLMs in sentiment analysis tasks.

关键词： Training Sentiment analysis Analytical models Adaptation models Sensitivity Computational modeling Large language models Collaboration software

来源：评论

学校读者我要写书评

暂无评论

An End-to-End Training Method to Ensemble Bi-Linear Models for Knowledge Graph Completion

An End-to-End Training Method to Ensemble Bi-Linear Models f...

引用

International Conference on Machine Learning and Cybernetics (ICMLC)

作者： Si Cen Han Liu Chao Liu Xiaoying Zou Guoquan Dai Xizhao Wang College of Computer Science and Software Engineering Shenzhen University Shenzhen China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen China

The study of ensemble learning in knowledge graph embedding (KGE) shows that combining multiple individual KGE models can perform better on knowledge graph completion. However, existing KGE ensemble methods ignore the creation of model diversity because these methods independently train individual models, which are short of training interaction. To create rich model diversity, we propose a novel training method for ensemble bilinear models (EBM) for the problem of knowledge graph completion. EBM uses a weighted loss to allow individual KGE models to interact during training. In this way, the relations in the knowledge graph can be automatically modeled by the most appropriate model from the KGE individual ones. The experiments on knowledge graph completion show that EBM has richer diversity and performs better than the single bilinear model and the ensemble methods without interaction.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Modified aquila optimizer for forecasting oil production

引用

Geo-Spatial information Science 2022年第4期25卷 519-535页

作者： Mohammed A.A.Al-qaness Ahmed A.Ewees Hong Fan Ayman Mutahar AlRassas Mohamed Abd Elaziz State Key Laboratory for Information Engineering in Surveying Mapping and Remote SensingWuhan UniversityWuhanChina Systems University of Bisha Department of e-BishaKingdom of Saudi Arabia Department of Computer Damietta UniversityDamiettaEgypt School of Petroleum Engineering China University of Petroleum(East China)QingdaoChina Department of Mathematics Faculty of ScienceZagazig UniversityZagazigEgypt Artificial Intelligence Research Center(AIRC) Ajman UniversityAjman 346United Arab Emirates Faculty of Computer Science&Engineering Galala UniversitySuze 435611Egypt

Oil production estimation plays a critical role in economic plans for local governments and ***,many studies applied different Artificial Intelligence(AI)based meth-ods to estimate oil production in different *** Adaptive Neuro-Fuzzy Inference System(ANFIS)is a well-known model that has been successfully employed in various applica-tions,including time-series ***,the ANFIS model faces critical shortcomings in its parameters during the configuration *** this point,this paper works to solve the drawbacks of the ANFIS by optimizing ANFIS parameters using a modified Aquila Optimizer(AO)with the Opposition-Based Learning(OBL)*** main idea of the developed model,AOOBL-ANFIS,is to enhance the search process of the AO and use the AOOBL to boost the performance of the *** proposed model is evaluated using real-world oil produc-tion datasets collected from different oilfields using several performance metrics,including Root Mean Square Error(RMSE),Mean Absolute Error(MAE),coefficient of determination(R2),Standard Deviation(Std),and computational ***,the AOOBL-ANFIS model is compared to several modified ANFIS models include Particle Swarm Optimization(PSO)-ANFIS,Grey Wolf Optimizer(GWO)-ANFIS,Sine Cosine Algorithm(SCA)-ANFIS,Slime Mold Algorithm(SMA)-ANFIS,and Genetic Algorithm(GA)-ANFIS,***,it is compared to well-known time series forecasting methods,namely,Autoregressive Integrated Moving Average(ARIMA),Long Short-Term Memory(LSTM),Seasonal Autoregressive Integrated Moving Average(SARIMA),and Neural Network(NN).The outcomes verified the high performance of the AOOBL-ANFIS,which outperformed the classic ANFIS model and the compared models.

关键词： Oil production ANFIS opposition-based learning(OBL) Aquila Optimizer(AO) time series forecasting Tahe oilfield Sunah oilfield

来源：评论

学校读者我要写书评

暂无评论

Cyclegan-Based SAR Image Expansion to Enhance Target Detection Performance

Cyclegan-Based SAR Image Expansion to Enhance Target Detecti...

引用

IEEE International Symposium on Geoscience and Remote Sensing (IGARSS)

作者： Fang Zhou Rong Liu Tingting Yang Xiyu Yang School of Computer Science and Information Engineering Hefei University of Technology Hefei China The Intelligent Interconnected Systems Laboratory of Anhui Province Hefei University of Technology Hefei China

ISBN: (数字)9798350360325

ISBN: (纸本)9798350360332

In response to the challenge of limited training samples for synthetic aperture radar (SAR) target detection, a SAR image expansion method based on improved cycle generative adversarial network (CycleGAN) is proposed. First, the structure of the CycleGAN is refined to enhance training efficiency. Then, instance normalization (IN) is incorporated into the residual unit of the CycleGAN to improve the realism of generated SAR images. Finally, SAR target recognition experiments were conducted using the single shot multibox detection (SSD) detection network with VoVNet structure. The experimental results prove that the data expansion method based on CycleGAN can improve the recognition accuracy of SAR targets.

关键词： Training Accuracy Target recognition Geoscience and remote sensing Object detection Generative adversarial networks Radar polarimetry

来源：评论

学校读者我要写书评

暂无评论

FedTC: Enabling Communication-Efficient Federated Learning via Transform Coding

FedTC: Enabling Communication-Efficient Federated Learning v...

引用

IEEE Annual Joint Conference: INFOCOM, IEEE computer and Communications Societies

作者： Yixuan Guan Xuefeng Liu Jianwei Niu Tao Ren State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China Zhongguancun Laboratory Beijing China Zhengzhou University Research Institute of Industrial Technology School of Information Engineering Zhengzhou University Zhengzhou China State Key Laboratory of Intelligent Game Institute of Software Chinese Academy of Sciences Beijing China

ISBN: (数字)9798350383508

ISBN: (纸本)9798350383515

Federated learning (FL) enables distributed training via periodically synchronizing model updates among participants. Communication overhead becomes a dominant constraint of FL since participating clients usually suffer from limited bandwidth. To tackle this issue, top-k based gradient compression techniques are broadly explored in FL context, manifesting powerful capabilities in reducing gradient volumes via picking significant entries. However, previous studies are primarily conducted on the raw gradients where massive spatial redundancies exist and positions of non-zero (top-k) entries vary greatly between gradients, which both impede the achievement of deeper compressions. Top-k may also degrade the performance of trained models due to biased gradient estimations. Targeting the above issues, we propose FedTC, a novel transform coding based compression framework. FedTC transforms gradients into a new domain with more compact energy distributions, which facilitates reducing spatial redundancies and biases in subsequent sparsification. Furthermore, non-zero entries across clients from different rounds become highly aligned in the transform domain, motivating us to partition the gradients into smaller entry blocks with various alignment levels to better exploit these alignments. Lastly, positions and values of non-zero entries are independently compressed in a block-wise manner with our customized designs, through which a higher compression ratio is achieved. Theoretical analysis and extensive experiments consistently demonstrate the effectiveness of our approach.

关键词： Training Quantization (signal) Costs Federated learning Redundancy Transform coding Estimation

来源：评论

学校读者我要写书评

暂无评论

M3OFF: Module-Compositional Model-Free Computation Offloading in Multi-Environment MEC

M3OFF: Module-Compositional Model-Free Computation Offloadin...

引用

IEEE Annual Joint Conference: INFOCOM, IEEE computer and Communications Societies

作者： Tao Ren Zheyuan Hu Jianwei Niu Weikun Feng Hang He State Key Laboratory of Intelligent Game Institute of Software Chinese Academy of Sciences Beijing China State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China Zhongguancun Laboratory Beijing China Zhengzhou University Research Institute of Industrial Technology School of Information Engineering Zhengzhou University Zhengzhou China

ISBN: (数字)9798350383508

ISBN: (纸本)9798350383515

Computation offloading is one of the key issues in mobile edge computing (MEC) that alleviates the tension between user equipment's limited capabilities and mobile application's high requirements. To achieve model-free computation offloading when reliable MEC dynamics are unavailable, deep reinforcement learning (DRL) has become a popular methodology. However, most existing DRL-based offloading approaches are developed for a single MEC environment, with invariant system bandwidth, edge capability, task types, etc., while realistic MEC scenarios tend to be of high diversity. Unfortunately, in multi-MEC environments, DRL-based offloading faces at least two challenges, learning inefficiency and interference of offloading experiences. To address the challenges, we propose a DRL-based Multi-environmental Module-compositional Modelfree computation OFFloading (M 3 OFF) framework. M 3 OFF generates offloading policies using module composition instead of a single DRL network so that learning efficiency could be improved by reusing the same modules and learning interference could be reduced by composing different modules. Furthermore, we design multiple module composition-specific training methods for M 3 OFF, including alternate modules-and-composer updates to improve training stability, loss-regularization to avoid module degeneration, and module-dropout to mitigate overfitting. Extensive experimental results on both simulation and testbed demonstrate that M 3 OFF outperforms the performances of most state-of-the-arts in multi-MEC and reaches close to single-MEC.

关键词： Training Visualization Multi-access edge computing Computational modeling Interference Bandwidth Stability analysis

来源：评论

学校读者我要写书评

暂无评论

Analyzing Infrared Linescan Profiles of Steel Strips for Enhanced Cooling Pattern Prediction

Analyzing Infrared Linescan Profiles of Steel Strips for Enh...

引用

IEEE Industry Applications Society Annual Meeting (IAS)

作者： Rubén Usamentiaga Adrian G. Gayo Francisco J. DelaCalle Dario G. Lema Stefano Sfarra Hai Zhang Department of Computer Science and Engineering University of Oviedo Gijón Asturias Spain Department of Industrial and Information Engineering and Economics (DIIIE) University of L'Aquila L'Aquila Italy Department of Electrical and Computer Engineering Computer Vision and Systems Laboratory (CVSL) Laval University Quebec Canada

ISBN: (数字)9798350372717

ISBN: (纸本)9798350372724

Real-time temperature information is crucial for optimizing cooling processes during steel strip rolling, ensuring the attainment of desired microstructural properties and surface quality at an optimal cooling rate. Infrared line scanners emerge as the preferred choice for temperature measurement in highspeed rolling operations, delivering temperature readings with high resolution and enabling the capture of detailed temperature profiles. By analyzing these profiles, cooling systems can be finely adjusted and precisely controlled to optimize the rolling operation. However, developing effective cooling strategies becomes challenging when dealing with temperature profiles comprising numerous discrete data points, often numbering in the thousands per profile. This study presents an innovative approach that integrates the detection of steel strip boundaries within temperature profiles and subsequent temperature pattern characterization using polynomial fitting. A significant advantage is demonstrated by leveraging the coefficients of Legendre polynomials, which provide a concise description of temperature profile shapes, facilitating straightforward approaches to cooling strategies. By integrating boundary detection with temperature characterization, the system enhances its ability to predict tailored cooling patterns, optimizing cooling efficiency, and enhancing product quality in the manufacturing process. Rigorous testing using both synthetic data and real-world applications in cold and hot rolling validates the proposed system's practical utility and reliability. These results underscore its potential to enhance efficiency and quality in industrial steel manufacturing operations.

关键词： Temperature measurement Temperature sensors Strips Cooling Shape Polynomials Real-time systems Steel Monitoring Testing

来源：评论

学校读者我要写书评

暂无评论

A Simple and Interactive Transformer for Fine-Grained Emotion Detection

IEEE Transactions on Audio, Speech and Language Processing

引用

IEEE Transactions on Audio, Speech and Language Processing 2024年 33卷 347-358页

作者： Dianbo Sui Bo Li Hang Yang Yubo Chen Kang Liu Dianhui Chu Jun Zhao School of Computer Science and Software Engineering Harbin Institute of Technology Weihai China School of Economics Peking University Beijing China Key Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China

Fine-grained emotion detection is a long-standing task in sentiment analysis. One of the crucial challenges in this task is to capture emotion correlations. Previous studies either ignore this challenge or resort to a chain-link structure (e.g. seq2seq), both of which encounter some thorny issues in reality. Unlike previous studies, we approach this challenge by proposing a masked language modeling like mechanism, named masked emotion modeling (MEM), which can capture emotion correlations in a simple but effective manner. Specifically, we augment the transformer model with emotion states and require the transformer model to recover masked emotion states. Furthermore, to fully enhance the effect of the proposed MEM, we also introduce a taxonomy-guided sampling strategy at the training phase and an iterative decoding strategy at the test phase. On two widely used datasets, we demonstrate that our method excels at capturing emotion correlations and achieves state-of-the-art results.

关键词： Correlation Emotion recognition Transformers Training Speech processing Predictive models Micromechanical devices Iterative decoding Adaptation models Electronic mail

来源：评论

学校读者我要写书评

暂无评论

BIG-MOE: BYPASS ISOLATED GATING MOE FOR GENERALIZED MULTIMODAL FACE ANTI-SPOOFING

arXiv

引用

arXiv 2024年

作者： Ma, Yingjie Yu, Zitong Lin, Xun Xie, Weicheng Shen, Linlin Great Bay University China College of Computer Science and Software Engineering Shenzhen University China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

In the domain of facial recognition security, multimodal Face Anti-Spoofing (FAS) is essential for countering presentation attacks. However, existing technologies encounter challenges due to modality biases and imbalances, as well as domain shifts. Our research introduces a Mixture of Experts (MoE) model to address these issues effectively. We identified three limitations in traditional MoE approaches to multimodal FAS: (1) Coarse-grained experts’ inability to capture nuanced spoofing indicators;(2) Gated networks’ susceptibility to input noise affecting decision-making;(3) MoE’s sensitivity to prompt tokens leading to overfitting with conventional learning methods. To mitigate these, we propose the Bypass Isolated Gating MoE (BIG-MoE) framework, featuring: (1) Fine-grained experts for enhanced detection of subtle spoofing cues;(2) An isolation gating mechanism to counteract input noise;(3) A novel differential convolutional prompt bypass enriching the gating network with critical local features, thereby improving perceptual capabilities. Extensive experiments on four benchmark datasets demonstrate significant generalization performance improvement in multimodal FAS task. The code is released at https://***/murInJ/BIGMoE. Copyright © 2024, The Authors. All rights reserved.

关键词： HTTP

来源：评论

学校读者我要写书评

暂无评论

UR4NNV: Neural Network Verification, Under-approximation Reachability Works!

arXiv

引用

arXiv 2024年

作者： Liang, Zhen Wu, Taoran Zhao, Ran Xue, Bai Wang, Ji Yang, Wenjing Deng, Shaojun Liu, Wanwei College of Computer Science and Technology National University of Defense Technology China Institute of Software Chinese Academy of Sciences China School of Computer Science and Technology University of Chinese Academy of Sciences China Key Laboratory of Software Engineering for Complex Systems National University of Defense Technology China

Recently, formal verification of deep neural networks (DNNs) has garnered considerable attention, and over-approximation based methods have become popular due to their effectiveness and efficiency. However, these strategies face challenges in addressing the "unknown dilemma" concerning whether the exact output region or the introduced approximation error violates the property in question. To address this, this paper introduces the UR4NNV verification framework, which utilizes under-approximation reachability analysis for DNN verification for the first time. UR4NNV focuses on DNNs with Rectified Linear Unit (ReLU) activations and employs a binary tree branch-based under-approximation algorithm. In each epoch, UR4NNV under-approximates a sub-polytope of the reachable set and verifies this polytope against the given property. Through a trial-and-error approach, UR4NNV effectively falsifies DNN properties while providing confidence levels when reaching verification epoch bounds and failing falsifying properties. Experimental comparisons with existing verification methods demonstrate the effectiveness and efficiency of UR4NNV, significantly reducing the impact of the "unknown dilemma".MSC Codes 68Q60, 68T07 Copyright © 2024, The Authors. All rights reserved.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：