检索结果-内蒙古大学图书馆

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Xiaosong Yuan Chen Shen Shaotian Yan Xiaofeng Zhang Liang Xie Wenxiao Wang Renchu Guan Ying Wang Jieping Ye College of Computer Science and Technology Jilin University and Key Laboratory of Symbolic Computation and Knowledge Engineering MoE Jilin University Alibaba Cloud Computing Shanghai Jiao Tong University College of Computer Science and Technology Zhejiang University of Technology College of Software Zhejiang University

ISBN: (纸本)9798331314385

Zero-shot Chain-of-Thought (CoT) prompting emerges as a simple and effective strategy for enhancing the performance of large language models (LLMs) in real-world reasoning tasks. Nonetheless, the efficacy of a singular, task-level prompt uniformly applied across the whole of instances is inherently limited since one prompt cannot be a good partner for all, a more appropriate approach should consider the interaction between the prompt and each instance meticulously. This work introduces an instance-adaptive prompting algorithm as an alternative zero-shot CoT reasoning scheme by adaptively differentiating good and bad prompts. Concretely, we first employ analysis on LLMs through the lens of information flow to detect the mechanism under zero-shot CoT reasoning, in which we discover that information flows from question to prompt and question to rationale jointly influence the reasoning results most. We notice that a better zero-shot CoT reasoning needs the prompt to obtain semantic information from the question, and then the rationale aggregates sufficient information from the question directly and via the prompt indirectly. On the contrary, lacking any of those would probably lead to a bad one. Stem from that, we further propose an instance-adaptive prompting strategy (IAP) for zero-shot CoT reasoning. Experiments conducted with LLaMA-2, LLaMA-3, and Qwen on math, logic, and commonsense reasoning tasks (e.g., GSM8k, MMLU, Causal Judgement) obtain consistent improvement, demonstrating that the instance-adaptive zero-shot CoT prompting performs better than other task-level methods with some curated prompts or sophisticated procedures, showing the significance of our findings in the zero-shot CoT reasoning mechanism.

关键词：

来源：评论

学校读者我要写书评

暂无评论

WHO IS YOUR RIGHT MIXUP PARTNER IN POSITIVE AND UNLABELED LEARNING 10

WHO IS YOUR RIGHT MIXUP PARTNER IN POSITIVE AND UNLABELED LE...

引用

10th International Conference on Learning Representations, ICLR 2022

作者： Li, Changchun Li, Ximing Feng, Lei Ouyang, Jihong College of Computer Science and Technology Jilin University China College of Computer Science Chongqing University China Imperfect Information Learning Team RIKEN Center for Advanced Intelligence Project Japan Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education China

Positive and Unlabeled (PU) learning targets inducing a binary classifier from weak training datasets of positive and unlabeled instances, which arise in many real-world applications. In this paper, we propose a novel PU learning method, namely Positive and unlabeled learning with Partially Positive Mixup (P3Mix), which simultaneously benefits from data augmentation and supervision correction with a heuristic mixup technique. To be specific, we take inspiration from the decision boundary deviation phenomenon observed in our preliminary experiments, where the learned PU boundary tends to deviate from the fully supervised boundary towards the positive side. For the unlabeled instances with ambiguous predictive results, we select their mixup partners from the positive instances around the learned PU boundary, so as to transform them into augmented instances near to the boundary yet with more precise supervision. Accordingly, those augmented instances may push the learned PU boundary towards the fully supervised boundary, thereby improving the classification performance. Comprehensive experimental results demonstrate the effectiveness of the heuristic mixup technique in PU learning and show that P3Mix can consistently outperform the state-of-the-art PU learning methods. © 2022 ICLR 2022 - 10th International Conference on Learning Representationss. All rights reserved.

关键词： Heuristic methods

来源：评论

学校读者我要写书评

暂无评论

Scalable Precise computation of Shannon Entropy

arXiv

引用

arXiv 2025年

作者： Lai, Yong Tong, Haolong Xu, Zhenghang Yin, Minghao College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University Changchun130012 China School of Computer Science and Information Technology Northeast Normal University Changchun130017 China

Quantitative information flow analyses (QIF) are a class of techniques for measuring the amount of confidential information leaked by a program to its public outputs. Shannon entropy is an important method to quantify the amount of leakage in QIF. This paper focuses on the programs modeled in Boolean constraints and optimizes the two stages of the Shannon entropy computation to implement a scalable precise tool PSE. In the first stage, we design a knowledge compilation language called ADD[∧] that combines Algebraic Decision Diagrams and conjunctive decomposition. ADD[∧] avoids enumerating possible outputs of a program and supports tractable entropy computation. In the second stage, we optimize the model counting queries that are used to compute the probabilities of outputs. We compare PSE with the state-of-the-art probably approximately correct tool EntropyEstimation, which was shown to significantly outperform the existing precise tools. The experimental results demonstrate that PSE solved 55 more benchmarks compared to EntropyEstimation in a total of 441. For 98% of the benchmarks that both PSE and EntropyEstimation solved, PSE is at least 10× as efficient as EntropyEstimation. Copyright © 2025, The Authors. All rights reserved.

关键词： Information leakage

来源：评论

学校读者我要写书评

暂无评论

Independently keypoint Learning for Small Object Semantic Correspondence

SSRN

引用

SSRN 2024年

作者： Jin, Hailong Li, Huiying Jilin University College of Computer Science and Technology Jilin Province Changchun China Key Laboratory of Symbol Computation and Knowledge Engineering Jilin University Changchun130012 China

Semantic correspondence remains a challenging task for establishing correspondences between a pair of images with the same category or similar scenes due to the large intra-class appearance. In this paper, we introduce a novel problem called 'Small Object Semantic Correspondence (SOSC).' This problem is challenging due to the close proximity of keypoints associated with small objects, which results in the fusion of these respective features. It is difficult to identify the corresponding key points of the fused features, and it is also difficult to be recognized. To address this challenge, we propose the keypoint Bounding box-centered Cropping (KBC) method, which aims to increase the spatial separation between keypoints of small objects, thereby facilitating independent learning of these keypoints. The KBC method is seamlessly integrated into our proposed inference pipeline and can be easily incorporated into other methodologies, resulting in significant performance enhancements. Additionally, we introduce a novel framework, named KBCNet, which serves as our baseline model. KBCNet comprises a Cross-Scale Feature Alignment (CSFA) module and an efficient 4D convolutional decoder. The CSFA module is designed to align multi-scale features, enriching keypoint representations by integrating fine-grained features and deep semantic features. Meanwhile, the 4D convolutional decoder, based on efficient 4D convolution, ensures efficiency and rapid convergence. To empirically validate the effectiveness of our proposed methodology, extensive experiments are conducted on three widely used benchmarks: PF-PASCAL, PF-WILLOW, and SPair-71k. Our KBC method demonstrates a substantial performance improvement of 7.5\% on the SPair-71K dataset, providing compelling evidence of its efficacy. © 2024, The Authors. All rights reserved.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

An Enhanced Approach for Few-Shot Segmentation Via Smooth Downsampling Mask and Label Smoothing Loss

SSRN

引用

SSRN 2024年

Few-shot semantic segmentation aims to segment new categories with only a small number of annotated images. Previous methods mainly focused on exploiting the pixel-level correlation between the support image and the query image, combined with attention-based methods, resulting in significant advancements. In this paper, we introduce a new perspective to enhance few-shot segmentation. We identify that utilizing the bilinear interpolation method to downsample the mask leads to the loss of fine-grained information from the target features. To address this issue, we propose a Smooth Downsampling Mask (SDM) method. The SDM method is designed to retain more effective target semantic features by employing a cascaded downsampling approach with a smooth kernel for mask processing. Additionally, we propose a label smoothing loss to further enhance the performance, which provides direct guidance for low-resolution feature map optimization. Notably, our proposed method involves no additional learnable parameters and computes efficiently. To validate the effectiveness of our approach, we conduct extensive experiments on three public benchmarks, PASCAL-5i, COCO-20i, and FSS-1000, and achieve considerable improvements. © 2024, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Vector Quantization: A Case Study on Robust Medical Semantic Segmentation

SSRN

引用

SSRN 2024年

作者： Lang, Yijun Liu, Pingping Zhao, Hongwei Zhou, Qiuzhan College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China School of Mechanical Science and Engineering Jilin University Changchun130025 China College of Communication Engineering Jilin University Changchun130022 China

Pixel-wise medical image segmentation is essential for accurate disease diagnosis and analysis. Although these models exhibit high accuracy and impressive performance, they often face issues of trustworthiness due to their sensitivity to minor perturbations in the original images, which can cause significant deviations in segmentation tasks. To address these challenges, we focus on enhancing both the accuracy and the robustness of these systems against adversarial perturbations. We introduce a robust projection-head that utilizes a non-parametric method, Vector Quantization Momentum (VQM), to increase the hypothesis margin in the input space and reduce disturbances in the feature space. Additionally, we propose a new loss function, Anchor-based Vector Quantization (AVQ), designed to achieve denser pixel-prototype embedding. Our evaluation, using two white-box adversarial attack algorithms across two datasets, demonstrates a defense improvement of up to 14.46%. © 2024, The Authors. All rights reserved.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Injecting Revenue-awareness into Cold-start Recommendation: The Case of Online Insurance

Injecting Revenue-awareness into Cold-start Recommendation: ...

引用

International Conference on Parallel and Distributed Systems (ICPADS)

作者： Yu Li Yi Zhang Helen He Chang Qiang Li College of Computer Science and Technology Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University WeSure Inc. Ping An Technology Shenzhen Co. Ltd

In online insurance, one of the central challenges is the cold-starting of new insurance products, which means there are no previous samples to refer to. Previous studies have mainly focused on improving the prediction accuracy of new items, but they have failed to consider the revenue generated by existing items. As a result, the total revenue may suffer a loss even if new items get conversions. To address this issue, in this paper we propose RACRec, a Revenue-Aware Cold-start Recommendation framework for online insurance. Unlike previous works, RACRec uses a revenue-based objective function to ensure profitability when cold-starting new items. With this dedicated objective, RACRec orchestrates the cold-start and warm-start model by predicting their expected revenue from each user, thereby preserving the total profit. In order to accurately predict revenue, a double-ranking scheme is designed for the warm-start model to mitigate position bias, while an item embedding alignment algorithm is proposed for the cold-start model to learn the revenue of new items from similar old items. Furthermore, a reinforced orchestrate update scheme is designed to eliminate the impact of sparse conversions and continuously update revenue estimation. Extensive offline and online experiments have been conducted to validate the effectiveness of RACRec.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Independently keypoint Learning for Small Object Semantic Correspondence

arXiv

引用

arXiv 2024年

Semantic correspondence remains a challenging task for establishing correspondences between a pair of images with the same category or similar scenes due to the large intra-class appearance. In this paper, we introduce a novel problem called’Small Object Semantic Correspondence (SOSC).’ This problem is challenging due to the close proximity of keypoints associated with small objects, which results in the fusion of these respective features. It is difficult to identify the corresponding key points of the fused features, and it is also difficult to be recognized. To address this challenge, we propose the keypoint Bounding box-centered Cropping (KBC) method, which aims to increase the spatial separation between keypoints of small objects, thereby facilitating independent learning of these keypoints. The KBC method is seamlessly integrated into our proposed inference pipeline and can be easily incorporated into other methodologies, resulting in significant performance enhancements. Additionally, we introduce a novel framework, named KBCNet, which serves as our baseline model. KBCNet comprises a Cross-Scale Feature Alignment (CSFA) module and an efficient 4D convolutional decoder. The CSFA module is designed to align multi-scale features, enriching keypoint representations by integrating fine-grained features and deep semantic features. Meanwhile, the 4D convolutional decoder, based on efficient 4D convolution, ensures efficiency and rapid convergence. To empirically validate the effectiveness of our proposed methodology, extensive experiments are conducted on three widely used benchmarks: PF-PASCAL, PF-WILLOW, and SPair-71k. Our KBC method demonstrates a substantial performance improvement of 7.5% on the SPair-71K dataset, providing compelling evidence of its efficacy. Copyright © 2024, The Authors. All rights reserved.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

Method for Preoperative Prediction of Microvascular Invasion of Hepatocellular Carcinoma

Method for Preoperative Prediction of Microvascular Invasion...

引用

2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022

作者： Zhao, Chen Bai, Tian Chu, Tongjia Wei, Feng Zhang, Fa Jilin University College of Computer Science and Technology Changchun China Ministry of Education Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Changchun China First Hospital of Jilin University General Surgery Center Hepatobiliary and Pancreas Department Changchun China School of Medical Technology Beijing Institute of Technology Beijing China

ISBN: (纸本)9781665468190

Microvascular invasion (MVI) in hepatocellular carcinoma (HCC) is of great guiding significance for the formulating treatment strategies and accessing the prognosis before the surgery. However, in traditional medicine, the gold standard for the diagnosis of MVI is obtained by examining pathological images which can only be obtained by sampling and sectioning tumors after surgery. At this time, MVI results have lost the timeliness of guiding tumor resection surgery. In order to solve this problem, existing studies began to use deep learning-based methods for preoperative prediction of MVI using non-invasive imaging. Most of these methods adopt the fusion methods of multi-sequence images to predict MVI, but fail to make full use of the characteristics of multiply sequences as prior knowledge to combine into the model, resulting in no further improvement of prediction performance. So we propose a multi-sequence image difference and correlation deep learning model. The model can extract the difference and correlation information between sequences from different scales and combine them into the model. To validate proposed model, we collected a data set consists of 120 HCC patients, including 50 MVI-positive patients. Compared with existing studies, our method has greatly improved in all evaluation metrics. © 2022 IEEE.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Efficient Heuristics for Learning Scalable Bayesian Network Classifier from Labeled and Unlabeled Data

SSRN

引用

SSRN 2023年

作者： Wang, Limin Wang, Junjie Guo, Lu Li, Qilong Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Software Jilin University Changchun130012 China College of Instrumentation and Electrical Engineering Jilin University Changchun130012 China

Naive Bayes (NB) is one of the top ten machine learning algorithms whereas its attribute independence assumption rarely holds in practice. A feasible and efficient approach to improving NB is relaxing the assumption by adding augmented edges to the restricted topology of NB. In this paper we prove theoretically that the generalized topology may be a suboptimal solution to model multivariate probability distributions if its fitness to data cannot be measured. Thus we propose to apply log-likelihood function as the scoring function, then introduce an efficient heuristic search strategy to explore high-dependence relationships, and for each iteration the learned topology will be improved to fit data better. The proposed algorithm, called log-likelihood Bayesian classifier (LLBC), can respectively learn two submodels from labeled training set and individual unlabeled testing instance, and then make them work jointly for classification in the framework of ensemble learning. Our extensive experimental evaluations on 36 UCI benchmark datasets reveal that, LLBC demonstrates excellent classification performance and provides a competitive approach to learn from labeled and unlabeled data. © 2023, The Authors. All rights reserved.

关键词： Classification (of information)

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：