检索结果-内蒙古大学图书馆

EC²Detect: Real-Time Online Video Object Detection in Edge-Cloud Collaborative IoT

IEEE Internet of Things Journal 2022年第20期9卷 20382-20392页

作者： Siyan Guo Cong Zhao Guiqin Wang Jiaqing Yang Shusen Yang National Engineering Laboratory for Big Data Analytics and the School of Mathematics and Statistics Xi’an Jiaotong University Xi’an China Department of Computing Imperial College London London U.K. National Engineering Laboratory for Big Data Analytics and the School of Computer Science and Technology Xi’an Jiaotong University Xi’an China School of Mathematics and Statistics Xi’an Jiaotong University Xi’an China National Engineering Laboratory for Big Data Analytics and Ministry of Education Key Laboratory for Intelligent Networks and Network Security Xi’an Jiaotong University Xi’an China Industrial Artificial Intelligence Center Pazhou Laboratory Guangzhou China

Video object detection is a fundamental technology of intelligent video analytics for Internet of Things (IoT) applications. However, even with extraordinary detection accuracy, predominating solutions based on deep convolutional neural networks (DCNNs) cannot achieve real-time online object detection on video streams with a low end-to-end (E2E) response latency and therefore cannot be applied to proliferating latency-sensitive IoT applications like autonomous driving requiring large-scale intelligent video analytics. To address this issue, we present EC2Detect, an edge-cloud collaborative real-time online video object detection method. Specifically, we propose a tracking-assisted object detection architecture based on edge-cloud collaboration with keyframe selection, where the accurate but heavy object detection is conducted by the Cloud on sparse keyframes adaptively selected according to their semantic variation, and the lightweight object tracking is used to localize and identify objects in other frames at edge devices. Extensive experiments of our real-world prototype demonstrate that, EC2Detect significantly outperforms state-of-the-art methods in terms of processing speed (up to $4.77\times $ faster), E2E latency (up to $8.12 \times $ lower), and edge-cloud bandwidth occupation ( $17 \times $ lower) with an acceptable mAP, which can effectively support large-scale intelligent video analytics in practice. Source code of EC2Detect is available at https://***/ECCDetect/ECCDetect .

关键词： Object detection Image edge detection Streaming media Internet of Things Collaboration Visual analytics Feature extraction

来源：评论

学校读者我要写书评

暂无评论

Protein Structure Prediction Using A New Optimization-Based Evolutionary and Explainable Artificial Intelligence Approach

引用

IEEE Transactions on Evolutionary Computation 2024年第3期29卷 1-1页

作者： Hong, Jun Zhan, Zhi-Hui He, Langchong Xu, Zongben Zhang, Jun School of Computer Science and Engineering South China University of Technology Guangzhou P. R. China Health Science Center School of Pharmacy Xi’an Jiaotong University Xi’an P. R. China National Engineering Laboratory for Big Data Analytics Xi’an Jiaotong University Xi’an P. R. China College of Artificial Intelligence Nankai University Tianjin P. R. China

Protein structure prediction (PSP) is an important scientific problem because it helps humans to understand how proteins perform their biological functions. This paper models the PSP problem as a multi-objective optimization problem with three fast and accurate knowledge-based energy functions. This way, using evolutionary computation (EC)-based artificial intelligence (AI) approach to solve this multi-objective PSP problem to find the optimal structure is explainable. Considering that the multiple populations for multiple objectives (MPMO) framework shows efficient performance in solving lots of multi-objective benchmarks and real-world problems, this paper proposes a new AI approach named improved MPMO-based differential evolution (IMPMO-DE) to solve the multi-objective PSP problem. To our best knowledge, this is the first time that MPMO is applied to PSP, with three novel strategies. First, an adaptive archive-based mutation strategy is proposed to better balance the exploration and exploitation abilities by adaptively using different archive-based mutation operators in different evolutionary stages. Second, a mixed individual transfer strategy is proposed to share search information among the multiple populations to accelerate the convergence speed. Third, an evolvable archive update strategy is proposed to generate more promising solutions through evolving the archived solutions. IMPMO-DE is tested on 28 representative proteins and all the available template-free modeling proteins up to 404 residues in the famous Critical Assessment of Protein Structure Prediction (CASP14) competition. Experimental results show that IMPMO-DE performs better than the compared state-of-the-art EC-based PSP methods and ranks above average compared with all the CASP14 competitors. More importantly, IMPMO-DE is a new efficient AI approach that opens a promising optimization-based evolutionary and explainable way for efficient PSP rather than deep learning approaches like AlphaFold2,

关键词： Evolutionary algorithms

来源：评论

学校读者我要写书评

暂无评论

Serendipity of Sharing: Large-Scale Measurement and analytics for Device-to-Device (D2D) Content Sharing in Mobile Social Networks

Serendipity of Sharing: Large-Scale Measurement and Analytic...

引用

IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks (SECON)

作者： Xiaofei Wang Hui Wang Keqiu Li Shusen Yang Tianpeng Jiang Tianjin Key Laboratory of Advanced Networking Tianjin University Tianjin China National Engineering Laboratory for Big Data Algorithms and Analytics Technology Xi'an Jiaotong University Xi'an China Beijing Anqi Zhilian Technology Co. Ltd. Beijing China

ISBN: (纸本)9781509066001

The heavy multimedia traffic produced by mobile users poses great challenges for the mobile network operators, especially in the areas with large user densities but limited cellular network capacities (e.g. India). Recently, many studies demonstrate that exploiting the device-to- device(D2D) content sharing in offline Mobile Social Networks is a promising solution to cellular data offloading. However, such approaches are based on either unrealistic assumptions, or limited data analytics caused by small data size (e.g. hundreds of MSN users) or single-dimensional feature (e.g. human mobility only), which severely restricts their applications in practice. To address this issue, this paper performs the first large-scale data measurement and multi-feature analytics of D2D content sharing. Specifically, by using Apache Spark over a 20-server cluster, we analyze the behaviors of 30 million users (with 40 billion D2D transmissions and 16 million content files) of Xender, a leading global D2D sharing platform. Several important features are studied, including performance basics, content properties, location relations, meeting dynamics, and social characteristics. Furthermore, as a proof-of-concept study of our analytics, we also develop a multi-feature learning based framework, which demonstrates the large potentials of predicting and recommending D2D sharing activities using machine learning methods.

关键词： Device-to-device communication Mobile computing Videos Multimedia communication Social network services Cellular networks

来源：评论

学校读者我要写书评

暂无评论

An automated workflow for integrating environmental sustainability assessment into parametric part design through standard reference models

引用

Procedia CIRP 2020年 90卷 102-108页

作者： William Z. Bernstein Melissa Tensa Maxwell Praniewicz Soonjo Kwon Devarajan Ramanujan Engineering Laboratory National Institute of Standards and Technology MD USA School of Mechanical Industrial and Manufacturing Engineering Oregon State University OR USA George W. Woodruff School of Mechanical Engineering Georgia Institute of Technology Atlanta GR USA Associate Engineering Laboratory National Institute of Standards and Technology MD USA Korea Advanced Institute of Science and Technology Daejeon Republic of Korea Mechanical Engineering Section & Center for Digitalization Big Data and Data Analytics Aarhus University Aarhus 8000 Denmark

Integrating environmental sustainability assessment into parametric design presents an opportunity for enabling sustainable product design. However, this is a challenging task as quantitative methods for sustainability assessment are poorly integrated with parametric design and optimization tools. Furthermore, current streamlined approaches for computing environmental impact during the design stage often ignore manufacturing-related impacts resulting from the geometric complexity of parts. To address these gaps, we present a systematic workflow for computing environmental indicators from parametric design models. Our workflow utilizes the unit manufacturing process information model to evaluate manufacturing-phase resource consumption from process planning data, and consequently enables quantitative correlation of design parameters to the calculated environmental indicators. We demonstrate our workflow through a case study involving the design of a rigid flange coupling, wherein we evaluate the influence of geometric design parameters on the corresponding environmental impact of the design.

关键词： Life cycle assessment (LCA) Computer aided design (CAD) Computer aided manufacturing (CAM) Screening design

来源：评论

学校读者我要写书评

暂无评论

Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond

arXiv

引用

arXiv 2023年

作者： Xu, Fangzhi Lin, Qika Han, Jiawei Zhao, Tianzhe Liu, Jun Cambria, Erik The School of Computer Science and Technology Xi’an Jiao-tong University Shaanxi Xi’an710049 China The Shaanxi Provincial Key Laboratory of Big Data Knowledge Engineering National Engineering Lab for Big Data Analytics Shaanxi Xi’an710049 China The School of Computer Science and Engineering Nanyang Technological University Singapore

Logical reasoning consistently plays a fundamental and significant role in the domains of knowledge engineering and artificial intelligence. Recently, Large Language Models (LLMs) have emerged as a noteworthy innovation in natural language processing (NLP). However, the question of whether LLMs can effectively address the task of logical reasoning, which requires gradual cognitive inference similar to human intelligence, remains unanswered. To this end, we aim to bridge this gap and provide comprehensive evaluations in this paper. Firstly, to offer systematic evaluations, we select fifteen typical logical reasoning datasets and organize them into deductive, inductive, abductive and mixed-form reasoning settings. Considering the comprehensiveness of evaluations, we include 3 early-era representative LLMs and 4 trending LLMs. Secondly, different from previous evaluations relying only on simple metrics (e.g., accuracy), we propose fine-level evaluations in objective and subjective manners, covering both answers and explanations, including answer correctness, explain correctness, explain completeness and explain redundancy. Additionally, to uncover the logical flaws of LLMs, problematic cases will be attributed to five error types from two dimensions, i.e., evidence selection process and reasoning process. Thirdly, to avoid the influences of knowledge bias and concentrate purely on benchmarking the logical reasoning capability of LLMs, we propose a new dataset with neutral content. Based on the in-depth evaluations, this paper finally forms a general evaluation scheme of logical reasoning capability from six dimensions (i.e., Correct, Rigorous, Self-aware, Active, Oriented and No hallucination). It reflects the pros and cons of LLMs and gives guiding directions for future works. © 2023, CC BY.

关键词： Natural language processing systems

来源：评论

学校读者我要写书评

暂无评论

Training networks in null space of feature covariance for continual learning

arXiv

引用

arXiv 2021年

作者： Wang, Shipeng Li, Xiaorong Sun, Jian Xu, Zongben School of Mathematics and Statistics Xi’an Jiaotong University Xi’an710049 China National Engineering Laboratory of Big Data Algorithms and Analysis Technology Xi’an710049 China Pazhou Lab Guangzhou Guangdong510335 China

In the setting of continual learning, a network is trained on a sequence of tasks, and suffers from catastrophic forgetting. To balance plasticity and stability of network in continual learning, in this paper, we propose a novel network training algorithm called Adam-NSCL, which sequentially optimizes network parameters in the null space of previous tasks. We first propose two mathematical conditions respectively for achieving network stability and plasticity in continual learning. Based on them, the network training for sequential tasks can be simply achieved by projecting the candidate parameter update into the approximate null space of all previous tasks in the network training process, where the candidate parameter update can be generated by Adam. The approximate null space can be derived by applying singular value decomposition to the uncentered covariance matrix of all input features of previous tasks for each linear layer. For efficiency, the uncentered covariance matrix can be incrementally computed after learning each task. We also empirically verify the rationality of the approximate null space at each linear layer. We apply our approach to training networks for continual learning on benchmark datasets of CIFAR-100 and TinyImageNet, and the results suggest that the proposed approach outperforms or matches the state-ot-the-art continual learning approaches. © 2021, CC BY-NC-ND.

关键词： Covariance matrix

来源：评论

学校读者我要写书评

暂无评论

Generative Model-based Feature Knowledge Distillation for Action Recognition

arXiv

引用

arXiv 2023年

作者： Wang, Guiqin Zhao, Peng Shi, Yanjiang Zhao, Cong Yang, Shusen School of Computer Science and Technology Xi’an Jiaotong University China School of Mathematics and Statistics Xi’an Jiaotong University China National Engineering Laboratory for Big Data Analytics Xi’an Jiaotong University China

Knowledge distillation (KD), a technique widely employed in computer vision, has emerged as a de facto standard for improving the performance of small neural networks. However, prevailing KD-based approaches in video tasks primarily focus on designing loss functions and fusing cross-modal information. This overlooks the spatial-temporal feature semantics, resulting in limited advancements in model compression. Addressing this gap, our paper introduces an innovative knowledge distillation framework, with the generative model for training a lightweight student model. In particular, the framework is organized into two steps: the initial phase is Feature Representation, wherein a generative model-based attention module is trained to represent feature semantics;Subsequently, the Generative-based Feature Distillation phase encompasses both Generative Distillation and Attention Distillation, with the objective of transferring attention-based feature semantics with the generative model. The efficacy of our approach is demonstrated through comprehensive experiments on diverse popular datasets, proving considerable enhancements in video action recognition task. Moreover, the effectiveness of our proposed framework is validated in the context of more intricate video action detection task. Our code is available at https://***/aaai24/Generative-based-KD. Copyright © 2023, The Authors. All rights reserved.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention

arXiv

引用

arXiv 2024年

作者： An, Wenbin Tian, Feng Leng, Sicong Nie, Jiahao Lin, Haonan Wang, Qianying Chen, Ping Zhang, Xiaoqin Lu, Shijian Xi’an Jiaotong University China National Engineering Laboratory for Big Data Analytics China Nanyang Technological University Singapore Lenovo Research University of Massachusetts Boston United States Zhejiang University of Technology China

Despite great success across various multimodal tasks, Large Vision-Language Models (LVLMs) often encounter object hallucinations with generated textual responses being inconsistent with the actual objects in images. We examine different LVLMs and pinpoint that one root cause of object hallucinations lies with deficient attention on discriminative image features. Specifically, LVLMs often predominantly attend to prompt-irrelevant global features instead of prompt-relevant local features, undermining their visual grounding capacity and leading to object hallucinations. We propose Assembly of Global and Local Attention (AGLA), a training-free and plug-and-play approach that mitigates hallucinations by assembling global features for response generation and local features for visual discrimination simultaneously. Specifically, we introduce an image-prompt matching scheme that captures prompt-relevant local features from images, leading to an augmented view of the input image where prompt-relevant content is highlighted while irrelevant distractions are suppressed. Hallucinations can thus be mitigated with a calibrated logit distribution that is from generative global features of the original image and discriminative local features of the augmented image. Extensive experiments show the superiority of AGLA in LVLM hallucination mitigation, demonstrating its wide applicability across both discriminative and generative tasks. Our code is available at https://***/Lackel/AGLA. © 2024, CC BY.

关键词： Visual languages

来源：评论

学校读者我要写书评

暂无评论

GPTR: Gestalt-Perception Transformer for Diagram Object Detection

arXiv

引用

arXiv 2022年

作者： Hu, Xin Zhang, Lingling Liu, Jun Fan, Jinfu You, Yang Wu, Yaqiang Shaanxi Provincial Key Laboratory of Big Data Knowledge Engineering School of Computer Science and Technology Xi’an Jiaotong University China National Engineering Lab for Big Data Analytics Xi’an Jiaotong University China Department of Control Science and Engineering Tongji University Shanghai China Department of Computer Science National University of Singapore Singapore Lenovo Research Beijing China

Diagram object detection is the key basis of practical applications such as textbook question answering. Because the diagram mainly consists of simple lines and color blocks, its visual features are sparser than those of natural images. In addition, diagrams usually express diverse knowledge, in which there are many low-frequency object categories in diagrams. These lead to the fact that traditional data-driven detection model is not suitable for diagrams. In this work, we propose a gestalt-perception transformer model for diagram object detection, which is based on an encoder-decoder architecture. Gestalt perception contains a series of laws to explain human perception, that the human visual system tends to perceive patches in an image that are similar, close or connected without abrupt directional changes as a perceptual whole object. Inspired by these thoughts, we build a gestalt-perception graph in transformer encoder, which is composed of diagram patches as nodes and the relationships between patches as edges. This graph aims to group these patches into objects via laws of similarity, proximity, and smoothness implied in these edges, so that the meaningful objects can be effectively detected. The experimental results demonstrate that the proposed GPTR achieves the best results in the diagram object detection task. Our model also obtains comparable results over the competitors in natural image object detection. Copyright © 2022, The Authors. All rights reserved.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

Joint Energy and Frequency Regulation Market Clearing Considering Wind Power Uncertainty

Joint Energy and Frequency Regulation Market Clearing Consid...

引用

IEEE/IAS Industrial and Commercial Power System Asia (I&CPS Asia)

作者： Yemin Wu Jiyao Wang Chenyu Peng Chunyu Chen Xuemei Dai Jianxiao Wang School of Electrical Engineering China University of Mining and Technology Xuzhou China School of Electrical Engineering Shanghai Electric Power University Shanghai China National Engineering Laboratory of Big Data Analytics and Applied Technologies Peking University Beijing China

Efficient integration of renewable power such as wind energy in electricity markets is among the highest priorities. However, the deterministic market designs may not effectively adapt to the uncertainty of renewable power. In this paper, we investigate a joint energy and frequency regulation market clearing considering wind power uncertainty. By introducing the chance-constrained market design, we propose a joint market-clearing strategy for both conventionally deterministic units and uncertain wind farms. By the simulation based on real market data, we show that as the confidence level increases, system stability improves, but this comes at the expense of increased wind abandonment losses and higher operating costs in the market. Simultaneously, a higher penetration of wind power leads to lower market operating costs and energy shadow prices.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：