检索结果-内蒙古大学图书馆

Power Characterization of Memory Intensive Applications: Analysis and Implications 1st

学校读者我要写书评

暂无评论

Power Characterization of Memory Intensive Applications: Ana...

1st International Symposium on Benchmarking, Measuring, and Optimization, Bench 2018

作者： Qiu, Yeliang Jiang, Congfeng Fan, Tiantian Wang, Yumei Zhang, Liangbin Wan, Jian Shi, Weisong Key Laboratory of Complex Systems Modeling and Simulation Ministry of Education Hangzhou Dianzi University Hangzhou310037 China School of Computer Science and Technology Hangzhou Dianzi University Hangzhou310037 China College of Big Data and Software Engineering Zhejiang Wanli University Ningbo China School of Information and Electronic Engineering Zhejiang University of Science and Technology Hangzhou310023 China Department of Computer Science Wayne State University DetroitMI48202 United States

ISBN: (纸本)9783030328122

DRAM is a significant source of server power consumption especially when the server runs memory intensive applications. Current power aware scheduling assumes that DRAM is as energy proportional as other components. However, the non-energy proportionality of DRAM significantly affects the power and energy consumption of the whole server system when running memory intensive applications. Thus good knowledge of server power characterization under memory intensive workloads can help better workload placement with power reduction. In this paper, we investigate the power characteristics of memory intensive applications on real rack servers of different generations. Through comprehensive analysis we find that (1) Server power consumption changes with workload intensity and concurrent execution threads. However, fully utilized memory systems are not the most energy efficient. (2) Powered memory modules of installed memory capacity, i.e. the memory capacity per processor core has significant impact on the application’s performance and server power consumption even if the memory system is not fully utilized. (3) Memory utilization is not always a good indicator for server power consumption when it is running memory intensive applications. Our experiments show that hardware configuration, workload types, as well as concurrently running threads have significant impact on a server’s energy efficiency when running memory intensive applications. Our findings presented in this paper provide useful insights and guidance to system designers, as well as data center operators for energy efficiency aware job scheduling and power reductions. © 2019, Springer Nature Switzerland AG.

关键词： Energy efficiency

NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Yawei Zhang, Kai Timofte, Radu Van Gool, Luc Kong, Fangyuan Li, Mingxi Liu, Songwei Du, Zongcai Liu, Ding Zhou, Chenhui Chen, Jingyi Han, Qingrui Li, Zheyuan Liu, Yingqi Chen, Xiangyu Cai, Haoming Qiao, Yu Dong, Chao Sun, Long Pan, Jinshan Zhu, Yi Zong, Zhikai Liu, Xiaoxiao Hui, Zheng Yang, Tao Ren, Peiran Xie, Xuansong Hua, Xian-Sheng Wang, Yanbo Ji, Xiaozhong Lin, Chuming Luo, Donghao Tai, Ying Wang, Chengjie Zhang, Zhizhong Xie, Yuan Cheng, Shen Luo, Ziwei Yu, Lei Wen, Zhihong Wu, Qi Li, Youwei Fan, Haoqiang Sun, Jian Liu, Shuaicheng Huang, Yuanfei Jin, Meiguang Huang, Hua Liu, Jing Zhang, Xinjian Wang, Yan Long, Lingshun Li, Gen Zhang, Yuanfan Cao, Zuowei Sun, Lei Alexander, Panaetov Wang, Yucong Cai, Minjie Wang, Li Tian, Lu Wang, Zheyuan Ma, Hongbing Liu, Jie Chen, Chao Cai, Yidong Tang, Jie Wu, Gangshan Wang, Weiran Huang, Shirui Lu, Honglei Liu, Huan Wang, Keyan Chen, Jun Chen, Shi Miao, Yuchun Huang, Zimo Zhang, Lefei Ayazoglu, Mustafa Xiong, Wei Xiong, Chengyi Wang, Fei Li, Hao Wen, Ruimian Yang, Zhijing Zou, Wenbin Zheng, Weixin Ye, Tian Zhang, Yuncheng Kong, Xiangzhen Arora, Aditya Zamir, Syed Waqas Khan, Salman Hayat, Munawar Khan, Fahad Shahbaz Gao, Dandan Zhou, Dengwen Ning, Qian Tang, Jingzhu Huang, Han Wang, Yufei Peng, Zhangheng Li, Haobo Guan, Wenxue Gong, Shenghua Li, Xin Liu, Jun Wang, Wanjun Zeng, Kun Lin, Hanjiang Chen, Xinyu Fang, Jinsheng Zhang, Shuhao Zhang, Yuhao Sinha, Abhishek Kumar Moorthi, S. Manthira Dhar, Debajyoti Yang, Hao-Hsiang Huang, Zhi-Kai Chen, Wei-Ting Chang, Hua-En Kuo, Sy-Yen Tan, Wei Chen, Hao Xu, Qian Narang, Pratik Singh, Usneek Sameen, Syed Khaitan, Harsh Yinghua, Liu Tianlin, Zhang Xiaoming, Zhang Meng, Dingxuan Tian, Chunwei Morshed, Mashrur M. Ahsan, Ahmad Omar Computer Vision Lab ETH Zurich Switzerland University of Würzburg Germany ByteDance Shenzhen China State Key Laboratory for Novel Software Technology Nanjing University China ByteDance Inc China NetEase Inc. China Shenzhen Institutes of Advanced Technology CAS China University of Macau China Shanghai AI Lab Shanghai China Nanjing University of Science and Technology China Amazon Web Services United States China Alibaba DAMO Academy EFC Yuhang District Zhejiang Hangzhou China East China Normal University China Youtu Lab Tencent China Megvii Technology China University of Electronic Science and Technology of China China School of Artificial Intelligence Beijing Normal University China Alibaba Group China Bilibili AI China Nankai-Baidu Joint Lab Nankai University Tianjin China Platform Technologies Tencent Online Video China Higher School of Economics Russia Huawei Moscow Research Center Russia Hunan University China Xidian University China Xilinx Technology Beijing Limited China College of Information Science and Engineering Xinjiang University Urumqi China Department of Electronic Engineering Tsinghua University Beijing China Nanjing University China McMaster University Canada School of Telecommunication Engineering Xidian University Xi’an China School of Computer Science Wuhan University Wuhan China School of Mathematical Science University of Electronic Science and Technology of China Chengdu China School of Computer Science The University of Sydney Sydney Australia Aselsan Research Ankara Turkey School of Electronic and Information Engineering South-Central University for Nationalities Wuhan China Guangdong University of Technology China Fujian Normal University Fuzhou University Jimei University China Design Group China Abu Dhabi United Arab Emirates Monash University Melbourne Australia Mohamed bin Zayed University of AI United Arab Emirates North China Electric Power University Changping District Beijing China The School of Art

This paper reviews the NTIRE 2022 challenge on efficient single image super-resolution with focus on the proposed solutions and results. The task of the challenge was to super-resolve an input image with a magnification factor of ×4 based on pairs of low and corresponding high resolution images. The aim was to design a network for single image super-resolution that achieved improvement of efficiency measured according to several metrics including runtime, parameters, FLOPs, activations, and memory consumption while at least maintaining the PSNR of 29.00dB on DIV2K validation set. IMDN is set as the baseline for efficiency measurement. The challenge had 3 tracks including the main track (runtime), sub-track one (model complexity), and sub-track two (overall performance). In the main track, the practical runtime performance of the submissions was evaluated. The rank of the teams were determined directly by the absolute value of the average runtime on the validation set and test set. In sub-track one, the number of parameters and FLOPs were considered. And the individual rankings of the two metrics were summed up to determine a final ranking in this track. In sub-track two, all of the five metrics mentioned in the description of the challenge including runtime, parameter count, FLOPs, activations, and memory consumption were considered. Similar to sub-track one, the rankings of five metrics were summed up to determine a final ranking. The challenge had 303 registered participants, and 43 teams made valid submissions. They gauge the state-of-the-art in efficient single image super-resolution. © 2022, CC BY.

关键词： Chemical activation

NTIRE 2022 Challenge on Stereo Image Super-Resolution: Methods and Results

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Guo, Yulan Wang, Longguang Wang, Yingqian Li, Juncheng Gu, Shuhang Timofte, Radu Chen, Liangyu Chu, Xiaojie Yu, Wenqing Jin, Kai Wei, Zeqiang Guo, Sha Yang, Angulia Zhou, Xiuzhuang Guo, Guodong Xiao, Huaxin Yan, Shen Liu, Yuxiang Cai, Hanxiao Dai, Bin Peng, Feiyue Cao, Pu Nie, Yang Yang, Lu Song, Qing Hu, Xiaotao Xu, Jun Xu, Mai Jing, Junpeng Deng, Xin Xing, Qunliang Qiao, Minglang Guan, Zhenyu Guo, Wenlong Peng, Chenxu Chen, Zan Chen, Junyang Li, Hao Chen, Junbin Li, Weijie Yang, Zhijing Li, Gen Li, Aijin Sun, Lei Zhang, Dafeng Liu, Shizhuo Zhang, Jiangtao Qu, Yanyun Yang, Hao-Hsiang Huang, Zhi-Kai Chen, Wei-Ting Chang, Hua-En Kuo, Sy-Yen Liang, Qiaohui Lin, Jianxin Wang, Yijun Yin, Lianying Zhang, Rongju Zhao, Wei Xiao, Peng Xu, Rongjian Zhang, Zhilu Zuo, Wangmeng Guo, Hansheng Gao, Guangwei Zeng, Tieyong Kim, Joohyeok Kim, HyeonA Park, Eunpil Sim, Jae-Young Pi, Huicheng Zhang, Shunli Zhai, Jucai Zeng, Pengcheng Liu, Yang Ma, Chihao Huang, Yulin Chen, Junying National University of Defense Technology China The Chinese University of Hong Kong Hong Kong The University of Sydney Australia University of Würzburg ETH Zürich Switzerland MEGVII Technology China Peking University China Bigo Technology Pte. Ltd Singapore Smart Healthcare Innovation Lab Beijing University of Posts and Telecommunications China School of Artificial Intelligence Beijing University of Posts and Telecommunications China Head of Institute of Deep Learning Baidu Research College of Systems Engineering National University of Defense Technology China College of Liberal Arts and Sciences National University of Defense Technology China Pattern Recognition and Intelligent Vision Lab Beijing University of Posts and Telecommunications China College of Computer Science Nankai University Tianjin China School of Statistics and Data Science Nankai University Tianjin Singapore Beihang University China Zhejiang University of Technology China Guangdong University of Technology China Tencent OVBU SRC-B Xiamen University China Department of Electrical Engineering National Taiwan University Taiwan Graduate Institute of Electronics Engineering National Taiwan University Taiwan College of Computer Science and Electronic Engineering Hunan University China Harbin Institude of Technology China The Chinese University of Hong Kong Hong Kong Nanjing University of Posts and Telecommunications China Department of Electrical Engineering Ulsan National Institute of Science and Technology Korea Republic of Graduate School of Artificial Intelligence Ulsan National Institute of Science and Technology Korea Republic of Beijing Jiaotong University China City University of Hong Kong Hong Kong South China University of Technology China

In this paper, we summarize the 1st NTIRE challenge on stereo image super-resolution (restoration of rich details in a pair of low-resolution stereo images) with a focus on new solutions and results. This challenge has 1 track aiming at the stereo image super-resolution problem under a standard bicubic degradation. In total, 238 participants were successfully registered, and 21 teams competed in the final testing phase. Among those participants, 20 teams successfully submitted results with PSNR (RGB) scores better than the baseline. This challenge establishes a new benchmark for stereo image SR. Copyright © 2022, The Authors. All rights reserved.

关键词： Stereo image processing

Lessons Learned from Assessing Trustworthy AI in Practice

学校读者我要写书评

暂无评论

Digital Society 2023年第3期2卷 1-25页

作者： Vetter, Dennis Amann, Julia Bruneault, Frédérick Coffee, Megan Düdder, Boris Gallucci, Alessio Gilbert, Thomas Krendl Hagendorff, Thilo van Halem, Irmhild Hickman, Eleanore Hildt, Elisabeth Holm, Sune Kararigas, Georgios Kringen, Pedro Madai, Vince I. Wiinblad Mathez, Emilie Tithi, Jesmin Jahan Westerlund, Magnus Wurth, Renee Zicari, Roberto V. Computational Vision and Artificial Intelligence Lab Goethe University Frankfurt Frankfurt Am Main Germany Z-Inspection® Initiative Venice Italy Health Ethics and Policy Lab ETH Zurich Zurich Switzerland Strategy and Innovation Careum Foundation Zurich Switzerland Philosophie Departement Collège André-Laurendeau Montréal Canada École Des Médias Université du Québec À Montréal Montréal Canada Department of Medicine Division of Infectious Diseases and Immunology New York University Grossman School of Medicine New York City USA Department of Computer Science University of Copenhagen Copenhagen Denmark Digital Life Initiative Cornell Tech New York City USA Cluster of Excellence “Machine Learning: New Perspectives for Science” University of Tuebingen Tuebingen Germany School of Law University of Bristol Bristol UK Center for the Study of Ethics in the Professions Illinois Institute of Technology Chicago USA Department of Business Management and Analytics Arcada University of Applied Sciences Helsinki Finland Department of Food & Resource Economics University of Copenhagen Copenhagen Denmark Department of Physiology Faculty of Medicine University of Iceland Reykjavik Iceland QUEST Centre for Responsible Research Berlin Institute of Health Charité Universitätsmedizin Berlin Berlin Germany Faculty of Computing Engineering and the Built Environment School of Computing and Digital Technology Birmingham City University Birmingham UK Parallel Computing Labs Intel Santa Clara USA School of Economics Innovation and Technology Kristiania University College Oslo Norway Data Science Graduate School Seoul National University Seoul South Korea

Building artificial intelligence (AI) systems that adhere to ethical standards is a complex problem. Even though a multitude of guidelines for the design and development of such trustworthy AI systems exist, these guidelines focus on high-level and abstract requirements for AI systems, and it is often very difficult to assess if a specific system fulfills these requirements. The Z-Inspection® process provides a holistic and dynamic framework to evaluate the trustworthiness of specific AI systems at different stages of the AI lifecycle, including intended use, design, and development. It focuses, in particular, on the discussion and identification of ethical issues and tensions through the analysis of socio-technical scenarios and a requirement-based framework for ethical and trustworthy AI. This article is a methodological reflection on the Z-Inspection® process. We illustrate how high-level guidelines for ethical and trustworthy AI can be applied in practice and provide insights for both AI researchers and AI practitioners. We share the lessons learned from conducting a series of independent assessments to evaluate the trustworthiness of real-world AI systems, as well as key recommendations and practical suggestions on how to ensure a rigorous trustworthiness assessment throughout the lifecycle of an AI system. The results presented in this article are based on our assessments of AI systems in the healthcare sector and environmental monitoring, where we used the framework for trustworthy AI proposed in the Ethics Guidelines for Trustworthy AI by the European Commission’s High-Level Expert Group on AI. However, the assessment process and the lessons learned can be adapted to other domains and include additional frameworks.

关键词：

The Multi-modality Cell Segmentation Challenge: Towards Universal Solutions

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Ma, Jun Xie, Ronald Ayyadhury, Shamini Ge, Cheng Gupta, Anubha Gupta, Ritu Gu, Song Zhang, Yao Lee, Gihun Kim, Joonkee Lou, Wei Li, Haofeng Upschulte, Eric Dickscheid, Timo de Almeida, José Guilherme Wang, Yixin Han, Lin Yang, Xin labagnara, Marco Gligorovski, Vojislav Scheder, Maxime Rahi, Sahand Jamal Kempster, Carly Pollitt, Alice Espinosa, Leon Mignot, Tâm Middeke, Jan Moritz Eckardt, Jan-Niklas Li, Wangkai Li, Zhaoyang Cai, Xiaochen Bai, Bizhe Greenwald, Noah F. Van Valen, David Weisbart, Erin Cimini, Beth A. Cheung, Trevor Brück, Oscar Bader, Gary D. Wang, Bo Peter Munk Cardiac Centre University Health Network TorontoON Canada Department of Laboratory Medicine and Pathobiology University of Toronto TorontoON Canada Vector Institute TorontoON Canada Department of Molecular Genetics University of Toronto TorontoON Canada Donnelly Centre University of Toronto TorontoON Canada Princess Margaret Cancer Centre University Health Network TorontoON Canada School of Medicine and Pharmacy Ocean University of China Qingdao China New Delhi India Laboratory Oncology Dr. BRA-IRCH All India Institute of Medical Sciences New Delhi India Department of Image Reconstruction Nanjing Anke Medical Technology Co. Ltd. Nanjing China Shanghai Artificial Intelligence Laboratory Shanghai China Graduate School of AI KAIST Seoul Korea Republic of Shenzhen Research Institute of Big Data Shenzhen China Shenzhen China Helmholtz AI Research Center Jülich Jülich Germany Faculty of Mathematics and Natural Sciences Institute of Computer Science Heinrich Heine University Düsseldorf Düsseldorf Germany Hinxton United Kingdom Champalimaud Foundation - Centre for the Unknown Lisbon Portugal Department of Bioengineering Stanford University Palo AltoCA United States Tandon School of Engineering New York University New YorkNY United States School of Biomedical Engineering Health Science Center Shenzhen University Shenzhen China Lausanne Switzerland School of Biological Sciences University of Reading Reading United Kingdom Laboratoire de Chimie Bactérienne CNRS Université Aix Marseille UMR Institut de Microbiologie de la Méditerranée Marseille France Department of Internal Medicine I University Hospital Dresden Technical University Dresden Dresden Germany Else Kroener Fresenius Center for Digital Health Technical University Dresden Dresden Germany Department of Automation University of Science and Technology of China Hefei China Institute of Advanced Technology University of Science and Technology of China Hefei Chi

Cell segmentation is a critical step for quantitative single-cell analysis in microscopy images. Existing cell segmentation methods are often tailored to specific modalities or require manual interventions to specify hyper-parameters in different experimental settings. Here, we present a multi-modality cell segmentation benchmark, comprising over 1500 labeled images derived from more than 50 diverse biological experiments. The top participants developed a Transformer-based deep-learning algorithm that not only exceeds existing methods but can also be applied to diverse microscopy images across imaging platforms and tissue types without manual parameter adjustments. This benchmark and the improved algorithm offer promising avenues for more accurate and versatile cell analysis in microscopy imaging. © 2023, CC BY-NC-ND.

关键词： Deep learning

lMFF: Efficient and Scalable layered Materials Force Field on Heterogeneous Many-Core Processors

学校读者我要写书评

暂无评论

lMFF: Efficient and Scalable layered Materials Force Field o...

Supercomputing Conference

作者： Ping Gao Xiaohui Duan Jiaxu Guo Jin Wang Zhenya Song Lizhen Cui Xiangxu Meng Xin Liu Wusheng Zhang Ming Ma Guohui Li Dexun Chen Haohuan Fu Wei Xue Weiguo Liu Guangwen Yang School of Software Shandong University Jinan China National Supercomputing Center in Wuxi Wuxi China Department of Computer Science and Technology Tsinghua University Beijing China College of Computer Science and Technology Jilin University Changchun China Department of Engineering Mechanics Center for Nano and Micro Mechanics Tsinghua University Beijing China Ministry of Natural Resources First Institute of Oceanography and Key Laboratory of Marine Science and Numerical Modeling Qingdao China Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR) Jinan China Engineering Research Center of Digital Media Technology Ministry of Education Jinan China Dalian Institute of Chemical Physics Chinese Academy of Sciences Dalian China Department of Earth System Science Ministry of Education Key Lab for Earth System Modeling Tsinghua University Beijing China

ISBN: (数字)9781450384421

ISBN: (纸本)9781665483902

LAMMPS is one of the most popular Molecular Dynamic (MD) packages and is widely used in the field of physics, chemistry and materials simulation. Layered Materials Force Field (LMFF) is our expansion of the LAMMPS potential function based on the Tersoff potential and inter-layer potential (ILP) in LAMMPS. LMFF is designed to study layered materials such as graphene and boron hexanitride. It is universal and does not depend on any platform. We have also carried out a series of optimizations on LMFF and the optimization work is carried out on the new generation of Sunway supercomputer, called SWLMFF. Experiments show that our implementation is efficient, scalable and portable. When generic LMFF is ported to Intel Xeon Gold 6278C, $2\times$ performance improvement is achieved. For the optimized SWLMFF, the overall performance improvement is nearly $200-330\times$ compared to the original ILP and Tersoff potentials. And SWLMFF has good parallel efficiency of 95%-100% under weak scaling with 2.7 million atoms on a single process. The maximum atomic system simulated by SWLMFF is close to $2^{31}$ atoms. And nanosecond simulations in one day can be realized.

关键词： Program processors Atomic layer deposition High performance computing Force Graphene Supercomputers Optimization

RETRACTED ARTICLE: Automatic detection technology for sports players based on image recognition technology: the significance of big data technology in China’s sports field

学校读者我要写书评

暂无评论

Annals of Operations Research 2022年第1期326卷 97-97页

作者： Li, Hongge Manickam, Adhiyaman Samuel, R. Dinesh Jackson Physical Education Department Changchun University of Technology Changchun China Research Institute for Future Media Computing College of Computer Science and Software Engineering Shenzhen University Shenzhen China Faculty of Technology Design and Environment Visual Artificial Intelligence Lab Oxford Brookes University Oxford UK

GIscience in the Era of Artificial intelligence: A Research Agenda Towards Autonomous GIS

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Li, Zhenlong Ning, Huan Gao, Song Janowicz, Krzysztof Li, Wenwen Arundel, Samantha T. Yang, Chaowei Bhaduri, Budhendra Wang, Shaowen Zhu, A. Xing Gahegan, Mark Shekhar, Shashi Ye, Xinyue McKenzie, Grant Cervone, Guido Hodgson, Michael E. Geoinformation and Big Data Research Lab Department of Geography The Pennsylvania State University University ParkPA United States Department of Geography University of Wisconsin – Madison WI United States STKO Lab Department of Geography and Regional Research University of Vienna Vienna Austria Spatial Analysis Research Center School of Geographical Sciences and Urban Planning Arizona State University AZ United States Center of Excellence for Geospatial Information Science U.S. Geological Survey VA United States NSF Spatiotemporal Innovation Center Department of Geography & Geoinformation Science George Mason University VA United States TN United States CyberGIS Center for Advanced Digital and Spatial Studies Department of Geography and Geographic Information Science University of Illinois Urbana-Champaign IL United States School of Computer Science University of Auckland New Zealand Department of Computer Science & Engineering University of Minnesota MN United States Department of Landscape Architecture & Urban Planning Center for Geospatial Sciences Applications & Technology Texas A&M University TX United States Platial Analysis Lab Department of Geography McGill University Quebec Canada Institute for Computational and Data Sciences Department of Geography The Pennsylvania State University University ParkPA United States Department of Geography University of South Carolina SC United States

The advent of generative AI exemplified by large language models (LLMs) opens new ways to represent and compute geographic information and transcends the process of geographic knowledge production, driving geographic information systems (GIS) towards autonomous GIS. Leveraging LLMs as the decision core, autonomous GIS can independently generate and execute geoprocessing workflows to perform spatial analysis. In this vision paper, we further elaborate on the concept of autonomous GIS and present a conceptual framework that defines its five autonomous goals, five autonomous levels, five core functions, and three operational scales. We demonstrate how autonomous GIS could perform geospatial data retrieval, spatial analysis, and map making with four proof-of-concept GIS agents. We conclude by identifying critical challenges and future research directions, including fine-tuning and self-growing decision-cores, autonomous modeling, and examining the societal and practical implications of autonomous GIS. By establishing the groundwork for a paradigm shift in GIscience, this paper envisions a future where GIS moves beyond traditional workflows to autonomously reason, derive, innovate, and advance geospatial solutions to pressing global challenges. Meanwhile, as we design and deploy increasingly intelligent geospatial systems, we carry a responsibility to ensure they are developed in socially responsible ways, serve the public good, and support the continued value of human geographic insight in an AI-augmented future. © 2025, CC BY.

关键词： Image retrieval

Harnessing multimodal approaches for depression detection using large language models and facial expressions

学校读者我要写书评

暂无评论

Npj mental health research

Npj mental health research 2024年第1期3卷 66页

作者： Misha Sadeghi Robert Richer Bernhard Egger Lena Schindler-Gmelch Lydia Helene Rupp Farnaz Rahimi Matthias Berking Bjoern M Eskofier Machine Learning and Data Analytics Lab (MaD Lab) Department Artificial Intelligence in Biomedical Engineering (AIBE) Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) Erlangen 91052 Germany. misha.sadeghi@fau.de. Machine Learning and Data Analytics Lab (MaD Lab) Department Artificial Intelligence in Biomedical Engineering (AIBE) Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) Erlangen 91052 Germany. Chair of Visual Computing (LGDV) Department of Computer Science Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) Erlangen 91058 Germany. Chair of Clinical Psychology and Psychotherapy (KliPs) Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) Erlangen 91052 Germany. Translational Digital Health Group Institute of AI for Health Helmholtz Zentrum München - German Research Center for Environmental Health Neuherberg 85764 Germany.

Detecting depression is a critical component of mental health diagnosis, and accurate assessment is essential for effective treatment. This study introduces a novel, fully automated approach to predicting depression severity using the E-DAIC dataset. We employ Large Language Models (LLMs) to extract depression-related indicators from interview transcripts, utilizing the Patient Health Questionnaire-8 (PHQ-8) score to train the prediction model. Additionally, facial data extracted from video frames is integrated with textual data to create a multimodal model for depression severity prediction. We evaluate three approaches: text-based features, facial features, and a combination of both. Our findings show the best results are achieved by enhancing text data with speech quality assessment, with a mean absolute error of 2.85 and root mean square error of 4.02. This study underscores the potential of automated depression detection, showing text-only models as robust and effective while paving the way for multimodal analysis.

关键词：