检索结果-内蒙古大学图书馆

computerized adaptive testing Framework Based on Excitation Block and Gumbel-Softmax

IEEE ACCESS 2025年 13卷 3475-3484页

作者： Liu, Chengsong Wei, Yan Chongqing Normal Univ Coll Comp & Informat Sci Chongqing 401331 Peoples R China Chongqing Engn Res Ctr Educ Big Data Intelligent P Chongqing 401331 Peoples R China

computerized adaptive testing (CAT) is a personalized assessment method that adaptively selects the most suitable questions for students of different abilities based on their response data. Its primary goal is to effectively measure students' proficiency in a specific subject in a shorter period. The selection algorithm is pivotal in CAT. The current algorithms inadequately consider the impact of knowledge concept weights in question and student potential factors (e.g., memory) on question selection. In addition, most algorithms primarily focus on accurately predicting students' abilities, neglecting critical factors such as concept diversity and question exposure rate, which are essential for model effectiveness. Therefore, this paper introduces a new framework for CAT, GECAT. It proposes a selection algorithm based on an excitation block to learn the weights of each knowledge concept in the questions and analyze the impact of student potential factors on their answering performance, thereby selecting more suitable questions for students. Additionally, it views CAT as reinforcement learning, introducing Gumbel-Softmax to provide students with diverse, non-repetitive, and valuable test questions. The experimental results on three real-world datasets demonstrate that the proposed CAT framework improves ACC and AUC by 0.71% and 0.86%, respectively, while reducing question exposure rate and overlap rate by 1.33% and 1.59%, respectively.

关键词： testing Reinforcement learning Prediction algorithms Accuracy Optimization Computational modeling Adaptation models Technological innovation Predictive models Metalearning computerized adaptive testing Gumbel-Softmax excitation block potential factors

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing to Balance Exposure Bias and Measurement Accuracy Using Zero-Suppressed Binary Decision Diagrams

引用

IEEE ACCESS 2025年 13卷 33883-33903页

作者： Ueno, Maomi Fuchimoto, Kazuma Kishida, Wakaba Miyazawa, Yoshimitsu Univ Electrocommun Grad Sch Informat & Engn Tokyo 1828585 Japan Natl Ctr Univ Entrance Examinat Res & Dev Tokyo 1530041 Japan

computerized adaptive testing (CAT) presents a tradeoff dilemma involving item exposure bias and measurement accuracy. To resolve this dilemma, we propose a new two-step CAT mechanism to balance exposure bias and measurement accuracy. Using zero-suppressed binary decision diagram (ZDD), the proposed method first selects and presents an optimal item from an equivalent item pool, which uniformly divides the whole item pool. The first step rapidly provides a roughly approximated ability estimate of an examinee. The second step produces a more accurate ability estimate of the examinee. Specifically, the second step selects an optimal item from the whole item pool and presents an item with a difficulty parameter value that is approximately equal to the examinee ability estimate. Numerical experiment results underscore the effectiveness of the proposed method.

关键词： Accuracy testing Probabilistic logic IP networks History Binary decision diagrams Standards Upper bound Gaussian distribution Current measurement computerized adaptive testing item response theory parallel test assembly zero-suppressed binary decision diagrams

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing to screen pre-school children for emotional and behavioral problems

引用

EUROPEAN JOURNAL OF PEDIATRICS 2024年第4期183卷 1777-1787页

作者： Theunissen, Meinou H. C. Eekhout, Iris Reijneveld, Sijmen A. Netherlands Org Appl Sci Res TNO Child Hlth Leiden Netherlands Univ Groningen Univ Med Ctr Groningen Dept Hlth Sci Groningen Netherlands

Questionnaires to detect emotional and behavioral (EB) problems in preventive child healthcare (PCH) should be short;this potentially affects their validity and reliability. computerized adaptive testing (CAT) could overcome this weakness. The aim of this study was to (1) develop a CAT to measure EB problems among pre-school children and (2) assess the efficiency and validity of this CAT. We used a Dutch national dataset obtained from parents of pre-school children undergoing a well-child care assessment by PCH (n = 2192, response 70%). Data regarded 197 items on EB problems, based on four questionnaires, the Strengths and Difficulties Questionnaire (SDQ), the Child Behavior Checklist (CBCL), the Ages and Stages Questionnaire: Social Emotional (ASQ:SE), and the Brief Infant-Toddler Social and Emotional Assessment (BITSEA). Using 80% of the sample, we calculated item parameters necessary for a CAT and defined a cutoff for EB problems. With the remaining part of the sample, we used simulation techniques to determine the validity and efficiency of this CAT, using as criterion a total clinical score on the CBCL. Item criteria were met by 193 items. This CAT needed, on average, 16 items to identify children with EB problems. Sensitivity and specificity compared to a clinical score on the CBCL were 0.89 and 0.91, respectively, for total problems;0.80 and 0.93 for emotional problems;and 0.94 and 0.91 for behavioral problems. Conclusion: A CAT is very promising for the identification of EB problems in pre-school children, as it seems to yield an efficient, yet high-quality identification. This conclusion should be confirmed by real-life administration of this CAT. What is Known:center dot Studies indicate the validity of using computerized adaptive test (CAT) applications to identify emotional and behavioral problems in school-aged *** dot Evidence is as yet limited on whether CAT applications can also be used with pre-school *** is New:center dot The

关键词： Screening computerized adaptive testing Preventive child healthcare Pre-school children Emotional and behavioral problems

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing for the patient evaluation measure (PEM) in patients undergoing cubital tunnel syndrome surgery

引用

JOURNAL OF HAND SURGERY-EUROPEAN VOLUME 2023年第10期48卷 1042-1047页

作者： Teunissen, Joris S. Hovius, Steven E. R. Ulrich, Dietmar J. O. Issa, Fadi Rodrigues, Jeremy N. Harrison, Conrad J. Radboud Univ Nijmegen Radboud Inst Hlth Sci Dept Plast Reconstruct & Hand Surg Med Ctr Nijmegen Gelderland Netherlands Univ Oxford John Radcliffe Hosp Nufffield Dept Surg Sci Oxford England Buckinghamshire Healthcare NHS Trust Stoke Mandeville Hosp Dept Plast Surg Aylesbury England Univ Warwick Clin Trials Unit Coventry England Univ Oxford Nuffield Dept Orthopaed Rheumatol & Musculoskeleta Oxford England

In outcome measures, item response theory (IRT) validation can deliver interval-scaled high-quality measurement that can be harnessed using computerized adaptive tests (CATs) to pose fewer questions to patients. We aimed to develop a CAT by developing an IRT model for the Patient Evaluation Measure (PEM) for patients undergoing cubital tunnel syndrome (CuTS) surgery. Nine hundred and seventy-nine completed PEM responses of patients with CuTS in the United Kingdom Hand Registry were used to develop and calibrate the CAT. Its performance was then evaluated in a simulated cohort of 1000 patients. The CAT reduced the original PEM length from ten to a median of two questions (range two to four), while preserving a high level of precision (median standard error of measurement of 0.27). The mean error between the CAT score and full-length score was 0.08%. A Bland-Altman analysis showed good agreement with no signs of bias. The CAT version of the PEM can substantially reduce patient burden while enhancing construct validity by harnessing IRT for patients undergoing CuTS surgery.

关键词： Patient-Reported Outcome Measures cubital tunnel syndrome computerized adaptive testing surgical procedures

来源：评论

学校读者我要写书评

暂无评论

Multidimensional Hybrid computerized adaptive testing Based on Multidimensional Item Response Theory

引用

IEEE ACCESS 2024年 12卷 169079-169101页

作者： Shao, Mingyu Sun, Jianan Li, Jingwen Wang, Shiyu Lai, Yinghui Beijing Forestry Univ Coll Sci Beijing 100083 Peoples R China Univ Georgia Dept Educ Psychol Athens GA 30602 USA Hunan Inst Sci & Technol Sch Educ Sci Yueyang 414006 Hunan Peoples R China

computerized adaptive testing (CAT) and multistage adaptive testing (MST) are widely used to deliver assessment questions in the fields of psychometrics, educational measurement, and medical assessments. Hybrid computerized adaptive testing (HCAT), as a novel and flexible approach that incorporates both modular and adaptively-selected items, effectively integrates the CAT and MST, and inherits their respective strengths. Current HCAT focuses on unidimensional assessments, yet practical applications often require multidimensional assessments. Multidimensional item response theory (MIRT) models can provide accurate measurement of examinees' multidimensional latent traits. Based on the MIRT models, this study proposes an innovative approach for constructing multidimensional hybrid computerized adaptive testing (MHCAT), aimed at better accommodating complex testing demands. Simulation studies were conducted to evaluate MHCAT using both dichotomous and polytomous items. Results indicated that, the fixed-length MHCAT achieved similar estimation accuracy to the fixed-length multidimensional CAT (MCAT), and the variable-length MHCAT had slightly higher estimation accuracy than the variable-length MCAT. Regarding item exposure control, both the fixed-length and variable-length MHCAT performed better than the MCAT. Empirical studies further validated the feasibility of MHCAT with several MIRT models. In summary, the proposed MHCAT presents promising performance in assessing examinees' abilities while maintaining satisfactory item exposure control, providing a valuable approach for multidimensional assessments.

关键词： testing Estimation Accuracy Adaptation models Computational modeling Vectors Complexity theory Routing Reliability Multidimensional systems Ability estimation accuracy computerized adaptive testing item exposure control multidimensional hybrid computerized adaptive testing multidimensional item response theory multidimensional multistage adaptive testing

来源：评论

学校读者我要写书评

暂无评论

Psychometric evaluation and computerized adaptive testing simulations of age-related macular degeneration quality of life item banks

引用

ASIA-PACIFIC JOURNAL OF OPHTHALMOLOGY 2025年第2期14卷 100178-100178页

作者： Fenwick, Eva K. Man, Ryan E. K. Tan, Anna C. S. Najjar, Raymond P. Milea, Dan Lee, Ester P. X. Wong, Tien Yin Tan, Gavin S. W. Chan, Hwei Wuen Laude, Augustinus Teo, Kelvin Y. C. Lee, Shu Yen Yeo, Ian Yew San Mathur, Ranjana Cheung, Gemmy C. M. Lamoureux, Ecosse L. Singapore Natl Eye Ctr Singapore Eye Res Inst Singapore Singapore Natl Univ Singapore Duke Natl Univ Singapore NUS Med Sch Singapore Singapore Natl Univ Singapore Yong Loo Lin Sch Med Dept Ophthalmol Singapore Singapore Natl Univ Singapore Coll Design & Engn Dept Biomed Engn Singapore Singapore Tsinghua Univ Tsinghua Med Beijing Peoples R China Tan Tock Seng Hosp Eye Inst Natl Healthcare Grp Singapore Singapore Univ Melbourne Melbourne Australia

Purpose: To optimize the psychometric properties of age-related macular degeneration (AMD) quality of life (QoL) item banks (IBs), and evaluate their performance using computerized adaptive testing (CAT) simulations. Design: Cross-sectional, clinical study. Methods: 261 AMD patients answered 219 items within seven IBs: Activity Limitation (AL);Lighting (LT);Mobility (MB);Emotional (EM);Concerns (CN);AMD Management (AM);and Work (WK), referred to collectively as "MacCAT". The psychometric properties of each IB (e.g. measurement precision;item "fit";differential item functioning (DIF)) were assessed using Rasch analysis. The mean number of items required for "high" and "moderate" measurement precision was determined using CAT simulations. Results: Of the 261 participants (mean age 70.5 +/- 7.6 years), 69 (26.4 %), 35 (13.4 %), 80 (30.7 %) and 77 (29.5 %) had no, early, intermediate and late AMD (better eye), respectively. AL, EM, CN and AM displayed good psychometric properties overall after collapsing response categories and deleting items for misfit and/or DIF. Despite similar reengineering efforts, LT and MB had suboptimal measurement precision but were retained due to otherwise good psychometric performances. Owing to unresolvable psychometric issues, WK was not considered further. Targeting for all IBs was suboptimal. In CAT simulations on the six remaining IBs, the mean number of items required per IB ranged from 8 (AL) to 13 (MB) for moderate, and 13 (AL) to19 (MB) for high measurement precision. Conclusions: Six IBs demonstrated acceptable psychometric properties and potential CAT efficiency, suggesting MacCAT provides a comprehensive measurement of the QoL impact of AMD and associated treatments. Further testing in larger clinical cohorts is needed.

关键词： Age-related macular degeneration Quality of life Item banks Rasch analysis computerized adaptive testing

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing: A Unified Approach Under Markov Decision Process 22nd

Computerized Adaptive Testing: A Unified Approach Under Mark...

引用

22nd International Conference on Computational Science and its Applications (ICCSA)

作者： Gilavert, Patricia Freire, Valdinei Univ Sao Paulo Sch Arts Sci & Humanities Sao Paulo Brazil

ISBN: (纸本)9783031105227;9783031105210

Markov Decision Process (MDP) is the most common planning framework in the literature for sequential decisions under probabilistic outcomes;MDPs also underlies the Reinforcement Learning (RL) theory. computerized adaptive testing (CAT) is an assessment approach that selects questions one after another while conditioning each selection on the previous questions and answers. While MDP defines a well-posed optimization planning-problem, shortsighted score functions have solved the planning problem in CATs. Here, we show how MDP can model different formalisms for CAT, and, therefore, why the CAT community may benefit from MDP algorithms and theory. We also apply an MDP algorithm to solve a CAT, and we compare it against traditional score functions from CAT literature.

关键词： computerized adaptive testing Markov Decision Process

来源：评论

学校读者我要写书评

暂无评论

A two-step item bank calibration strategy based on 1-bit matrix completion for small-scale computerized adaptive testing

引用

BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY 2024年第3期77卷 553-612页

作者： Shen, Yawei Wang, Shiyu Xiao, Houping Univ Georgia Dept Educ Psychol 325N Aderhold Hall Athens GA 30602 USA Georgia State Univ Inst Insight Atlanta GA USA

computerized adaptive testing (CAT) is a widely embraced approach for delivering personalized educational assessments, tailoring each test to the real-time performance of individual examinees. Despite its potential advantages, CAT's application in small-scale assessments has been limited due to the complexities associated with calibrating the item bank using sparse response data and small sample sizes. This study addresses these challenges by developing a two-step item bank calibration strategy that leverages the 1-bit matrix completion method in conjunction with two distinct incomplete pretesting designs. We introduce two novel 1-bit matrix completion-based imputation methods specifically designed to tackle the issues associated with item calibration in the presence of sparse response data and limited sample sizes. To demonstrate the effectiveness of these approaches, we conduct a comparative assessment against several established item parameter estimation methods capable of handling missing data. This evaluation is carried out through two sets of simulation studies, each featuring different pretesting designs, item bank structures, and sample sizes. Furthermore, we illustrate the practical application of the methods investigated, using empirical data collected from small-scale assessments.

关键词： computerized adaptive testing item bank item response theory missing data

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing for Ipsative Tests with Multidimensional Pairwise-Comparison Items: Algorithm Development and Applications

引用

APPLIED PSYCHOLOGICAL MEASUREMENT 2022年第4期46卷 255-272页

作者： Qiu, Xue-Lan de la Torre, Jimmy Ro, Sage Wang, Wen-Chung Univ Hong Kong Hong Kong Peoples R China SA St Paul MN USA Educ Univ Hong Kong Hong Kong Peoples R China

A computerized adaptive testing (CAT) solution for tests with multidimensional pairwise-comparison (MPC) items, aiming to measure career interest, value, and personality, is rare. This paper proposes new item selection and exposure control methods for CAT with dichotomous and polytomous MPC items and present simulation study results. The results show that the procedures are effective in selecting items and controlling within-person statement exposure with no loss of efficiency. Implications are discussed in two applications of the proposed CAT procedures: a work attitude test with dichotomous MPC items and a career interest assessment with polytomous MPC items.

关键词： computerized adaptive testing ipsative tests forced-choice items pairwise-comparison

来源：评论

学校读者我要写书评

暂无评论

Psychometric properties of computerized adaptive testing for chronic obstructive pulmonary disease patient-reported outcome measurement

引用

HEALTH AND QUALITY OF LIFE OUTCOMES 2024年第1期22卷 1页

作者： Wang, Jiajia Xie, Yang Feng, Zhenzhen Li, Jiansheng Henan Univ Chinese Med Collaborat Innovat Ctr Chinese Med & Resp Dis Co c 156 Jinshui East Rd Zhengzhou 450046 Peoples R China Henan Univ Chinese Med Henan Key Lab Chinese Med Resp Dis 156 Jinshui East Rd Zhengzhou 450046 Peoples R China Henan Univ Chinese Med Dept Resp Dis Affiliated Hosp 1 19 Renmin Rd Zhengzhou 450003 Peoples R China

Background computerized adaptive testing (CAT) is an effective way to reduce time, repetitious redundancy, and respond burden, and has been used to measure outcomes in many diseases. This study aimed to develop and validate a comprehensive disease-specific CAT for chronic obstructive pulmonary disease (COPD) patient-reported outcome measurement. Methods The discrimination and difficulty of the items from the modified patient-reported outcome scale for COPD (mCOPD-PRO) were analyzed using item response theory. Then the initial item, item selection method, ability estimation method, and stopping criteria were further set based on Concerto platform to form the CAT. Finally, the reliability and validity were validated. Results The item discrimination ranged from 1.05 to 2.71, and the item difficulty ranged from - 3.08 to 3.65. The measurement reliability of the CAT ranged from 0.910 to 0.922 using random method, while that ranged from 0.910 to 0.924 using maximum Fisher information (MFI) method. The content validity was good. The correlation coefficient between theta of the CAT and COPD assessment test and modified Medical Research Council dyspnea scale scores using random method was 0.628 and 0.540 (P < 0.001;P < 0.001) respectively, while that using MFI method was 0.347 and 0.328 (P = 0.007;P = 0.010) respectively. About 11 items (reducing by 59.3%) on average were tested using random method, while about seven items (reducing by 74.1%) on average using MFI method. The correlation coefficient between theta of the CAT and mCOPD-PRO total scores using random method was 0.919 (P < 0.001), while that using MFI method was 0.760 (P < 0.001). Conclusions The comprehensive disease-specific CAT for COPD patient-reported outcome measurement is well developed with good psychometric properties, which can provide an efficient, accurate, and user-friendly measurement for patient-reported outcome of COPD.

关键词： Chronic obstructive pulmonary disease Patient-reported outcome computerized adaptive testing Item response theory Reliability Validity

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：