检索结果-内蒙古大学图书馆

computerized adaptive testing Framework Based on Excitation Block and Gumbel-Softmax

IEEE ACCESS 2025年 13卷 3475-3484页

作者： Liu, Chengsong Wei, Yan Chongqing Normal Univ Coll Comp & Informat Sci Chongqing 401331 Peoples R China Chongqing Engn Res Ctr Educ Big Data Intelligent P Chongqing 401331 Peoples R China

computerized adaptive testing (CAT) is a personalized assessment method that adaptively selects the most suitable questions for students of different abilities based on their response data. Its primary goal is to effectively measure students' proficiency in a specific subject in a shorter period. The selection algorithm is pivotal in CAT. The current algorithms inadequately consider the impact of knowledge concept weights in question and student potential factors (e.g., memory) on question selection. In addition, most algorithms primarily focus on accurately predicting students' abilities, neglecting critical factors such as concept diversity and question exposure rate, which are essential for model effectiveness. Therefore, this paper introduces a new framework for CAT, GECAT. It proposes a selection algorithm based on an excitation block to learn the weights of each knowledge concept in the questions and analyze the impact of student potential factors on their answering performance, thereby selecting more suitable questions for students. Additionally, it views CAT as reinforcement learning, introducing Gumbel-Softmax to provide students with diverse, non-repetitive, and valuable test questions. The experimental results on three real-world datasets demonstrate that the proposed CAT framework improves ACC and AUC by 0.71% and 0.86%, respectively, while reducing question exposure rate and overlap rate by 1.33% and 1.59%, respectively.

关键词： testing Reinforcement learning Prediction algorithms Accuracy Optimization Computational modeling Adaptation models Technological innovation Predictive models Metalearning computerized adaptive testing Gumbel-Softmax excitation block potential factors

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing to Balance Exposure Bias and Measurement Accuracy Using Zero-Suppressed Binary Decision Diagrams

引用

IEEE ACCESS 2025年 13卷 33883-33903页

作者： Ueno, Maomi Fuchimoto, Kazuma Kishida, Wakaba Miyazawa, Yoshimitsu Univ Electrocommun Grad Sch Informat & Engn Tokyo 1828585 Japan Natl Ctr Univ Entrance Examinat Res & Dev Tokyo 1530041 Japan

computerized adaptive testing (CAT) presents a tradeoff dilemma involving item exposure bias and measurement accuracy. To resolve this dilemma, we propose a new two-step CAT mechanism to balance exposure bias and measurement accuracy. Using zero-suppressed binary decision diagram (ZDD), the proposed method first selects and presents an optimal item from an equivalent item pool, which uniformly divides the whole item pool. The first step rapidly provides a roughly approximated ability estimate of an examinee. The second step produces a more accurate ability estimate of the examinee. Specifically, the second step selects an optimal item from the whole item pool and presents an item with a difficulty parameter value that is approximately equal to the examinee ability estimate. Numerical experiment results underscore the effectiveness of the proposed method.

关键词： Accuracy testing Probabilistic logic IP networks History Binary decision diagrams Standards Upper bound Gaussian distribution Current measurement computerized adaptive testing item response theory parallel test assembly zero-suppressed binary decision diagrams

来源：评论

学校读者我要写书评

暂无评论

Psychometric evaluation and computerized adaptive testing simulations of age-related macular degeneration quality of life item banks

引用

ASIA-PACIFIC JOURNAL OF OPHTHALMOLOGY 2025年第2期14卷 100178-100178页

作者： Fenwick, Eva K. Man, Ryan E. K. Tan, Anna C. S. Najjar, Raymond P. Milea, Dan Lee, Ester P. X. Wong, Tien Yin Tan, Gavin S. W. Chan, Hwei Wuen Laude, Augustinus Teo, Kelvin Y. C. Lee, Shu Yen Yeo, Ian Yew San Mathur, Ranjana Cheung, Gemmy C. M. Lamoureux, Ecosse L. Singapore Natl Eye Ctr Singapore Eye Res Inst Singapore Singapore Natl Univ Singapore Duke Natl Univ Singapore NUS Med Sch Singapore Singapore Natl Univ Singapore Yong Loo Lin Sch Med Dept Ophthalmol Singapore Singapore Natl Univ Singapore Coll Design & Engn Dept Biomed Engn Singapore Singapore Tsinghua Univ Tsinghua Med Beijing Peoples R China Tan Tock Seng Hosp Eye Inst Natl Healthcare Grp Singapore Singapore Univ Melbourne Melbourne Australia

Purpose: To optimize the psychometric properties of age-related macular degeneration (AMD) quality of life (QoL) item banks (IBs), and evaluate their performance using computerized adaptive testing (CAT) simulations. Design: Cross-sectional, clinical study. Methods: 261 AMD patients answered 219 items within seven IBs: Activity Limitation (AL);Lighting (LT);Mobility (MB);Emotional (EM);Concerns (CN);AMD Management (AM);and Work (WK), referred to collectively as "MacCAT". The psychometric properties of each IB (e.g. measurement precision;item "fit";differential item functioning (DIF)) were assessed using Rasch analysis. The mean number of items required for "high" and "moderate" measurement precision was determined using CAT simulations. Results: Of the 261 participants (mean age 70.5 +/- 7.6 years), 69 (26.4 %), 35 (13.4 %), 80 (30.7 %) and 77 (29.5 %) had no, early, intermediate and late AMD (better eye), respectively. AL, EM, CN and AM displayed good psychometric properties overall after collapsing response categories and deleting items for misfit and/or DIF. Despite similar reengineering efforts, LT and MB had suboptimal measurement precision but were retained due to otherwise good psychometric performances. Owing to unresolvable psychometric issues, WK was not considered further. Targeting for all IBs was suboptimal. In CAT simulations on the six remaining IBs, the mean number of items required per IB ranged from 8 (AL) to 13 (MB) for moderate, and 13 (AL) to19 (MB) for high measurement precision. Conclusions: Six IBs demonstrated acceptable psychometric properties and potential CAT efficiency, suggesting MacCAT provides a comprehensive measurement of the QoL impact of AMD and associated treatments. Further testing in larger clinical cohorts is needed.

关键词： Age-related macular degeneration Quality of life Item banks Rasch analysis computerized adaptive testing

来源：评论

学校读者我要写书评

暂无评论

ROAR-CAT: Rapid Online Assessment of Reading ability with computerized adaptive testing

引用

BEHAVIOR RESEARCH METHODS 2025年第1期57卷 1-17页

作者： Ma, Wanjing Anya Richie-Halford, Adam Burkhardt, Amy K. Kanopka, Klint Chou, Clementine Domingue, Benjamin W. Yeatman, Jason D. Stanford Univ Grad Sch Educ 520 Galvez Mall Stanford CA 94305 USA Stanford Univ Sch Med Div Dev & Behav Pediat Stanford CA USA Stanford Univ Dept Psychol Stanford CA USA NYU New York NY USA Cambium Assessment Washington DC USA

The Rapid Online Assessment of Reading (ROAR) is a web-based lexical decision task that measures single-word reading abilities in children and adults without a proctor. Here we study whether item response theory (IRT) and computerized adaptive testing (CAT) can be used to create a more efficient online measure of word recognition. To construct an item bank, we first analyzed data taken from four groups of students (N = 1960) who differed in age, socioeconomic status, and language-based learning disabilities. The majority of item parameters were highly consistent across groups (r = .78-.94), and six items that functioned differently across groups were removed. Next, we implemented a JavaScript CAT algorithm and conducted a validation experiment with 485 students in grades 1-8 who were randomly assigned to complete trials of all items in the item bank in either (a) a random order or (b) a CAT order. We found that, to achieve reliability of 0.9, CAT improved test efficiency by 40%: 75 CAT items produced the same standard error of measurement as 125 items in a random order. Subsequent validation in 32 public school classrooms showed that an approximately 3-min ROAR-CAT can achieve high correlations (r = .89 for first grade, r = .73 for second grade) with alternative 5-15-min individually proctored oral reading assessments. Our findings suggest that ROAR-CAT is a promising tool for efficiently and accurately measuring single-word reading ability. Furthermore, our development process serves as a model for creating adaptive online assessments that bridge research and practice.

关键词： Dyslexia Screening tools Psychometrics computerized adaptive testing Lexical decision task Word recognition

来源：评论

学校读者我要写书评

暂无评论

Accounting for item calibration error in computerized adaptive testing

引用

BEHAVIOR RESEARCH METHODS 2025年第5期57卷 1-12页

作者： Fink, Aron Koenig, Christoph Frey, Andreas Goethe Univ Frankfurt Theodor W Adorno Pl 6 D-60323 Frankfurt Germany

In computerized adaptive testing (CAT), item parameter estimates derived from calibration studies are considered to be known and are used as fixed values for adaptive item selection and ability estimation. This is not completely accurate because these item parameter estimates contain a certain degree of error. If this error is random, the typical CAT procedure leads to standard errors of the final ability estimates that are too small. If the calibration error is large, it has been shown that the accuracy of the ability estimates is negatively affected due to the capitalization on chance problem, especially for extreme ability levels. In order to find a solution for this fundamental problem of CAT, we conducted a Monte Carlo simulation study to examine three approaches that can be used to consider the uncertainty of item parameter estimates in CAT. The first two approaches used a measurement error modeling approach in which item parameters were treated as covariates that contained errors. The third approach was fully Bayesian. Each of the approaches was compared with regard to the quality of the resulting ability estimates. The results indicate that each of the three approaches is capable of reducing bias and the mean squared error (MSE) of the ability estimates, especially for high item calibration errors. The Bayesian approach clearly outperformed the other approaches. We recommend the Bayesian approach, especially for application areas in which the recruitment of a large calibration sample is infeasible.

关键词： computerized adaptive testing Item response theory Bayesian techniques Calibration error

来源：评论

学校读者我要写书评

暂无评论

Diffusion-Inspired Cold Start with Sufficient Prior in computerized adaptive testing 25

Diffusion-Inspired Cold Start with Sufficient Prior in Compu...

引用

Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1

作者： Haiping Ma Aoqing Xia Changqian Wang Hai Wang Xingyi Zhang Information Materials and Intelligent Sensing Laboratory of Anhui Province the Institutes of Physical Science and Information Technology Anhui University Hefei Anhui China The Institutes of Physical Science and Information Technology Anhui University Hefei Anhui China The Institutes of Physical Science and Information Technology Anhui University hefei anhui China School of Computer Science and Technology Anhui University Hefei Anhui China

ISBN: (纸本)9798400712456

computerized adaptive testing (CAT) aims to select the most appropriate questions based on the examinee's ability and is widely used in online education. However, existing CAT systems often lack initial understanding of the examinee's ability, requiring random probing questions. This can lead to poorly matched questions, extending the test duration and negatively impacting the examinee's mindset, a phenomenon referred to as the Cold Start with Insufficient Prior (CSIP) task. This issue occurs because CAT systems do not effectively utilize the abundant prior information about the examinee available from other courses on online platforms. These response records, due to the commonality of cognitive states across different knowledge domains, can provide valuable prior information for the target domain. However, no prior work has explored solutions for the CSIP task. In response to this gap, we propose Diffusion Cognitive States TransfeR Framework (DCSR), a novel domain transfer framework based on Diffusion Models (DMs) to address the CSIP task. Specifically, we construct a cognitive state transition bridge between domains, guided by the common cognitive states of examinees, encouraging the model to reconstruct the initial ability state in the target domain. To enrich the expressive power of the generated data, we analyze the causal relationships in the generation process from a causal perspective. Redundant and extraneous cognitive states can lead to limited transfer and negative transfer effects. Therefore, we designed three decoupling strategies to control confounding variables, thereby blocking backdoor paths that hinder causal discovery. Given that excessive uncertainty can affect the applicability of generated results to the CAT system, we propose consistency constraint and task-oriented constraint to control the randomness of the generated results and their relevance to the CAT task, respectively. Our DCSR can seamlessly apply the generated initial ability states

关键词： computerized adaptive testing

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing for the patient evaluation measure (PEM) in patients undergoing cubital tunnel syndrome surgery

引用

JOURNAL OF HAND SURGERY-EUROPEAN VOLUME 2023年第10期48卷 1042-1047页

作者： Teunissen, Joris S. Hovius, Steven E. R. Ulrich, Dietmar J. O. Issa, Fadi Rodrigues, Jeremy N. Harrison, Conrad J. Radboud Univ Nijmegen Radboud Inst Hlth Sci Dept Plast Reconstruct & Hand Surg Med Ctr Nijmegen Gelderland Netherlands Univ Oxford John Radcliffe Hosp Nufffield Dept Surg Sci Oxford England Buckinghamshire Healthcare NHS Trust Stoke Mandeville Hosp Dept Plast Surg Aylesbury England Univ Warwick Clin Trials Unit Coventry England Univ Oxford Nuffield Dept Orthopaed Rheumatol & Musculoskeleta Oxford England

In outcome measures, item response theory (IRT) validation can deliver interval-scaled high-quality measurement that can be harnessed using computerized adaptive tests (CATs) to pose fewer questions to patients. We aimed to develop a CAT by developing an IRT model for the Patient Evaluation Measure (PEM) for patients undergoing cubital tunnel syndrome (CuTS) surgery. Nine hundred and seventy-nine completed PEM responses of patients with CuTS in the United Kingdom Hand Registry were used to develop and calibrate the CAT. Its performance was then evaluated in a simulated cohort of 1000 patients. The CAT reduced the original PEM length from ten to a median of two questions (range two to four), while preserving a high level of precision (median standard error of measurement of 0.27). The mean error between the CAT score and full-length score was 0.08%. A Bland-Altman analysis showed good agreement with no signs of bias. The CAT version of the PEM can substantially reduce patient burden while enhancing construct validity by harnessing IRT for patients undergoing CuTS surgery.

关键词： Patient-Reported Outcome Measures cubital tunnel syndrome computerized adaptive testing surgical procedures

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing for classifying examinees into three categories

引用

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 2000年第5期60卷 713-734页

作者： Eggen, TJHM Straetmans, GJJM Cito The Netherlands

The objective of this study was to explore the possibilities for using computerized adaptive testing in situations in which examinees are to be classified into one of three categories. testing algorithms with two different statistical computation procedures are described and evaluated. The first computation procedure is based on statistical testing and the other on statistical estimation. Item selection methods based on maximum information (MI) considering content and exposure control are considered. The measurement quality of the proposed testing algorithms is reported. The results of the study are that a reduction of at least 22% in the mean number of items can be expected in a computerized adaptive test (CAT) compared to an existing paper-and-pencil placement test. Furthermore, statistical testing is a promising alternative to statistical estimation. Finally, it is concluded that imposing constraints on the MI selection strategy does not negatively affect the quality of the testing algorithms.

关键词： computerized adaptive testing classification

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing of population psychological distress: simulation-based evaluation of GHQ-30

引用

SOCIAL PSYCHIATRY AND PSYCHIATRIC EPIDEMIOLOGY 2016年第6期51卷 895-906页

作者： Stochl, Jan Bohnke, Jan R. Pickett, Kate E. Croudace, Tim J. Univ York Dept Hlth Sci Area 4ARRC Bldg York YO10 5DD N Yorkshire England Univ York HYMS Area 4ARRC Bldg York YO10 5DD N Yorkshire England Univ Dundee Sch Nursing & Hlth Sci 11 Airlie Pl Dundee DD1 4HJ Scotland Univ Cambridge Dept Psychiat Herchel Smith BldgRobinson Way Cambridge CB2 0SZ England

Goldberg's General Health Questionnaire (GHQ) items are frequently used to assess psychological distress but no study to date has investigated the GHQ-30's potential for adaptive administration. In computerized adaptive testing (CAT) items are matched optimally to the targeted distress level of respondents instead of relying on fixed-length versions of instruments. We therefore calibrate GHQ-30 items and report a simulation study exploring the potential of this instrument for adaptive administration in a longitudinal setting. GHQ-30 responses of 3445 participants with 2 completed assessments (baseline, 7-year follow-up) in the UK Health and Lifestyle Survey were calibrated using item response theory. Our simulation study evaluated the efficiency of CAT administration of the items, cross-sectionally and longitudinally, with different estimators, item selection methods, and measurement precision criteria. To yield accurate distress measurements (marginal reliability at least 0.90) nearly all GHQ-30 items need to be administered to most survey respondents in general population samples. When lower accuracy is permissible (marginal reliability of 0.80), adaptive administration saves approximately 2/3 of the items. For longitudinal applications, change scores based on the complete set of GHQ-30 items correlate highly with change scores from adaptive administrations. The rationale for CAT-GHQ-30 is only supported when the required marginal reliability is lower than 0.9, which is most likely to be the case in cross-sectional and longitudinal studies assessing mean changes in populations. Precise measurement of psychological distress at the individual level can be achieved, but requires the deployment of all 30 items.

关键词： computerized adaptive testing Item response theory Bifactor model Measurement invariance General Health Questionnaire

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing for Patient Reported Outcomes in Ankle Fracture Surgery

引用

FOOT & ANKLE INTERNATIONAL 2018年第10期39卷 1192-1198页

作者： Gausden, Elizabeth B. Levack, Ashley Nwachukwu, Benedict U. Sin, Danielle Wellman, David S. Lorich, Dean G. Hosp Special Surg 535 E 70th St New York NY 10021 USA Hosp Special Surg New York Presbyterian Hosp Weill Cornell Med Coll New York NY 10021 USA

Background: Advantages of using computerized adaptive testing (CAT) include decreased survey-burden, diminished floor and ceiling effect, and improved ability to detect the minimal clinical significant difference (MCID) among patients. The goal of this study was to compare the legacy patient-reported outcome measures (PROMs) to the Patient-Reported Outcomes Measurement Information System (PROMIS) scores in terms of ability to detect clinically significant changes in patients who have undergone surgery for ankle fractures. Methods: Patients who underwent osteosynthesis for an unstable ankle fracture between 2013-2016 and completed legacy outcome scores (Foot and Ankle Outcome Score [FAOS], Olerud and Molander Ankle Score [OMAS], and Weber Score) along with the PROMIS Physical Function (PF) and PROMIS Lower Extremity (LE) CATs postoperatively were included. Correlation between the scores at 3-month, 6-month, and 1-year intervals, as well as floor and ceiling effects, in addition to MCIDs were calculated for each instrument. A total of 132 patients were included in the study. Results: There was no observed floor or ceiling effect in either the PROMIS PF or the PROMIS LE scores. Clinically significant changes in the PROMIS LE score were detected in patients between 6-month and 12-month postoperative visits (P =.0006), whereas the reported OMAS score and Weber scores did not identify a clinically significant difference between patients at their 6-month and 12-month visit. Conclusion: The results of this study indicate that the PROMIS LE was superior for evaluating patients following ankle fracture surgery in terms of lower floor and ceiling effects and greater ability to distinguish clinically significant changes in patients between time points following surgery.

关键词： patient-reported outcomes ankle fractures minimal clinical important difference PROMIS computerized adaptive testing

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：