检索结果-内蒙古大学图书馆

32nd ACM International Conference on Information and Knowledge Management (CIKM)

作者： Kwon, Soonwoo Kim, Sojung Lee, Seunghyun Kim, Jin-Young An, Suyeong Kim, Kyuseok Riiid AI Res Seoul South Korea

ISBN: (纸本)9798400701245

computerized adaptive testing (CAT) is a widely used, efficient test mode that adapts to the examinee's proficiency level in the test domain. CAT requires pre-trained item profiles, for CAT iteratively assesses the student real-time based on the registered items' profiles, and selects the next item to administer using candidate items' profiles. However, obtaining such item profiles is a costly process that involves gathering a large, dense item-response data, then training a diagnostic model on the collected data. In this paper, we explore the possibility of leveraging response data collected in the CAT service. We first show that this poses a unique challenge due to the inherent selection bias introduced by CAT, i.e., more proficient students will receive harder questions. Indeed, when naively training the diagnostic model using CAT response data, we observe that item profiles deviate significantly from the ground-truth. To tackle the selection bias issue, we propose the user-wise aggregate influence function method. Our intuition is to filter out users whose response data is heavily biased in an aggregate manner, as judged by how much perturbation the added data will introduce during parameter estimation. This way, we may enhance the performance of CAT while introducing minimal bias to the item profiles. We provide extensive experiments to demonstrate the superiority of our proposed method based on the three public datasets and one dataset that contains real-world CAT response data.

关键词： computerized adaptive testing Influence Function Bias Reduction

来源：评论

学校读者我要写书评

暂无评论

Hybrid Threshold-Based Sequential Procedures for Detecting Compromised Items in a computerized adaptive testing Licensure Exam

引用

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 2022年第4期82卷 782-810页

作者： Lee, Chansoon Qian, Hong Liberty Univ 306 Liberty View Lane Lynchburg VA 24502 USA Natl Council State Boards Nursing Chicago IL USA

Using classical test theory and item response theory, this study applied sequential procedures to a real operational item pool in a variable-length computerized adaptive testing (CAT) to detect items whose security may be compromised. Moreover, this study proposed a hybrid threshold approach to improve the detection power of the sequential procedure while controlling the Type I error rate. The hybrid threshold approach uses a local threshold for each item in an early stage of the CAT administration, and then it uses the global threshold in the decision-making stage. Applying various simulation factors, a series of simulation studies examined which factors contribute significantly to the power rate and lag time of the procedure. In addition to the simulation study, a case study investigated whether the procedures are applicable to the real item pool administered in CAT and can identify potentially compromised items in the pool. This research found that the increment of probability of a correct answer (p-increment) was the simulation factor most important to the sequential procedures' ability to detect compromised items. This study also found that the local threshold approach improved power rates and shortened lag times when the p-increment was small. The findings of this study could help practitioners implement the sequential procedures using the hybrid threshold approach in real-time CAT administration.

关键词： test security compromised item detection change-point problem computerized adaptive testing

来源：评论

学校读者我要写书评

暂无评论

SACAT: Student-adaptive computerized adaptive testing 23

SACAT: Student-Adaptive Computerized Adaptive Testing

引用

5th International Conference on Distributed Artificial Intelligence (DAI)

作者： Yu, Jingwei Mu, Zhenyu Lei, Jiayi Yin, Li'Ang Xia, Wei Yu, Yong Long, Ting Shanghai Jiao Tong Univ Shanghai Peoples R China Huawei Noahs Art Lab Shenzhen Peoples R China Jilin Univ Jilin Peoples R China

ISBN: (纸本)9798400708480

computerized adaptive testing refers to an online student ability testing system. It consists of Selection Algorithm and Cognitive Diagnosis Module (CDM). The Selection Algorithm aims to carefully select a small set of questions for the newly arrived student to answer, and the CDM aims to infer the ability of the newly arrived student based on his answers to the selected questions. The CDM faces the challenge of inferring student ability based on the short question-answer sequence. The state-of-the-art approach employs a meta-learning framework to solve this challenge. Specifically, in the outer-layer of the meta-learning framework, it learns an average student ability from all students as the initial ability for the newly arrived student, while in the inner-layer of the meta-learning framework, it infers the newly arrived student's ability from the short sequence. However, this approach suffers from two major limitations: Firstly, collaborative information between the newly arrived student and all students was not utilized. Secondly, the meta-learning framework has a slow convergence. This paper introduces Student-adaptive computerized adaptive testing (SACAT), which addresses these issues by: Firstly, use the short sequence of the newly arrived student to retrieve similar students from all students. Secondly, design a fast adaptive function that can adaptively generate an ability representation suitable for the newly arrived student from abilities of similar students. Through extensive experiments on three real-world student response datasets, we validate that SACAT can outperform existing CAT methods. Furthermore, through the fast adaptation, we show that SACAT achieves fast model convergence.

关键词： few-shot learning fast adaption computerized adaptive testing

来源：评论

学校读者我要写书评

暂无评论

Overview of computerized adaptive testing 8

Overview of Computerized Adaptive Testing

引用

8th IEEE/ACIS International Conference on Big Data, Cloud Computing, and Data Science, BCD 2023

作者： Thu Nguyet, Phan Thi Cam Tu, Truong Phan Ho Chi Minh University of Social Sciences and Humanites Social Work Department Ho Chi Minh City Viet Nam RMIT University Vietnam School of Communication and Design Chi Minh City Viet Nam

ISBN: (纸本)9798350373615

computerized adaptive testing (CAT), which provides a flexible and effective means of measuring an individual's knowledge, skills, and talents, has completely transformed the field of educational and psychological assessment. The computer adaptive testing (CAT) has both adaptive properties and fast individualized feedback. It creates algorithms to obtain more accurate results while sparing test takers' time. Early research suggested that CAT can be less stressful and more motivating than a traditional paper-pencil test. The article presents an overview of the fundamental ideas of CAT, such as item response theory (IRT) and item banks' function. The CAT components covered here include item bank development, item selection processes, trait estimate, and stopping rule. © 2023 IEEE.

关键词： computerized adaptive testing Efficiency Item bank Item response theory

来源：评论

学校读者我要写书评

暂无评论

A comparative analysis of multidimensional computerized adaptive testing for the DASH and QuickDASH scores in Dupuytren's disease

引用

JOURNAL OF HAND SURGERY-EUROPEAN VOLUME 2022年第7期47卷 750-754页

作者： Harrison, Conrad Clelland, Andrew D. Davis, Tim R. C. Scammell, Brigitte E. Zhang, Weiya Russell, Peter Fullilove, Sue Chakrabarti, Indranil Davidson, Dominique Rodrigues, Jeremy Univ Oxford Nuffield Dept Orthopaed Rheumatol & Musculoskelet Oxford England Univ Cambridge Dept Surg Cambridge England Nottingham Univ Hosp NHS Trust Nottingham England Univ Nottingham Acad Unit Injury Inflammat & Recovery Sci Sch Med Nottingham England Derby Teaching Hosp NHS Fdn Trust Derby England Univ Hosp Plymouth NHS Trust Plymouth Devon England Rotherham NHS Fdn Trust Rotherham S Yorkshire England NHS Lothian Livingston Scotland Warwick Med Sch Clin Trials Unit Warwick England

The QuickDASH is a short-form version of the DASH questionnaire, the most widely used patient-reported outcome measure in hand surgery. Multidimensional computerized adaptive testing (MCAT) can produce shorter and more precise testing than static short forms, like QuickDASH. We used DASH responses from 507 patients with Dupuytren's disease to develop a MCAT. The algorithm was evaluated in a Monte Carlo simulation, where the standard error of measurement (SEm) of scores obtained from the 11-item QuickDASH was compared with scores obtained from an MCAT that could administer up to 11 items from the full 30-item DASH. The MCAT asked a mean of 8.51 items (SD 2.93) and 265/1000 simulated respondents needed to complete <= five items. Median SEms were better for DASH MCAT: 0.299 (hand function) and 0.256 (sensory symptoms) versus 0.320 and 0.290, respectively, for QuickDASH. Our study showed that the DASH MCAT can produce more precise DASH measurement than the QuickDASH, from fewer items.

关键词： Patient-reported outcome measures PROM multidimensional computerized adaptive testing CAT Dupuytren's disease

来源：评论

学校读者我要写书评

暂无评论

computerized adaptive testing of symptom severity: a registry-based study of 924 patients with trapeziometacarpal arthritis

引用

JOURNAL OF HAND SURGERY-EUROPEAN VOLUME 2022年第9期47卷 893-898页

作者： Kamran, Rakhshan Rodrigues, Jeremy N. Dobbs, Thomas D. Wormald, Justin C. R. Trickett, Ryan W. Harrison, Conrad J. Univ Oxford Nuffield Dept Orthopaed Rheumatol & Musculoskelet Oxford England Warwick Med Sch Clin Trials Unit Warwick England Swansea Univ Welsh Ctr Burns & Plast Surg Swansea W Glam Wales Swansea Univ Swansea Univ Med Sch Swansea W Glam Wales Cardiff & Vale Univ Hlth Board Cardiff Wales

We aimed to develop a computerized adaptive testing (CAT) version of the 11 item Patient Evaluation Measure (PEM), using an item response theory model. This model transformed the ordinal scores into ratio-interval scores. We obtained PEM responses from 924 patients with trapeziometacarpal osteoarthritis to build a CAT model and tested its performance on a simulated cohort of 1000 PEM response sets. The CAT achieved high precision (median standard error or measurement 0.26) and reduced the number of questions needed for accurate scoring from 11 to median two. The CAT scores and item-response-theory-based 15-item PEM scores were similar, and a Bland-Altman analysis demonstrated a mean score difference of 0.2 between the CAT and the full-length PEM scores on a scale from 0 to 100. We conclude that the CAT substantially reduced the burden of the PEM while also harnessing the validity of item response theory scoring.

关键词： Osteoarthritis patient-reported outcome measures PROM computerized adaptive testing computerized adaptive testing CAT

来源：评论

学校读者我要写书评

暂无评论

The development of a glaucoma-specific health-related quality of life item bank supporting a novel computerized adaptive testing system in Asia

引用

JOURNAL OF PATIENT-REPORTED OUTCOMES 2022年第1期6卷 1-13页

作者： Fenwick, Eva K. Lim, Belicia Man, Ryan E. K. Baskaran, Mani Nongpiur, Monisha E. Sng, Chelvin C. A. Iyer, Jayant, V Husain, Rahat Perera, Shamira A. Wong, Tina T. Low, Jin Rong Shimin, Olivia Huang Lun, Katherine Aung, Tin Lamoureux, Ecosse L. Singapore Eye Res Inst SERI Singapore Natl Eye Ctr 20 Coll RdLevel 6 Singapore 169856 Singapore Natl Univ Singapore Duke NUS Med Sch Singapore Singapore Natl Univ Hlth Syst Singapore Singapore Univ Melbourne Melbourne Vic Australia Sankara Nethralaya Med & Vis Res Fdn Chennai Tamil Nadu India

Background A glaucoma-specific health-related quality of life (HRQoL) item bank (IB) and computerized adaptive testing (CAT) system relevant to Asian populations is not currently available. We aimed to develop content for an IB focusing on HRQoL domains important to Asian people with glaucoma;and to compare the content coverage of our new instrument with established glaucoma-specific instruments. Methods In this qualitative study of glaucoma patients recruited from the Singapore National Eye Centre (November 2018-November 2019), items/domains were generated from: (1) glaucoma-specific questionnaires;(2) published articles;(3) focus groups/semi-structured interviews with glaucoma patients (n = 27);and (4) feedback from glaucoma experts. Data were analyzed using the constant comparative method. Items were systematically refined to a concise set, and pre-tested using cognitive interviews with 27 additional glaucoma patients. Results Of the 54 patients (mean +/- standard deviation [SD] age 66.9 +/- 9.8;53.7% male), 67 (62.0%), 30 (27.8%), and 11 (10.2%) eyes had primary open angle glaucoma, angle closure glaucoma, and no glaucoma respectively. Eighteen (33.3%), 11 (20.4%), 8 (14.8%), 12 (22.2%), and 5 (9.3%) patients had no, mild, moderate, severe, or advanced/end-stage glaucoma (better eye), respectively. Initially, 311 items within nine HRQoL domains were identified: Visual Symptoms, Ocular Comfort Symptoms, Activity Limitation, Driving, Lighting, Mobility, Psychosocial, Glaucoma management, and Work;however, Driving and Visual Symptoms were subsequently removed during the refinement process. During cognitive interviews, 12, 23 and 10 items were added, dropped and modified, respectively. Conclusion Following a rigorous process, we developed a 221-item, 7-domain Asian glaucoma-specific IB. Once operationalised using CAT, this new instrument will enable precise, rapid, and comprehensive assessment of the HRQoL impact of glaucoma and associated treatment efficacy.

关键词： Glaucoma Quality of life Item bank computerized adaptive testing Eyedrops Qualitative

来源：评论

学校读者我要写书评

暂无评论

Developing and Validating a computerized adaptive testing System for Measuring the English Proficiency of Taiwanese EFL University Students

引用

LANGUAGE ASSESSMENT QUARTERLY 2022年第2期19卷 162-188页

作者： Huang, Heng-Tsung Danny Hung, Shao-Ting Alan Chao, Hsiu-Yi Chen, Jyun-Hong Lin, Tsui-Peng Shih, Ching-Lin Natl Taiwan Univ Taipei Taiwan Natl Taiwan Univ Sci & Technol Taipei Taiwan Natl Taiwan Ocean Univ Keelung Taiwan Soochow Univ Taipei Taiwan Natl Sun Yat Sen Univ Kaohsiung Taiwan

Prompted by Taiwanese university students' increasing demand for English proficiency assessment, the absence of a test designed specifically for this demographic subgroup, and the lack of a localized and freely-accessible proficiency measure, this project set out to develop and validate a computerized adaptive English proficiency testing (E-CAT) system for Taiwanese EFL university students. Drawing on the guidelines posited by L2 testing specialists, we devised and followed a six-stage procedure to develop this E-CAT system: determining the test purpose, defining the construct, developing the test items, designing the administration processes, performing the field testing, and constructing the E-CAT system. Upon its completion, we performed two validation studies on the simulated data and as such offered the backing for the generalization inference and the explanation inference, which combined to lend support for the validity argument for the E-CAT score-based interpretations and uses. This project highlighted the importance of test localization, foregrounded the utility of computerized adaptive testing and item response theory in language test development and validation, and generated a localized, free-of-charge English proficiency test for Taiwanese university students to satisfy the graduation benchmark requirement and/or to demonstrate their English proficiency levels when job hunting.

关键词： Language proficiency assessment test localization computerized adaptive testing computerized adaptive testing

来源：评论

学校读者我要写书评

暂无评论

A Robust computerized adaptive testing Approach in Educational Question Retrieval 22

A Robust Computerized Adaptive Testing Approach in Education...

引用

45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)

作者： Zhuang, Yan Liu, Qi Huang, Zhenya Li, Zhi Jin, Binbin Bi, Haoyang Chen, Enhong Wang, Shijin Univ Sci & Technol China Anhui Prov Key Lab Big Data Anal & Applicat Hefei Peoples R China State Key Lab Cognit Intelligence Hefei Peoples R China Hefei Comprehens Natl Sci Ctr Inst Artificial Intelligence Hefei Peoples R China Huawei Cloud Comp Technol Co Ltd Hangzhou Peoples R China iFLYTEK Co Ltd State Key Lab Cognit Intelligence Hefei Peoples R China iFLYTEK Co Ltd iFLYTEK AI Res Cent China Hefei Peoples R China

ISBN: (纸本)9781450387323

computerized adaptive testing (CAT) is a promising testing mode in personalized online education (e.g., GRE), which aims at measuring student's proficiency accurately and reducing test length. The "adaptive" is reflected in its selection algorithm that can retrieve best-suited questions for student based on his/her estimated proficiency at each test step. Although there are many sophisticated selection algorithms for improving CAT's effectiveness, they are restricted and perturbed by the accuracy of current proficiency estimate, thus lacking robustness. To this end, we investigate a general method to enhance the robustness of existing algorithms by leveraging student's "multi-facet" nature during tests. Specifically, we present a generic optimization criterion Robust adaptive testing (RAT) for proficiency estimation via fusing multiple estimates at each step, which maintains a multi-facet description of student's potential proficiency. We further provide theoretical analyses of such estimator's desirable statistical properties: asymptotic unbiasedness, efficiency, and consistency. Extensive experiments on perturbed synthetic data and three real-world datasets show that selection algorithms in our RAT framework are robust and yield substantial improvements.

关键词： computerized adaptive testing educational resource search educational measurement cognitive diagnosis

来源：评论

学校读者我要写书评

暂无评论

Combining Cognitive Diagnostic computerized adaptive testing With Multidimensional Item Response Theory

引用

APPLIED PSYCHOLOGICAL MEASUREMENT 2022年第4期46卷 288-302页

作者： Luo, Hao Wang, Daxun Guo, Zhiming Cai, Yan Tu, Dongbo Jiangxi Normal Univ Sch Psychol 99 Ziyang Ave Nanchang 330022 Jiangxi Peoples R China East China Normal Univ Fac Educ Dept Educ Psychol Shanghai Peoples R China

The new generation of tests not only focuses on the general ability but also the process of finer-grained skills. Under the guidance of this thought, researchers have developed a dual-purpose CD-CAT (Dual-CAT). In the existing Dual-CAT, the models used in overall ability estimation are unidimensional IRT models, which cannot apply to the multidimensional tests. This article intends to develop a multidimensional Dual-CAT to improve its applicability. To achieve this goal, this article firstly proposes some item selection methods for the multidimensional Dual-CAT, and then verifies the estimation accuracy and exposure rate of these methods through both simulation study and a real item bank study. The results show that the established multidimensional Dual-CAT is effective and the new proposed methods outperform the traditional methods. Finally, this article discusses the future direction of the Dual-CAT.

关键词： cognitive diagnosis computerized adaptive testing multidimensional item response theory educational and psychological measurement

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：