NDLI: What different kinds of stratification can reveal about the generalizability of data-mined skill assessment models

Please wait, while we are loading the content...

Addressing learner issues with StepUp!: an evaluation

Considering formal assessment in learning analytics within a PLE: the HOU2LEARN case

Analysis of collaborative writing processes using revision maps and probabilistic topic models

Analyzing the flow of ideas and profiles of contributors in an open learning community

Towards the development of multimodal action based assessment

Affective states and state tests: investigating how affect throughout the school year predicts end of year learning outcomes

What can we learn from Facebook activity?: using social learning analytics to observe new media literacy skills

Interpreting data mining results with linked data for learning analytics: motivation, case study and directions

Deconstructing disengagement: analyzing learner subpopulations in massive open online courses

What different kinds of stratification can reveal about the generalizability of data-mined skill assessment models

STEMscopes: contextualizing learning analytics in a K-12 science curriculum

Issues, challenges, and lessons learned when scaling up a learning analytics intervention

From micro to macro: analyzing activity in the ROLE Sandbox

GradeCraft: what can we learn from a game-inspired learning management system?

Crafting transformative strategies for personalized learning/analytics

DCLA13: $1^{st}$ International Workshop on Discourse-Centric Learning Analytics

Multidisciplinarity vs. Multivocality, the case of "learning analytics"

Live interest meter: learning from quantified feedback in mass lectures

Visualizing social learning ties by type and topic: rationale and concept demonstrator

Learning analytics for online discussions: a pedagogical model for intervention with embedded and extracted analytics

Epistemology, pedagogy, assessment and learning analytics

Multimodal learning analytics

An eye-tracking study of notational, informational, and emotional aspects of learning analytics representations

Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment

Nanogenetic learning analytics: illuminating student learning pathways in an online fraction game

The pairing of lecture recording data with assessment scores: a method of discovering pedagogical impact

Assessing students' performance using the learning analytics enriched rubrics

Supporting action research with learning analytics

An evaluation of policy frameworks for addressing ethical considerations in learning analytics

Analytics of collaborative planning in Metafora: architecture, data, and analytic methods

System for assessing classroom attention

Educational data scientists: a scarce breed

Analytics on video-based learning

Understanding promotions in a case study of student blogging

An evaluation of learning analytics to identify exploratory dialogue in online discussions

Toward collaboration sensing: applying network analysis techniques to collaborative eye-tracking data

Open academic analytics initiative: initial research findings

MOOCs and the funnel of participation

Model-driven assessment of learners in open-ended learning environments

A case study inside virtual worlds: use of analytics for immersive spaces

Aggregating social and usage datasets for learning analytics: data-oriented challenges

Orchestrating of complex inquiry: three roles for learning analytics in a smart classroom infrastructure

Learning object analytics for collections, repositories & federations

Inferring higher level learning information from low level data for the Khan Academy platform

Formative assessment and learning analytics

Second International Workshop on Teaching Analytics

What different kinds of stratification can reveal about the generalizability of data-mined skill assessment models

Content Provider	ACM Digital Library
Author	Baker, Ryan S. J. D. Sao Pedro, Michael A. Gobert, Janice D.
Abstract	When validating assessment models built with data mining, generalization is typically tested at the student-level, where models are tested on new students. This approach, though, may fail to find cases where model performance suffers if other aspects of those cases relevant to prediction are not well represented. We explore this here by testing if scientific inquiry skill models built and validated for one science topic can predict skill demonstration for new students and a new science topic. Test cases were chosen using two methods: student-level stratification, and stratification based on the amount of trials ran during students' experimentation. We found that predictive performance of the models was different on each test set, revealing limitations that would have been missed from student-level validation alone.
Starting Page	190
Ending Page	194
Page Count	5
File Format	PDF
ISBN	9781450317856
DOI	10.1145/2460296.2460334
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-04-08
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Validation Educational data mining Learning analytics Generalizability Science inquiry Science simulations Automated inquiry assessment User modeling Science microworlds
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Improving construct validity yields better models of systematic inquiry, even with less information

Leveraging Educational Data Mining for Real-time Performance Assessment of Scientific Inquiry Skills within Microworlds

Learning analytics and educational data mining for inquiry-based learning

Using learning analytics to assess students' behavior in open-ended programming tasks

E-Learning standards and learning analytics. Can data collection be improved by using standard data models?

Leveraging Educational Data Mining for Real-Time Performance Assessment of Scientific Inquiry Skills within Microworlds

LeMo: A learning analytics application focussing on user path analysis and interactive visualization

Essays about service-learning events can be mined for program assessment

Modeling User Exploration and Boundary Testing in Digital Learning Games

What different kinds of stratification can reveal about the generalizability of data-mined skill assessment models

Similar Documents

Improving construct validity yields better models of systematic inquiry, even with less information

Leveraging Educational Data Mining for Real-time Performance Assessment of Scientific Inquiry Skills within Microworlds

Learning analytics and educational data mining for inquiry-based learning

Using learning analytics to assess students' behavior in open-ended programming tasks

E-Learning standards and learning analytics. Can data collection be improved by using standard data models?

Leveraging Educational Data Mining for Real-Time Performance Assessment of Scientific Inquiry Skills within Microworlds

LeMo: A learning analytics application focussing on user path analysis and interactive visualization

Essays about service-learning events can be mined for program assessment

Modeling User Exploration and Boundary Testing in Digital Learning Games

What different kinds of stratification can reveal about the generalizability of data-mined skill assessment models