Difference between revisions of "Flash Cards as Cognitive Test"
m |
m (→Goals) |
||
| Line 6: | Line 6: | ||
=== Goals === | === Goals === | ||
| − | Simply adding colorful plots that Anki does not already have will encourage studying. The goal of teaching is almost as | + | Simply adding colorful plots that Anki does not already have will encourage studying. |
| + | |||
| + | The goal of teaching is almost as easy to guarantee because analyzing the data requires delving into the learning process. This goal may actually be the most impactful. | ||
Project will advise user on how to optimize their studying by comparing what actually happened with what would have happened if they had done something different, according to a machine learning model. Effects will be illustrated using Partial Dependence Plots and ICE<ref>Visualizing ML Models with LIME · UC Business Analytics R Programming Guide (uc-r.github.io)</ref>. To help user conduct experiments, project will compare one part of time series with another or progress on one set of cards with another. User may have to do some analysis on their own. | Project will advise user on how to optimize their studying by comparing what actually happened with what would have happened if they had done something different, according to a machine learning model. Effects will be illustrated using Partial Dependence Plots and ICE<ref>Visualizing ML Models with LIME · UC Business Analytics R Programming Guide (uc-r.github.io)</ref>. To help user conduct experiments, project will compare one part of time series with another or progress on one set of cards with another. User may have to do some analysis on their own. | ||
| − | Any decent skill test will detect when subject is severely sick. For a test to be useful | + | Any decent skill test will detect when subject is severely sick. For a test to be useful for improving the skill, it must detect more subtle patterns. Statistical tests detect plenty of patterns in target data that are subtle enough and obviously not generated by the same process as the rest of the data. Unfortunately, those patterns could easily be artifacts of the analysis or of the test taking process. Adding the confounders to a machine learning model and then using the error / residuals as the actual test results should help, but is not guaranteed to remove everything. |
| + | === Cognitive Test === | ||
Everyone should track their cognitive ability as much as health-conscious people track their heartrate and exercise. Formal cognitive testing takes too much time, relevance to user's productivity goals is often questionable. An alternative that solves both is skill trainers like typing tutors. To generalize to cognition and health the skill test must correlate with other cognitive things or health things. Wozniak of supermemo has found correlation between sleep and flash card skill. | Everyone should track their cognitive ability as much as health-conscious people track their heartrate and exercise. Formal cognitive testing takes too much time, relevance to user's productivity goals is often questionable. An alternative that solves both is skill trainers like typing tutors. To generalize to cognition and health the skill test must correlate with other cognitive things or health things. Wozniak of supermemo has found correlation between sleep and flash card skill. | ||
Revision as of 21:59, 12 July 2023
Project Infobox 
| |
|---|---|
| Self researcher(s) | User:DG |
| Related tools | Anki, Spaced Repetition |
| Related topics | Tools for Cognitive Testing |
Builds on project(s) |
Spaced Listening, Spaced Repetition: A Cognitive QS Method for Knowledge Acquisition |
| Has inspired | Projects (0) |
Flash cards are cards with question on one side and answers on opposite, used for memorization. Exist several computer apps that automate the process and have recorded a lot of data. I expected electronic flashcard data to be useful as a cognitive test so I started a project to analyze the data that Anki records. Turns out the project teaches users about learning and allows them to experiment with and optimize their own learning process. This project also encourages studying by illustrating success in detail, similar to gamification.
The project is a work in progress and much of the intended functionality is not yet working. I cannot yet guarantee that each of the goals will be all that useful to the end user. Project will take about ten thousand lines of code to complete, so I expect to burn out a few times before it is done. No AI or LLM was used in the making of this project.
Goals
Simply adding colorful plots that Anki does not already have will encourage studying.
The goal of teaching is almost as easy to guarantee because analyzing the data requires delving into the learning process. This goal may actually be the most impactful.
Project will advise user on how to optimize their studying by comparing what actually happened with what would have happened if they had done something different, according to a machine learning model. Effects will be illustrated using Partial Dependence Plots and ICE[1]. To help user conduct experiments, project will compare one part of time series with another or progress on one set of cards with another. User may have to do some analysis on their own.
Any decent skill test will detect when subject is severely sick. For a test to be useful for improving the skill, it must detect more subtle patterns. Statistical tests detect plenty of patterns in target data that are subtle enough and obviously not generated by the same process as the rest of the data. Unfortunately, those patterns could easily be artifacts of the analysis or of the test taking process. Adding the confounders to a machine learning model and then using the error / residuals as the actual test results should help, but is not guaranteed to remove everything.
Cognitive Test
Everyone should track their cognitive ability as much as health-conscious people track their heartrate and exercise. Formal cognitive testing takes too much time, relevance to user's productivity goals is often questionable. An alternative that solves both is skill trainers like typing tutors. To generalize to cognition and health the skill test must correlate with other cognitive things or health things. Wozniak of supermemo has found correlation between sleep and flash card skill.
References
- ↑ Visualizing ML Models with LIME · UC Business Analytics R Programming Guide (uc-r.github.io)