Changes

{{Project Infobox|Self researchers=User:DG|Related tools=Anki,Spaced Repetition|Related topics=Tools for Cognitive Testing|Related projects=Spaced Listening, Spaced Repetition: A Cognitive QS Method for Knowledge Acquisition}}  

{{Project Infobox|Self researchers=User:DG|Related tools=Anki,Spaced Repetition|Related topics=Tools for Cognitive Testing|Related projects=Spaced Listening, Spaced Repetition: A Cognitive QS Method for Knowledge Acquisition}}  

Flash cards are cards with question on one side and answers on opposite, used for memorization. Exist several computer apps that automate the process and have recorded a lot of data. I expected electronic flashcard data to be useful as a cognitive test so I started a project to analyze the data that [[Anki]] records. Turns out the project teaches users about learning and allows them to experiment with and optimize their own learning process. This project also encourages studying by illustrating success in detail, similar to gamification.   

Flash cards are cards with question on one side and answers on opposite, used for memorization. Exist several computer apps that automate the process and have recorded a lot of data. I expected electronic flashcard data to be useful as a cognitive test so I started a project to analyze the data that [[Anki]] records. Turns out the project will teach users about learning and allow them to experiment with and optimize their own learning process. This project also encourages studying by illustrating success in detail, similar to gamification.   

The project is a work in progress and much of the intended functionality is not yet working. I cannot yet guarantee that each of the goals will be all that useful to the end user. Project will take about ten thousand lines of code to complete, so I expect to burn out a few times before it is done. No AI or LLM was used in the making of this project.     

The project is a work in progress and much of the intended functionality is not yet working. I cannot yet guarantee that each of the goals will be all that useful to the end user. Project will take about ten thousand lines of code to complete, so I expect to burn out a few times before it is done. No AI or LLM was used in the making of this project.     

The goal of teaching is almost as easy to guarantee because analyzing the data requires delving into the learning process. This goal may actually be the most impactful.  

The goal of teaching is almost as easy to guarantee because analyzing the data requires delving into the learning process. This goal may actually be the most impactful.  

Project will advise user on how to optimize their studying by comparing what actually happened with what would have happened if they had done something different, according to a machine learning model. Effects will be illustrated using Partial Dependence Plots and ICE<ref>Visualizing ML Models with LIME · UC Business Analytics R Programming Guide (uc-r.github.io)</ref>. To help user conduct experiments, project will compare one part of time series with another or progress on one set of cards with another. User may have to do some analysis on their own.   

Project will advise user on how to optimize their studying by comparing what actually happened with what would have happened if they had done something different, according to a machine learning model. Effects will be illustrated using Partial Dependence Plots and ICE<ref>Visualizing ML Models with LIME · UC Business Analytics R Programming Guide (uc-r.github.io)</ref>.    

Any decent skill test will detect when subject is severely sick. For a test to be useful for improving the skill, it must detect more subtle patterns. Statistical tests detect plenty of patterns in target data that are subtle enough and obviously not generated by the same process as the rest of the data. Unfortunately, those patterns could easily be artifacts of the analysis or of the test taking process. Adding the confounders to a machine learning model and then using resulting error / residuals as actual test results should help, but is not guaranteed to remove everything.         

 

Any decent skill test will detect when subject is severely sick. For a test to be useful for optimization and experimentation, it must detect more subtle patterns. Statistical tests detect plenty of patterns in target data that are both subtle enough and clearly not generated by the same process as the rest of the data. Unfortunately, those patterns could easily be artifacts of the analysis or of the test taking process. Including every variable that is supposed to be irrelevant in a machine learning model and then using resulting residual errors as the final test results should help, but not all variables that cause artifacts are available.         

=== Cognitive Test ===

=== Cognitive Test ===