1,683
edits
Changes
mLine 14:
Line 14: − + + + +
→Goals
To help user conduct experiments, project will compare one part of time series with another or progress on one set of cards with another. User may have to do some analysis on their own.
To help user conduct experiments, project will compare one part of time series with another or progress on one set of cards with another. User may have to do some analysis on their own.
Any decent skill test will detect when subject is severely sick. For a test to be useful for optimization and experimentation, it must detect more subtle patterns. Statistical tests detect plenty of patterns in target data that are both subtle enough and clearly not generated by the same process as the rest of the data. Unfortunately, those patterns could easily be artifacts of the analysis or of the test taking process. Including all available variables that should NOT correlate with target in a machine learning model and then using resulting residual errors as the final test results should help, but not all variables that cause artifacts are available. Some of the artifacts will differ between tests so comparing results from multiple tests may result in a single decent time series strongly dependent on skill. If these solutions are not enough, one of the tests may correlate and generalize to an established validated cognitive test.
=== Confounders and Artifacts of Procedure ===
Any decent skill test will detect when subject is severely sick. For a test to be useful for optimization and experimentation, it must detect more subtle patterns. Statistical tests detect plenty of patterns in target data that are both subtle enough and clearly not generated by the same process as the rest of the data. Unfortunately, those patterns could easily be artifacts of the analysis or of the test taking process. Including all available variables that should NOT correlate with target in a machine learning model and then using resulting residual errors as the final test results should help, but not all variables that cause artifacts are available.
Some of the artifacts will differ between tests so comparing results from multiple tests may result in a single decent time series strongly dependent on skill. If these solutions are not enough, one of the tests may correlate and generalize to an established validated cognitive test. That would still allow experimentation on and optimization of a skill, but through a cognitive ability.
=== Cognitive Test ===
=== Cognitive Test ===