Difference between revisions of "Finding relations between variables in time series"

From Personal Science Wiki
Jump to navigation Jump to search
(Removed second "tool queries")
m (restructure as a topic page)
Line 1: Line 1:
{{Tool Infobox
+
A frequent need when engaging in personal science is finding relationships between different variables across a time series, an example could be the question "does eating chocolate improve focus?".  
|Related topics=
 
}}
 
==What is this tool and what can be done with it?==
 
Lets say you have lots of data, its parsed, cleaned, all in one place, and visualized. Next step is to find relations between variables. For example does eating chocolate improves focus? Some people do this by themselves, using R and Python, in notebooks or apps, here on open humans, kaggle and github. This requires technical skills, though its easier on OH. For everyone else there are apps that can do it all automatically.  
 
  
== List of non technical tools ==
+
== How does one find relations between variables ==
 +
To do this you need to have your data parsed, cleaned, all in one place, and ideally even visualized. The next step is to find relations between variables. Some people do this by themselves, by using programming languages such as R and Python in notebooks or apps. Coding platforms such as the notebooks on [[Open Humans]], Kaggle or GitHub can help, but it frequently
 +
requires technical skills.
  
==== [https://www.openhumans.org/activity/personal-data-notebooks/ Open Humans] ====
+
There are also a number of tools or apps that can semi-automatically perform these correlations and help in doing the analyses.
Personal notebooks. [https://blog.openhumans.org/2021/05/17/file-upload-data-types/ File Uploader].
 
  
==== [https://blog.zenobase.com/post/81497604762 Zenobase] ====
+
== List of less technical tools ==
Correlation tested based on user specified question. User must configure lag, regression method and aggregation method using a UI. Powerful filtering tools too.
 
  
==== [https://exist.io/ Exist.io] ====
+
==== [[Open Humans]] and their Personal Analysis notebooks ====
From Exist.io main site :"Which habits go together? Correlations are the most powerful part of Exist. By combining your data, we can answer questions like: “What makes me happiest?”
+
Open Humans provides a library of notebooks that can be used to visualize data across data sources and find relations between different variables. It also supports the upload of generic data files through the [https://blog.openhumans.org/2021/05/17/file-upload-data-types/ File Uploader].
“What can I do to be more active?”
 
“When am I most productive?”"
 
  
[https://dailyvis.com/posts/self-analysis-with-my-quantified-self-data/ DailyViz blog]
+
==== [[Zenobase]] ====
 +
[https://blog.zenobase.com/post/81497604762 Zenobase] can test correlations based on user-specified questions. User must configure lag, regression method and aggregation method using a UI. Powerful filtering tools too.
  
Blog post of interactive analysis of their data with surprising results. I think they allow using their app.
+
==== [[Exist.io]] ====
 +
From the [https://exist.io/ Exist.io] main site :"Which habits go together? Correlations are the most powerful part of Exist. By combining your data, we can answer questions like: “What makes me happiest?”, “What can I do to be more active?”, “When am I most productive?”"
  
[https://habitdash.com/ Habitdash]
+
==== DailyViz notebook ====
 +
The [https://dailyvis.com/posts/self-analysis-with-my-quantified-self-data/ DailyViz blog] gives an example of finding all relevant correlations in a large, personal self-tracking data set. The blog post show the interactive analysis of their data with some surprising results. The notebook [https://dailyvis.com/vis/compare/demo/ is available].
  
"Automatic data analysis
+
==== [[Habitdash]] ====
  
searches for hidden patterns.
+
[https://habitdash.com/  Habitdash]'s ''Automatic data analysis searches for hidden patterns'' to find relationships between activity, sleep, weight and other habits.
  
Our statistical algorithm runs each time you upload new data, searching for underlying relationships in your activity, sleep, weight, and other habits.
+
==== [[Optimized app]] ====
  
Scatterplots Sampling periods Linear regression Impact scores
+
[http://optimized-app.com/ Optimized] claims to do ''"automatic correlation mining"''
 
 
"
 
 
 
http://optimized-app.com/
 
 
 
"automatic correlation mining"
 
  
 
== List of very technical tools ==
 
== List of very technical tools ==
  
===Users interested in this tool (add your name to the list below!)===
+
{{stub}}
DG
 
  
{{Tool Queries}}
+
{{Topic Queries}}

Revision as of 08:54, 2 December 2021

A frequent need when engaging in personal science is finding relationships between different variables across a time series, an example could be the question "does eating chocolate improve focus?".

How does one find relations between variables

To do this you need to have your data parsed, cleaned, all in one place, and ideally even visualized. The next step is to find relations between variables. Some people do this by themselves, by using programming languages such as R and Python in notebooks or apps. Coding platforms such as the notebooks on Open Humans, Kaggle or GitHub can help, but it frequently requires technical skills.

There are also a number of tools or apps that can semi-automatically perform these correlations and help in doing the analyses.

List of less technical tools

Open Humans and their Personal Analysis notebooks

Open Humans provides a library of notebooks that can be used to visualize data across data sources and find relations between different variables. It also supports the upload of generic data files through the File Uploader.

Zenobase

Zenobase can test correlations based on user-specified questions. User must configure lag, regression method and aggregation method using a UI. Powerful filtering tools too.

Exist.io

From the Exist.io main site :"Which habits go together? Correlations are the most powerful part of Exist. By combining your data, we can answer questions like: “What makes me happiest?”, “What can I do to be more active?”, “When am I most productive?”"

DailyViz notebook

The DailyViz blog gives an example of finding all relevant correlations in a large, personal self-tracking data set. The blog post show the interactive analysis of their data with some surprising results. The notebook is available.

Habitdash

Habitdash's Automatic data analysis searches for hidden patterns to find relationships between activity, sleep, weight and other habits.

Optimized app

Optimized claims to do "automatic correlation mining"

List of very technical tools

This article is a stub. You can help the Personal Science Wiki by expanding it.

Linked content on this wiki

(The content in the table below is automatically created. See Template:Topic Queries for details. If newly linked pages do not appear here, click on "More" and "Refresh".)

Tools related to this topic  
Projects related to this topic  
Self researchers related to this topic  
We talked about this topic in the following meetings