Personal Development, Self-Experiments, and the Future of Search
Monday, May 16, 2011 at 8:38AM [Cross-posted to Quantified Self]
We experiment on ourselves and track the results to improve the way we work, our health, and our personal lives. This rational approach is essential because there are few guarantees that what works for others will work for us. Take the category of sleep, for example. Of the hundreds of tinctures and techniques available, clearly not all help everyone, or there would be exactly one title in the sleep section of your bookstore, called "Sleep," and no one could argue about its effectiveness. Treating these improvements experimentally, however, requires a major shift in thinking.
But being human isn't that simple. There are variables and confounding factors that mean you have to take matters actively into your hands if you want to really know what's personally effectual. That's why what we do here is so exciting. Instead of accepting common sense, we take a "prove it to me" approach and work to find out for ourselves. Operating from this basis, rather than faith, is more effective in the long run. (It's why we use science to understand the world, rather than astrology or phrenology, for example. Just look at what we've accomplished.)
As I tried to say in Making citizen scientists, this is heralding a move from citizens-as-helpers to true citizen scientists - people who get genuinely curious about something and decide to test things out for themselves, rather than simply trusting what others say will work. If we expand that vision five or ten years in the future, I think there could be a major shift in how we search for ways to improve ourselves, and that's what I want to share here.
Picture that you have something you're trying to change, and you want to find starting points, especially what's worked for others. Ideally you know someone who can point you in the right direction (medical professionals come to mind), but rarely do our social and professional circles cover everything we want to improve. Normally we are on our own, and must sit down and courageously cast ourselves into the vast sea of the web. What do we find? An insane number of hits mysteriously organized by clever algorithms. Again, take sleep. My search for insomnia yielded over three million hits. How do we decide how to use these results? I think the fundamental issue is of trust. How can I trust what I read if there is nothing backing it up? Google is great for some things, but for self-improvement, what I want isn't necessarily what's popular (let's face it, the popular kids at school weren't necessarily the smartest - spoken from experience). What I want is something that's a reasonable starting point. That is, something that has a high likelihood of yielding useful information that moves me quickly in a helpful direction. (My scientific colleague calls this exploring the "search frontier.")
Instead, what we have is a immense collection of definitions, blog posts, news articles, how to's, marketing literature, product reviews, fringe nuttiness, and the like. In other words, a Wild West of self-improvement. Exciting, dangerous, risky, unproven, and loaded with potential.
What's closer to what we want are the discussion board threads and blog comment exchanges where people shared what they tried and what has and hasn't worked. After a quick search, two examples that came up in the sleep realm are at talk about sleep and iVillage. However, we have three problems. First, my search for insomnia discussion boards still generated almost three million hits. That means we don't know where the quality work is taking place. Second, and far worse, is that the way people have gone about their search for solutions is rarely principled. This is because applying a scientific approach to self-help, as I tried to explain above, is still rare. (Want to test that? Just try to tell someone why you're reading this site, and watch the confusion on his face. "You're tracking what? But WHY?") With questionable methodologies come questionable results. Finally, if there truly are well-run experiments, they are scattered throughout the site on various threads, the data is not likely in a form we can analyze, and it's very hard to find who else has tried the experiments and what they discovered. In other words, the knowledge, experiences, and results of everyone's hard work isn't structured or centralized. And that's a massive waste. 
Now imagine that there is a community of self-experimentation tools that meet the three characteristics I outlined in my experiment-driven life talk (my original post is here): Broad, Social, and Scientific. On these sites will be records of millions of past and in-progress experiments being performed daily by thousands of citizen scientists, both individually and collectively. They will be structured to expose what folks did specifically, how the process went for them (in some ways as important as results themselves), what the data was, and how they interpreted it. And they will have targeted search tools to find experiments in a variety of ways - topic, treatment type, ratings, etc.
Visualize yourself going to one of those sites and searching folks' work for your topic. Assuming they're structured reasonably, you could find something marvelous: Actual personal experiments, around your situation, with their data and conclusions. Wow! This should allow you to get a summary view of the things people have tried, who else tried it, and what they learned. In other words, it would be a data-driven entry to deciding what I should start trying.
Ultimately, I envision this moving towards a kind of personal development "general store" where instead of facing an intimidatingly large self-help section in your bookstore (i.e., the big-box help-yourself model), you come to a desk with one person sitting and asking, "How can I help?" You tell her your topic and a little about yourself, then ask for advice. The clerk, who has read all of the books on the subject, answers, "For someone like you, the most effective experiments were ..." and lists five or six to look at. I think of it as a kind of intelligent, experiment-based search engine that factors in personal data, demographics, and topic (maybe as simple as keywords, for starters) and serves up ballpark suggestions.
What do you think? My ideas are still developing, so this is still a little rough, but I honestly believe we could build such an ecosystem. Are you with me?
Reader Comments (17)
Does your vision have to be experiments/data only? What about communities of experts -- discussing/doing things/answering questions/teaching -- Could be anything: dance/green building/bee keeping/burning mouth syndrome. Some merger of edison/stack exchange/wikipedia/the library/cohousing/meetup.com?
One problem is that people tend to report successes more than failures.
Another is that we might wind up with a million different experiments, and find it hard to lump and compare. Perhaps we need to commission some experiments that we can all rally around to get some numbers in some cases.
I'm following this blog now, so I look forward to seeing how your ideas progress here.
I really liked this article. I have been really focused on personal development for the past 2 years and I agree that it's really hard to sift through all of the information out there.
When it comes to learning or teaching, I like everything to be simplified as much as possible. it becomes overwhelming with all of the information out there. I started my website to try to get kids out of high school to focus on personal development. I try to keep it very simple with my website and teach based on my experiences.
I think that everyone needs to define their niche, become an expert in it and teach from their experiences... whatever it may be. It's all about making a personal connection with someone who needs your guidance. Then they have someone that they can relate to and you are able to pass on your knowledge more effectively.
I'll keep in eye on your blog =)
I see you've been thinking about these things for some time. I'll have to read more to try to catch up, and also check out Edison some time.
I taught critical thinking to college undergrads for a spell, so I come at it more from the perspective of teaching people how to avoid fooling themselves as they try to explain the phenomena in their lives.
I also love the power of crowd-sourcing, when done well, so I'll keep an eye over here, and see if there are opportunities to contribute along the way.
Yeah that's right.
For example, I spent years after high school struggling to find my purpose in life. I didn't have any direction and I was always searching online for that one piece of information that would help to move me forward. After reading through tons of articles and purchasing many products, I finally came across something that helped me to develop a deeper purpose in my life.
It took me years of struggle to find ONE program that actually helped me in my situation. That's when I decided to create a website, www.afterhighschool.net, that would help people who are now in the same situation I was in to find their solution without the searching. Anyone who finds me online will be provided with the guidance they need to take the next step in life after high school. Everything is highly targeted towards after high school guidance.
So basically I'm the middleman. I was in a situation where I didn't know what I wanted to do with my life, I figured it out after years of searching online, and now I'm introducing this product that helped me to my targeted audience.
Everybody has learned to overcome something in their life that they can then pass on to help others. It's all about defining a specific niche based on your story or your experiences... mine happens to be finding my path after high school.
don't usually do, or may even be afraid to do sometimes. Experimenting is a good way of making
us grow personally and professionally. Your post is very well done and contains great helpful
information and tips. Thanks for sharing this to us.
experimenting on things that can harm us like drugs. You have a very great point of view in here.
Mind Zoom
7 Foods to Burn the Fat Fast Discover How to Loss Weight Quickly
http://xxxxx.mindzoom.hop.clickbank.net