Analyzing the results of your leanstartup experiment!

Can you distill early stage entrepreneurship into a process? I don't know the answer right now... but we are going to find out! Thanks +John Sechrest for galvanizing this post...

This is the best part...! You have picked a risky assumption, converted it to a sound testable hypothesis and run an experiment. You have run the experiment and reported on your results. How best to truly interpret these results. If we were going to try and turn this into a formula - this is what we would do - we would go directly to the prediction vs results.

DID THE PREDICTION COME TRUE? YES OR NO
IS IT ACCURATE?
HOW FAR OFF WAS THE PREDICTION
DO WE KNOW WHY
WHAT DO WE DO NEXT


  1. Did not meet criteria... false negative 
  2. Did not meet criteria... true negative 
  3. Met criteria... false positive 
  4. Met criteria... true positive 
SCENARIO ONE (use sparingly, another word for FALSE NEGATIVE is EXCUSE)
  1. failed numerator 
  2. failed denominator 
  3. tested at the wrong time?
  4. right people didn't BELIEVE the solution was possible 
  5. tested on the wrong people (this is a true negative for the segment you tested on though)
  6. couldn't find enough people (this is an indication though) 
  7. subjects flat out didn't understand the experiment 
Pivot is too strong a word at this stage... here are the LIKELY adjustments an entrepreneur is LIKELY to take after a perceived false negative... 

Here are the likely adjustments we think they should take...

SCENARIO TWO 
  1. High denominator with custdev - extremely low numerator... explicit learnings are "NO PROBLEM, HAPPY WITH SOLUTION
  2. LOW numerator after 3 tries or 6 months

SCENARIO THREE 
  1. Asking friends and family - not the customer 
  2. Not testing the riskiest assumption 
  3. Asking other segments who have a vested interest in your startup succeeding (service providers, etc)
  4. The red herring experiment... "Free beer if you sign up for our Petfood delivery service" Entreprenru interpretation - people want the Petfood delivery service... Everyone else "people want free beer"

SCENARIO FOUR
  1. WONDERFUL... despite all of our feedback... we are actually rooting for this! Can you repeat it? If you got 10 can you get 100 in the same amount of time? Can you automate it? Can 
Post a Comment

Popular Posts