That's my point, is that in most cases the amount of traffic isn't there to support such an AB test.
It is also very difficult to isolate all other variables in the conversion funnel. For the case of an online software startup with an inside sales team like we have at Central Desktop, it's nearly impossible to say that every signup gets the same sales attention and is pitched in the same way.
Of course every case is different, but I'd argue that most startups don't have the traffic or the ability to isolate ALL potential variables in the conversion funnel.
If you don't have traffic, you don't have traffic.
You don't have to isolate other variables. Just make them randomized, and they become just another factor you don't know that is handled by the statistics.
It is also very difficult to isolate all other variables in the conversion funnel. For the case of an online software startup with an inside sales team like we have at Central Desktop, it's nearly impossible to say that every signup gets the same sales attention and is pitched in the same way.
Of course every case is different, but I'd argue that most startups don't have the traffic or the ability to isolate ALL potential variables in the conversion funnel.