Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yep. I have an A/B results page which automatically collects closed tests. http://abingo.org/results 75% or so of tests get a null result (A may or may not be better than B.). Lots of the remainder tell me to what degree of statistical significance my great new idea for improvement sucked. But you can still improve over time.


Hey Patio, thanks for sharing that link, I didn't even know that page existed!


Oh, that is awesome! Do you adjust for multiple testing? You could do so and then test an overarching hypothesis (say, that there is at least one test on that page that differs from what would be expected by chance when looking at N tests).




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: