You have to compare the worry over potentially losing investments to the worry of not having any investments or rainy day fund at all and being totally at the capricious mercy of an often cruel and arbitrary economy with a minimal safety net.