They most likely had a family and a harvest to return to back home - viking raids generally were seasonal in between farming, so they had a built-in time limit.