Many people are encouraged to just "go for it" because if they fail they can always go back to an ordinary job and try again. However the risk equation changes when you have young children you care about since (in most cases) you're the only parents they have and they are only young once. Even if your startup is successful you'll never be able to get back the time you miss with them.