Would you drive with 4 kids from Toronto to Florida?
I personally don't see sitting in a car for hours at a time as a vacation. An option might be to go someplace close and just enjoy yourself. We have had great vacations just a couple of towns over. A vacation is disrupting your schedule in doing different things.