I 10000% know this feeling!!!! And to answer the question you posed... No! It would definitely not be bad to escape for a little while. The complete opposite is true actually! It would likely be the healthiest and most beneficial thing you can do for the sake of your own emotional and mental well being! I often would drive to the water and sit for an hour or so if I had a rough or extra stressful day at work. That way when I get home I'm not still wound up, stressed out, and short tempered toward my family.
I've been working from home for the past year. Part of me absolutely loves it but a BIG part of me misses my "me time". Driving with the window down, the music up, and singing my lil heart out to it's own content!
Taking time for yourself is good not only for you but for your family as well. If we aren't in a level state of mind we can't be the best 'me' for anyone else<3