It depends on what else is available. If you work in a specialized role and might not have many other opportunities, then it might be a good choice to go. However, if you work in a non-specialized field (finance, HR, IT), etc. then I'd stick it out where you are and see if you can find another opportunity without the drawbacks.
It sounds like you'll be leaving a position you're currently indifferent about for a position that you might actually come to hate after a while (long commutes and long stressful hours make this more probable than you might think). There's a big difference. You can suck it up and bear the former for a while. The latter tends to make everything in your life miserable.