Go for it. You pointed out all the good and bad sides already. So, it mostly depends upon your ambitions, your priorities. Gov jobs offers way better WLB but at the cost of relatively less base pay. If you are starting at higher GS level (or equivalent), you will be fine.