Oh hey I can answer that as I went through something similar. I don't think that there is anything you can do to not "make them feel bad". I say that you have to communicate with your partner clearly about how you feel and why you want to leave/ why things aren't working out. Short and simple.