If I were u. I would drill him  by askin what he meant by that. You should ask him sternly if he really meant it or he just said it in the heat of the moment. If he did mean that he doesnt wanna be wt u, I see no point why u wanna stick around wt a guy who doesnt even love u. You can do better.