Is he tying you in chains and forcing you to work for him?
I bet the answer is a NO. Stop complaining about him unless he is causing you some kind of harm. He is fulfilling your needs, you can't expect him to be a saint. If you hate him that much, move on and find another job. Otherwise man-up and do your job.