If your so called friend was really a friend, he would not put you in this situation.  So,  just be a man and be firm about telling them they need to find another place to shack up.

Unless he has some hook on you, I see no reason why you have to tolerate this.