I understand your problem  bhikari bro!! I had that problem and that had turned best fren into enemy and we didnot talk to each other for whole one year ,now we have better relation but i am not sure he forgot it all I still remmember bad things that hurt me as well, may i did hurt him as well.There is truth in saying" Jati tadha uti maya gadha".

Bro You should find solution best solution comes from discussion , be patient and not aggressive tell him what you feel i guess he understands that if not then you have to know he is not ur fren ,if it really affects you in terms of long range, beware bro ... think once again!!