You can do couple of things that might work

1) Start by writing a letter of complaint to 3 parties (same letter) owner/property manager and the tenant upstairs...by complaining in writing you can break the lease if bad comes to worse.  Make sure to get a receipt for delivery of the letters.  This is to prepare if it goes to court.  If you can record vdo tape noise, conversations etc..Be clear precise and discriptive

2) Talk with the landlord and tell him next time you will be forced to call the police on them if they continue their irrational behaviour...and KEEP YOUR WORD TO CALL THE POLICE

3) Do not confront the tenants anymore it will only lead to altercations, call up the landlord at 2 or 3 am or whenver problem occurs.

but start with 1 then follow the rest or bite the bullet and move out but what if this happens again? you cannot be evicted if you abide by your lease terms.