No matter how beautiful other's wife is, I would never try to bang her, particularly neighbor's. I have been in these situations before. Ethically its not good. If you bang other's wife, they will bang yours.
There is plenty of fish. Find one for yourself in the ocean.