In other words, these persons have made a decision to sell out their neighbors by putting their own welfare ahead of their neighbors' to a magnitude that will forever change the lives of their neighbors, harming their health, happiness, property values, etc.
So in this case the neighbors are fighting back which is the only thing to do when a neighbor and perhaps so called friend decides to sell you out. Don't let them tell you that you are interfering with their property rights. They are the guilty parties who have decided to interfere with you. Show them they have interfered with the wrong persons.