How to take actions against abusive neighbours

The person living opposite to our house always threatens us and abuses to our family and relatives. Too much aggressive that he starts fighting to people who are good to us. What to do because we are really fed up with all his crap. Everytime he just threatens us that he will get our home sealed, will get us removed from our job and last but not least he says, he has great links with ministers. We have been getting through all this from past 3 years. He start calling cops on his own and then tries to take us all along with him to police station.