Brother troubling us how can we disown him

Dear Sir, I need to break my relation with my younger brother. Reason being he is not treating us well and blaming us for his failure in business. Though after my father passed away, I have not claimed a single paisa from my Fathers belonging movable or non movable. However now-a days relations are getting worse and he is not at all listening to us and troubling us whole day by calling us at odd time and at office hours. Though I am married and living in separate flat. My mother is also living in separate flat. Please guide suitably to avoid being getting humiliated.