How can I throw my father out of the house legally

My Father has 2 wife. I m the son of 1st wife. We are 3 brothers. My father's 2nd wife has 6 children. He did not give divorce to my mother till now. He has many case against him. As per my knowledge, 2 murder case. He was leaving with his 2nd wife for last 30 years. His 2nd wife died 2 year back and now he is leaving with my mother in our house which we built 2 years back. But I am not interested in that. I don't want him to stay with us but unfortunately my mother wants him to stay with us. The land on which we built the house is in the name of my grand parents (My father has 4 brothers). Main problem is , he has a habit of scolding everyone, dunked every day. My son, wife as well as my younger brothers also don't want him to stay with us. They are not feeling safe. Unfortunately my mother wants. Even he beat my mother sometimes. He is a goon. I fear for my life and my family's life if i argue with him. Please advice us how we can throw him out of our house