Children Custody and permission to meet

My husband and me are away since 2 months due to clashes and I am staying in my mom place. next month I have plan to shift Bangalore and stay separately with my 2 kids. My husband is telling indirectly weekly 2 days he will keep kids and 5 days with me. neither he nor me sent any notices to each other and I dont even want to send. the only thing I want is he should realize his mistakes. I dont want to leave children even for 2 days until our problem resolves . Can I say no I cannot give children for 2 days also?. What if he bring legal notice from court to give kids? nissue between me and husband is he is irresponsible, drinks a lot, ask my bank statements , he dont let me to help my parents family who is running through financial crisis , he always abuse me and my parents family including brother , he is more possessive about his mother, directly he tells even his mom is wrong I have to keep quite, he forces me to quit job and become housewife