How to remove co-borrowers name from buyer agreement

While booking a flat in Noida 7 years ago, I made my younger brother as co-applicant in bank and co-borrower in builder buyer agreement. Now, I am staying in the flat after getting possession since last 3 years. I wished to get the registry in my name as all the payments including EMI were paid by me. Now, when I came to know that my brother's name has to be removed from the bank co-borrower in order to get the deed in my name, I approached him. He is now denying to withdraw his name and wants that registry should be in joint name. I do realise that adding his name was my mistake in the first place itself. Please guide me if any way out or legal remedy is possible in my case.