Property issue Transfer of ownership within family

My father had purchased a land in my brother's name later he constructed 2 floor home on the land with his money and using my brother housing loan considering one floor home will be for my brother and other floor for me. Two years back My father closed my brothers pending Home loan after my brother agreed to transfer the ownership of one floor building to me as already agreed. I have audio proof of this oral agreement. Since it was agreed to be given as my share I have beared all the expenses(property/Eb/water bills) and my father was receiving rent of that share till date. Now my brother is refusing to transfer the ownership to me or to my father and not allowing me or my father to use or receive rent from my share. Can I proceed legally with this proof to acquire the ownership of my share.