Gifted my part of land to my brother on false claims what to do now

My brother proposed to start construction of a house in the property. We intended to apply for a loan with the land as collateral. My brother provided false files which showed that loan cannot be taken because of my poor income tax files. I gifted my property to him without anything else mentioned in the deed. I made him sign on the stamp paper which says the second floor of the house will be named to me. It has been 3 years and now my brother refuses to construct or to give me back my part of the land.