Temple land reflecting as state govt land

My ancestors used to have lot of lands in my village out of which some land was alloted for temple where small temple was there , my family took up that temple and constructed a new big temple , now the village president and few others want to grab it saying it's under panchayati land , We wish to construct Mandapam also as an service for our godess but being objected by locals with support of president and building some cattle shelters in the nearby premises . what all options do we have ?