What to do if the husband is cancelling the court marriage

I got married in Ghaziabad court on 4 may this year with my boyfriend because we thought I was pregnant.i had home test but not the blood test.because he had already broken off with me and I was not ready to trust him.he got ready to do court marriage.then second day we took blood test and my pregnancy test was negative.now he is asking me to withdraw the court marriage saying that he has been cheated.he talked to his lawyer who said that by giving some money our marriage can be deleted from the system.i don't know what to do.i had already faced a divorce.i don't want to face another legal issues.my focus is to save my marriage.what should I do.and can he get our registration of marriage be deleted??? Please advise.