Case quashed. No appeal made. Can the case be called for re hearing?

This advice is purely on the presumption that your 498a case was quashed in Dec 2012 by the High Court in some settlement, and your brother was a party to the same. It is not clear why your brother has filed the Oct 2013 civil defamation.

It may be noted here that the application for re-hearing in the same high court is a repercussion to the same and / or in violation of the same settlement. At this stage, you may raise objections to said notice before immediately rushing to the Supreme Court. You can file contempt petition if the need be.

The High Court has ample powers under writ jurisdiction and other provisions for parties for redressal.