What to do in case both party lawyers conspire against the litigants?

I did filed a civil property case few months back in court with an advocate by paying his full fee. Few days back we got knew that both lawyers playing games without taking interest in suit, As we lost trust in respective advocates, We both plaintiff and defendants agreed to reach a settlement out of court mutually and happily and resolved problems. As the both side advocates got information that we reached a settlement, they are refusing to withdraw the suit, not giving noc, and demanding huge money other than already paid fee. In the honourable court, the trail is in going on. We contacted Lok adalat too to help us out but they too mandating both side lawyers. Pls help with advice and procedure so that we can withdraw running suit without advocates or with new advocate. Thank u.