Bank sent legal notice directing to pay credit dues

Hi!. I hada credit card (with 30000rs limit), but due to some financial problem due to my unemployment I had to exhaust my savings as result credit card couldn't debit charges from my account and hence they kept calling me and I told them about my ordeal and now they've sent me a legal notice asking me to pay 7412 rs( please note that the entire amount is only the credit maintenance fees accrued over time and I have never used the credit card to purchase or pay for any service), one of their managers said ( when the amount was around 3,000rs due) that if I won't pay it will affect my CIBIL score, I approached the credit card manager but like bank employees he just wants money and not ready to understand. I also replied back to the bank's Legal department but they haven't replied back at all can't pay the amount mainly because I never used the card I just want to know if I don't pay will I be in legal trouble or will it only affect my CIBIL score. Please reply