RBL bank credit card - Cibil Score Downgrade

I have been using my RBL Credit Credit since abouth *-* years, since **** due to lock down and job crisis, i have been not using RBL credit card. So in **** i have called them and asked to waveoff annual fee, they said ok, and again after *-* months they have again added annual fee and month by month they have adding Late fee charges, i called the customer care and ask them to cancel my card, but they said they wont do until i pay the annual fee with charges, due to that i lost my cibil score , i used to have *** cibil score it came down to ***. So please resolve this issue...