Mobile application related issue

Save Dear sir/madam, In this lockdown period om 24th April I called a customer to download my company app for his benifit, but he is unable to do the same than I said to him please download team viewer app so that I can help you he downloaded than I demand partner I'd and I said when you will provide me partner I'd than your phone will connect with my phone but he denied for partner I'd than I said ok please do it yourself he is ok after 1 hr he called me that you are trying to do fraud with me by teamviewer app than I tell him nothing like that I am trying to just help you but when you are ready to do it yourself than I was ok and also said when you are doing self so you can delete team viewer app. Sir I didn't access his mobile, he didn't share anything with me. But he is saying to take legal action on me What should I do please help.