Can I be a Cohabiting partner in a different country without divorce

I got married as per the Hindu marriage act. Got married November 2010; due to various differences, we are living separately in the same premise since January 2016 and different cities since October 2016. She was cheating on me once during 2014 which we sorted and then again the same happened by end of 2015. I have been asking for a divorce through mutual consent but she is not ready to give. Sometime during August 2016, I found someone whom I liked and she is a foreigner. It has been a year now and I want to move in with her in her country as a Cohabiting partner and she is ready to sponsor. I have already removed my wife's name from my passport stating we are separated and now I am planning to apply for a visa. Considering the situation that I am still legally married, I am now worried about the list of legal problems that may arise because of this. My wife doesn't know about this new girlfriend. Please advise