Walking on road while on call at night.

I was walking in my neighborhood while on a call. It is like 11:30 pm, when a neighbour came out the door and yelled at me and said something like " ghar ja apne, raato ko kyu ghoom Raha hai?" He did it really aggressively. I didn't know if I was allowed to walk late at night while talking on the phone. So I complied and came back to home. I wanna know if I didn't, would it have been illegal?