Renovating flat - neighbors objecting to noise

I'm renovating a recently bought flat. We plan to remove existing tiles and relay new ones. We started the demolition work today with electric drills. We are following all building/society by-laws (i.e. work only allowed from 9-5pm, rest period 2-4pm, no-work on Sunday's and public holidays). We even proactively offered a 4-star hotel accommodation to all affected residents for a period of 3 days where intensive demolition was planned. No floor plan change was part of the plan - only in-room demolition i.e. kitchen counters, shelves etc. One neighbor threatened to go to Pollution control board or police and lodge a complaint on excessive noise if we did not stop work? Can my neighbors do that?