I would not worry too much about the dust really. Most of it is on the floor, your 12 day old, as you said is not there. If the baby's room is clean and the work is not in progress at the time the baby is there, I doubt there will be a lot of inhaling. Most of the dust will have settled.