I grew up not too far from Newark Liberty Airport, and some of the flight paths went right over my house. I can recall, growing up, the powers that be wanted them changed, as our town was an "upscale" town, and therefore shouldn't have to deal with the noise. FTR, it wasn't that bad, and after a while, you didn't even notice it.
My last apt was also in a flight path for that airport, plus i lived less than 5 miles from a small municipal airport that catered to mostly corporate jets, as well as being on the route for helicopters heading to the local hospital where there's a Level 1 trauma center. At times, esp with the helicopters, and due to the old cruddy windows, they'd fly low and they'd rattle, but again, nothing you couldn't deal with.
what was worse for me was right after 9/11, when all airspace was shut down, was the quiet. I'd been so used to the background noise of planes, when there was nothing, it was kind of creepy.