Somewhere upthread, someone mentioned that they seldom see people with disabilities out and about. I don't remember who said it and I don't want to seem like I'm picking on them. Because they spoke the truth--you do seldom see people with disabilities in our society.
The question is, do they stay home because they are disabled? or do they stay home because their mobility is severely limited once they are out of the house?
If you can't get into the store or the restaurant, you can't be seen there. If you can't use the handicapped restroom stalls, you won't be seen at the museum, or the theater or the concert hall.
It is very possible for a building to meet every bit of the code for disabled access, and still not be accessible for the needs of a particular individual. Grab bars in a restroom might meet code, but be too high or too low for someone. The wheelchair height drinking fountain might be too low for a very tall person in a wheelchair, or too high for a very short person, or the wheelchair itself might make access difficult or impossible. If you can't drive, your ability to get around is limited, especially in the US, where public transportation is limited. The cities with good public transportation, like NYC and Boston and Chicago, tend to have older stations with limited or no disabled access (they are working on it, but retrofitting 150 year old underground stations isn't easy).
There are an incredible number of factors that make everyday life difficult for the disabled. Not having enough handicapped bathroom stalls is just one thing.