I have a Samsung Note 2. I chose it for the big screen, since I frequently read things on it, and like to be able to fit a few paragraphs of text on the screen at a time instead of scrolling every sentence. My next phone is already purchased, a Sony Experia Z Ultra. Even bigger.
Bigger screens, I think more due to plain old physics rather than anything that could ever be helped by construction, are prone to damage, and I've cracked the screen on the samsung. Somewhat economical to fix, only about $100.
I really liked my Motorola android phone (Droid X - too old to get now) and my husband has the Moto X (also being refreshed this fall). We have found both handsets to be very very durable, with no material or electrical faults. The things I love about his Moto X is that the camera function is super easy to get to with the corkscrew gesture, and the always listening google voice. Very nice in the car, he can just tell it "OK Google Now, Call Arila" and wherever the phone is in the car, it calls me without him ever taking his hands off the wheel. It also has super endurance battery life. He forgets to charge it sometimes overnight, and it goes on 'til the next day! I would totally have a moto x if my primary buying decision wasn't screen size. (Are you listening Motorola? I want a phablet!)
Honestly though, when I was considering Apple or Android, I considered more strongly the communication modes of those nearest and dearest to me. We were already using google emails, and google calendars and google chats (now hangouts). If your husband has (and is keeping) his iDevice, will you be blocking one of your normal communication modes? Even if I was willing to move to Apple (I'm opposite to you, the 6's were finally appealing to me - see commentary on screen size!), I wouldn't do it, because my communication streams are so enmeshed with google that it would be a real headache to go over unless I organized a family-wide coup.
I would also just do some research. I mean, we are talking hundreds of dollars to be spent on this, so take an afternoon or two this weekend and go to CNET and read some of the articles. They are big fans of comparison articles between "flagship" phones, both Android/Android and Android/Apple. They compare things like performance and battery life, and maybe some other things (camera quality) that you might not realize you care about.