i've mentioned this before, but i started (almost finished) a BA degree in the early 1980s when i was 20. i never finished and it has bothered me for years.
when i was 44 i finally took the plunge and went back. a friend told me "take one class and see how it goes". i started with two classes (they were the two main pre-requisites in the department) and loved it. i was going to school part time (very very part time, a few hours a week), working full time, and being a mother. it took me four years and i finally completed my BA ( I had to actually start almost from scratch).
it is hard but it also fun. it may be harder for you than for the younger students, but you are also probably a lot more disciplined. you will (probably

) not show up to class in your PJs, hung over, bleary eyed asking "was there an assignment due today? um, oh, she's giving us a quiz? on what material?"