My wife went back to school in her 40's and got her Bachelor's degree, Master's degree, and began her PhD. The key was that she went to the (fully regionally accredited) Anthioch University campus in Santa Barbara, which (at the time, anyway) was geared 100% toward "adult learners" with at least 1-2 years of college credit already. (Note: It is an expensive private school, but if you want it bad enough and can get loans and/or scholarships, it's doable.) Their approach is different from that taken with freshly-minted high school graduates, acknowledging that most adults who return to school have a complex life built up during their years away from formal education, and are at a different place in their life than someone fresh out of high school. There are several things they do differently: class size is very limited; the "quarters" (or whatever) are only 10 weeks long and very intensive; you can opt for letter grades or pass/fail and you are evaluated entirely on class participation and the many MANY papers you must write for each class, usually including a final paper that demonstrates mastery of the material. Classes are scheduled in such a way to better accomodate the student's outside committments, such as family and work. Some students take all their classes on weekends, while others stack them all on one or two days a week, or evenings. Some students find that going back to school surrounded by others who are doing the same thing is more supportive of their efforts.
Bottom line to what I'm saying: Check out other ways of going to school. Distance learning can be a good option because there are several ways to make that work. Schools catering specifically to adults that are returning to school after an absence are another option.