Degree or not. I'd say it depends on a several factors.
First, and probably the most important, I believe, is how bright (IQ) you are. I'd say that you might fare better over the long term with a degree if you IQ is 120 or less. Less than 110, then consider a different career.
Second, is your personal learning style. If you learn best in a classroom setting, then the degree is probably the way to go. If you can RTFM and figure it out yourself, then you may do fine without.
Third, is your overall career goal. Sysadmin is a good start and pays well enough. If you think you'll do your entire career in sysadmin or operations management, then no degree might be OK. If you see yourself designing and coding software of some significant complexity, or managing software development then the degree is probably a good idea.
Fourth, is the curriculum you plan to study if you pursue the degree. If your aspirations are toward software development and design, then the curriculum should have courses specific to that career direction. I do not mean programming language courses, but theory courses such as analysis of algorithms, discrete math for comp-sci, and the like.
From my own personal experience, a high school dropout with a GED, there were times over a 30-something year career where I faced software development issues where I knew the degree, at least some very specific knowledge during the pursuit of the degree would have helped a lot. There was one assignment where my employer told me to go buy the books, take 3 months to learn the pre-requisite theory (on their nickle), find a mentor among my peers, then do the job. I did exactly that, but that was a good employer and I had a good track record with them.
There were at least two jobs I did not get because I did not have a degree. In retrospect, those two jobs would not have benefited my career anyway, but there were doors closed because I did not have the degree.
Given my career goals, given the advances in compsci over the years, given the kinds of jobs I had, the degree would have been a good thing. Then again, at the time I was of age to have gone to college (1963), there was no compsci, or IT focused degree.
On reflection, at the time I retired (2001) I'd say that there were, and still are, some holes in my software development education. Had I been able to pursue the degree when I was younger, I might have taken a different path through my career. That path not taken may, or may not, have made a difference in job choices, money made, my personal legacy, ... whatever. At this point, it's moot. For you, however, your decision now will influence your long term career outcome.
JMHO, YMMV.