While I'd agree with you that having a CS degree isn't required for many jobs in IT, there are plenty of companies who are stuck on requiring a BS or BA degree of some sort to even consider you. So, not having that will limit you somewhat.
I also know having a CS degree alone won't get you jack. You will need some skills beyond the degree to get a job. Then again, the point of a CS degree isn't to train you for a job in the IT field, but to give you the foundation and understanding about how things work with computers, OSs and algorithms, which can help give you a greater understanding on how things work and make learning some concepts easier.
I'd never demean someone for not having a CS degree, since I've known many talented and skilled people without one. That being said, I also know the value of what you learn with a CS degree, and I know that it is more than just a sheet of paper.