When I'm talking about holidays, I'd think someone who always needs to point out they don't take them was a chump. The same would be true if it was concerts, sporting events, computer games and yes, shock horror, television. It doesn't matter how much people talk about TV, you aren't obligated to go on about not watching it every time they discuss it and doing so comes across as pretty pathetic not as a sign of a more culturally enhanced existence.
I didn't watch any TV bar the odd news bulletin for years, I probably watch ~1-2 hours a week now via iPlayer/Netflix. I don't think anyone I know, who hasn't stayed at my house, would know and that's not because I hide it like a dark secret; it's because I don't inject it into every conversation I can as an attempt to build an image. There's some really great TV out there, so depriving yourself of it on principle just comes across as stunting yourself for ideological reasons. There's just been an excellent show on the relationship between the Kaizer, Tzar and British King in the run up to WW1 for example.