It's pretty telling that in the starting credits for every episode, he reduces their mathematics and computational genius to "Sylvester's a human calculator", and he implies that because they are smart, they need a "normal" person to translate the world for them - when in reality, people are called geniuses because they are better at translating parts or all of the world than the folks they call "normal". It's a blatant fallacy that people that are smarter in one aspect have to be at least correspondingly dumber, if not more, in the specific aspect of social relations.
I know it's hard for writers to portray characters that are far smarter than they themselves are in any authentic way, but what this really means is that for this show in particular they need to hire some much smarter writers. The last thing we need is crowds of people living in fear of becoming smart because their social skills will wither and fall off.