They use the term esport to differentiate from traditional sports. Clearly it's what would be categorized as a competitive game, like poker, chess, and other competitive games, and not a sport, which historically differed from a competitive game via athleticism.
In that sense, would you consider bowling or golf sports? Certainly neither are what most would consider athletic. It's more or less a meaningless distinction, though.