There are 2 different "Tegra4" chips. The Tegra4i is the only one that will ever end up in your smartphone, and it only includes Cortex A9 derived CPU cores and a GPU that, while quite good, includes far few processing units than the big-brother Tegra 4.
So basically: Of course the full-blown Tegra 4 beats smartphone chips. Guess what: So does Haswell, but you won't be seeing Haswell in smartphones either. There's a price to all that performance and Nvidia is targeting the heavy-weight version of Tegra 4 at tablets because the power draw won't fly in a smaller smartphone platform, where the Tegra4i will be Nvidia's offering.