The core Date module doesn't have dependencies, you don't have to enable the integration modules.
The Date module could be split into a several different projects by just copying folders into a different Git repos. Would it make any real difference, no.
PS Another reason the Date module is large is it's history back to PHP 4, which it maintained compatibility with for a long time. As PHPs included DateTime classes improve (and fix long standing bugs) it can get smaller.