Your post made me curious about expansion, so i read the wikipedia article.
It sounds like expansion is only occurring on a very large scale, where matter isn't gravitationally bound. So things outside the milky way, andromeda and virgo cluster are expanding away, but there is no expansion within.
So your hypothesis is wrong. I've often wondered though if there is some fosilization phenomena that could cause them to grow over time.