Maybe, but I'm not sure that's a very good reason. The only times that have a different word for them are "noon" and "midnight". Every other hour is identified strictly by its numerical value with the am/pm (or in 24 hour time, simply its numerical value). 12:00 am or pm can still be identified by that value whether or not the word "noon" exists. "Noon" is redundant at best.
Consistency is an interesting point, but without too much effort I can think of words that have different meanings today than they did when I was growing up or even 10 years ago, so the idea that communication does not change does not have merit. Noon could easily fall into that category.
Agreed that someone has to be GMT. But that doesn't mean anything as again it's just numbers. Different places would still be offset. There is nothing that ties daylight hours to the hands pointing to a specific position on the clock. My sunrise could 1pm, I start work at 3pm, leave work at 11pm, and still have a few hours of daylight until I go to bed at 4am. Right now when I work with someone on the other side of the globe I have to think "what time is it there". If we were all just GMT I would be thinking "what are that person's work hours". Not a huge change IMO.