Your experience is just that - your experience. You're clearly not aware of the "bullying" that is real and occurs due to message bubbles from Apple forcing SMS on its users. So while you may not care, the average Apple user does. And the average Android users notices and now cares as well due to RCS vs SMS.
It's all quite complicated actually, but know that the original cultural problem comes from Apple, and the Android people that hate iPhone people is a reaction. You can judge that reaction, but understand the order of events.