We're not talking about rights. we're talking about freedom.
Not having the freedom to put graffiti on your fence is less freedom. Obviously I don't have the right to do such a thing, but it is a reduction of my freedom. (hopefully that analogy helps you understand the difference between a right and a freedom)
Now that is out of the way. If I cannot incorporate your code into my project without changing my license to match yours, then I have less freedom. (you can use the physical sense of the word, as in degrees of freedom, if that helps you understand.). You failed to grant me the right to do as I please with your code. Instead of a gift, you have shared something you made with some strings attached.
That's fine. I don't blame you for not giving me gifts. But my code is a gift to you. I expect nothing in return, I do not expect you to reciprocate and carry on with the gift-giving. I only hope that it brings you some happiness or ease in your life. If my code saves you an hour of work on a project, an hour you could spend with your family, then that is really the highest measure of success in my opinion.