Then you haven't really transferred at all, have you?
Plus, I have some rather severe doubts you can replace a functioning brain cell, much less replace all of the many, many billions - one (or a few) at a time. Do *you* want to go through ten thousand possibly fatal brain surgeries?
What happens if your brain cells reject the invaders and refuse to interact with them?