Very surpisingly, I found the culprit of the slowdowns. It's the NVidia driver. I installed it manually today, set to max effects and that's what makes the machine slow. Weird, one would expect better performance with the proprietary driver....Okay, in all fairness. Keeping the driver and setting it to no effects seems to put it back to normal.... Meaning no slowdown while typing.