Comment: Re:Did I seriously miss something? (Score 2) 61
there are ways around that through smart planning, variable use, and multiple data files for different variables so not all are in memory at once
There are also packages like ff and others which handle absolutely gigantic files by offloading parts of them to storage and only allocating memory for them (and storage) when required. R certainly has some problems with dealing with huge amounts of data, but they aren't insurmountable for datasets less than 1T.