At home I don't have to stack up random boxes to block unfiltered sunlight streaming through the wall to wall windows, nor do I have to contend with jackasses in the office who don't understand that their phone transmits sound and thus they don't have to talk loud enough to be heard directly in the next state. I also don't lose an hour in the morning, when my colleagues to the east have already been working for three hours, making myself more or less presentable and doing the drive/park dance.
When I've worked in an office, any gains from this mythic in-person impromptu collaboration were dwarfed by that lost by the auditory interruptions, or the dozen trips back and forth to someone's desk trying to actually find them there. One place actually had a policy against facing the cubicle entrance, with the lame-brained idea that would be more distracting. What was distracting was constantly turning around because I *felt* like someone was standing there, or seeing the reflections of passers-by in my CRT. I slide out my filing cabinet and used it as a monitor stand anyway, to mitigate those issues.