You are probably underestimating the importance of smell. Even if you take taste and everything related to food out of the equation.

I have a lot of memories tied to smell, much more than I realized at first. It is just at a more subconscious level. Even bad smells can be tied to happy thoughts.

For example, a girl I know enjoys the smell of underground parking lots. Why? Don't know, maybe tied to childhood vacations. I actually like the smell of sweat and smoke in parties, because while in most situation, that would be a terrible smell, it is also the smell of having fun. A common example is the smell of a new car, many people enjoy it for what it represents, not because these noxious volatile organic compounds smell good.

Also let's not dismiss the usefulness of smell as a warning system. There is a reason natural gas is artificially scented for instance.