no, you live it with the limitation imposed by literature.
Why do you think there aren't any?
Why do you think that I think there aren't any?
Yes, there are limitations, which can be pitfalls. Anything the writer describes becomes the limitations for the imagination.
This is also a pitfall, where the writer must take care to describe an object in all the details that later will matter.
I've read a story where the author did not ever mention or allude to the gender of the protagonist. That worked well.
But I've read several stories where the author did not establish limits like gender, age, skin color or height, but then referenced it later, after the user had already made a mental image. That is shoddy writing.
But as a writer, you don't have to go into excruciating details, but take advantage of the minds out there fleshing out the world. And you can provide visuals that is very possible to imagine, but not feasible to cast. Even two thousand years ago, literature had trees with gold leaves. Penned in for a penny. The best movie studios cannot make a believable gold leafed tree, with million dollar budgets.