Also, what would an adobe home be "undesirable", other than you're a dumbass?
Most people don't want to live in a house made of dirt. Besides perceived concerns about the durability of the structure itself, it's just a matter of public perception. Living in a house made of earthen materials brings to mind settlers in mud-brick homesteads. That's not the modern living folks want. Many people buy homes with the idea of it being an investment they will resell in the future. If people don't find your home desirable you'll have a harder time selling down the line and wont get as much in return. Same reason people don't paint their house exterior hot pink.
I have a book somewhere around here from the '70s about building your own home by building into a hillside essentially (so the majority of the structure is semi underground). This style of building has obvious benefits when it comes to weather resistance and climate control. But the home you end up with is somewhat a cave with little natural light. The couple in the photograph on the cover could pass for many a neckbeard of today and his wife was shown sewing like some survivalist bride trying to maintain a home where commercial electricity isn't a thing. This is not the image people want emulate.