Zoning exists to separate industry from residential and also to separate middle-class households (people who can afford to use their home only for consumption, whose only animals are pets and whose only crop is grass) from the working-class (people who made income on their home by taking in boarders, growing chickens, doing home businesses, etc.) Middle-class zoning banned these working-class activities (see https://www.amazon.com/American-Nightmare-Government-Undermi...). I think it’s really tricky to separate who is harming whom in the modern day when houses are seen as an investment and there is insufficient zoning for working-class people, and where the norms of what a house is for may be changing.
Edit: Related point: In some places, it is ingrained in our culture since the 1970s that housing should be a good investment. Low property taxes (Proposition 13) and zoning restrictions are designed to increase the private gains to this investment (https://www.amazon.com/Homevoter-Hypothesis-Influence-Govern...). A small change of use to short-term rentals is perhaps the next incremental step for house investors. It sucks for people who want to use housing as only a peaceful consumption good, but in my opinion that ship sailed a long time ago in Closed-Access cities.
I think the question of whether a prosperous region can have both urban growth boundaries and affordable housing is an open question. The Bay Area has not set a good example in this manner; we listen to environmentalists when it’s time to put walls around the region but we don’t listen to them when they call for greater infill development (to their credit, the Greenbelt Alliance has a subsidiary called the SF Housing Action Coalition that promotes infill development, but in SF politics they are often written off as developer shills).