That's entirely untrue, particularly at lower frequencies. This isn't audiophile cork-sniffing - the behaviour of a loudspeaker can be radically altered by the design of the enclosure. Entire textbooks have been written on the topic.

https://www.amazon.com/Introduction-Loudspeaker-Design-John-...