Crossmodal correspondences in composing and listening to music

We often reach for crossmodal metaphor to describe music--it sounds warm, or velvety, or rough, spiky, jagged, smooth, glassy, or bright, etc. What if these metaphors were not as subjective as we might think, but had a scientific, neurological basis?