Cold tolerance

A few years Sifu was telling me about cold tolerance and how it relates to our training. I can't remember everything he said. Personally, probably for unrelated reasons, I have poor cold tolerance. Less than a minute if exposure to a cold wind can cause me to go into shivers. This is obviously the wrong direction of development. Any pointers on what I'm doing wrong and how to address it?