I’m not claiming it’s for sure an evolved trait, but most people do prefer cold water (and hot water) over lukewarm water. Here’s a paper if your curious: https://www.jstor.org/stable/41266787

I think the reason we evolved to prefer cold water is because warm water is more likely to be stagnant and contain dangerous pathogens. The cold water of lakes, streams and springs was much safer for our ancestors.