What kind of milk are you giving? Have you tried giving him warm milk or giving frozen milk pops?
The good news here is that he’s taking the milk (even if you have to disguise it with yogurt or lassi). You don’t have to force him to drink milk, just be sure that he is getting his calcium, vitamin d and fats from other sources such as: yogurts, cheeses, fortified oj, fortified bread, chocolate milk, etc.
Hope this helps a bit 
Source:
http://storktweets.com/baby-video/24980