I also had, and still have, confusion about taking with milk. From what I've read here and in other sites, it seems that the calcium in milk helps. I thought it might have been the fat in the milk. So if it's calcium, eating yogurt would help also, as well as would a simple calcium vitamin pill.
Please don't take this as gospel, I am only repeating what I've read and one is never sure how accurate the web is. Who knows, there could be a conspiracy of dairy cows seeking ways to increase milk consumption