Information Theory, Inference, and Learning Algorithms Author: David J.C. MacKay, full text of the 2005 printing available for downloading. Software is also available.
From a review that I read (http://dx.doi.org/10.1145/1189056.1189063), MacKay treats machine learning as the other side of the coin from information theory.
Take the time to visit MacKay’s homepage.
There you will find his book Sustainable Energy – Without the Hot Air. Highly entertaining.