Information theory and coding example problem set 1 let x and y represent random variables with associated probability distributions px and py respectively they are not independent their conditional probability distributions are px y and py x and their joint probability distribution is pxy 1. University printing house cambridge cb2 8bs united kingdom published in the united states of america by cambridge university press new york. Information theory and coding computer science tripos part ii michaelmas term 11 lectures by j g daugman 1 overview what is information theory key idea the movements and transformations of information just like those of a uid are constrained by mathematical and physical laws these laws have deep connections with probability theory statistics and combinatorics thermodynamics . Information theory and network coding spin springers internal project number if known november 15 2007 springer to my parents and my family preface cover and thomas wrote a book on information theory 72 ten years ago which covers most of the major topics with considerable depth their book has since become the standard textbook in the eld and it was no doubt a remarkable success