Evolution and Information Theory

Information is Closely Related to Probability

Suppose that the scientist has 100 coins, and he is told that he has a 1 in 64 chance of opening the door if he tosses the correct number of coins and enters an H or T into the computer. He is told not to toss all 100 coins because the combination for the door is not that long. He is also told that the door only has one correct combination.

   How does the scientist figure out how many coins to toss? He needs to convert the odds of opening the door into an equivalent number of bits. One way is trial and error. He can compose a table like table 1.1. From this table, it is clear that if the scientist tosses 6 coins, he will have a 1 in 64 chance of opening the door.

Table 1.1- Information Contained in Coins

   Notice that there is a definite relationship between the number of bits in the door’s combination and the odds that the scientist will open the door. Probability theory and information theory are closely related.

    

Next: mathemtical definition of  information

Previous: Evolution of Knowledge