Comments on: Distribution of Mutual Information http://brainwave.opencog.org/2009/03/11/distribution-of-mutual-information/ The first ultraintelligent machine is the last invention that man need ever make. -I. J. Good, 1965 Thu, 08 Oct 2009 16:10:00 +0000 http://wordpress.com/ hourly 1 By: linasv http://brainwave.opencog.org/2009/03/11/distribution-of-mutual-information/#comment-14 linasv Tue, 08 Sep 2009 18:38:26 +0000 http://brainwave.opencog.org/?p=89#comment-14 These graphs were discussed on the corpora mailing list in March 2009. See http://mailman.uib.no/public/corpora/2009-March/008193.html and followups in that thread. It was concluded that the gross features of the graph (i.e. the exponential fall-off) can be explained by drawing random pairs of words from a Zipfian distribution for single words (which seemed plausible to me, although I did not do the math to double-check/verify this). These graphs were discussed on the corpora mailing list in March 2009. See http://mailman.uib.no/public/corpora/2009-March/008193.html and followups in that thread.

It was concluded that the gross features of the graph (i.e. the exponential fall-off) can be explained by drawing random pairs of words from a Zipfian distribution for single words (which seemed plausible to me, although I did not do the math to double-check/verify this).

]]>