NSB Entropy Estimation

NSB Entropy Estimation - Estimate entropy and related information-theoretic quantities from undersampled discrete data
Download

NSB Entropy Estimation Ranking & Summary

Advertisement

  • Rating:
  • License:
  • GPL
  • Price:
  • FREE
  • Publisher Name:
  • Ilya Nemenman
  • Publisher web site:
  • Operating Systems:
  • Mac OS X
  • File Size:
  • 128 KB

NSB Entropy Estimation Tags


NSB Entropy Estimation Description

NSB Entropy Estimation - Estimate entropy and related information-theoretic quantities from undersampled discrete data NSB Entropy Estimation is devoted to implementation and practical use of the NSB algorithm for estimation of entropy and related information-theoretic quantities from undersampled discrete data.There are two implementations of the method (C++ and MatLab/Octave). The MatLab/Octave code (thanks to Fernando Montani for porting the original Octave source to MatLab/Octave compatible version) is pretty basic in its functionality, works cross-platform, but is not actively being developed anymore due to its slow speed as well as inability of Octave and MatLab to index discrete structures that can exist in a space with cardinality of more than 2^32 (which we routinely encounter in linguistics or neuroscience applications). The C++ code is much faster and is currently being developed. It has all the bells and whistles invented after the initial creation of algorithms and can transparently deal with complicated data files. As a cost, one will need to compile the code and install additional software libraries (GSL and GMP), both available under the GPL.Requirements:· gsl, gmp, octave, gnuplot and gcc 3.3


NSB Entropy Estimation Related Software