/var/logmarcus chiu

/var/log

❯

Mathematics

❯

Probability - Statistics - Information Theory - Econometrics

❯

Information Theory - Mathematical Theory of Communication - Telecommunications

❯

Univariate Entropy (Information Content - Entropy - Cross Entropy - KL Divergence)

❯

Maximum Entropy (Maxent) Models

Feature Overlapping - Feature Interaction - Double/Overcounting Counting

Created on Sep 13, 2021

  • Maximum Entropy Models handle overlapping features well
  • unlike Naive Bayes Model, there is no double counting
  • Maximum Entropy Models handle overlapping features well, but do not automatically model feature interactions. They do not model interaction terms, you have to add them