The Naive Bayes classifier performs remarkably well on many classification data sets, especially considering the patently unrealistic assumptions it makes about the data. In my college thesis, I investigated the reasons why Naive Bayes does so well and how we can take advantage of these ideas to build better classifiers.
You can read the full paper here (68 pages) or see a poster summarizing the work here.