Bayesian sparsity using spike-and-slab priors

I recently received some queries on our paper: S. Mohamed, K. Heller and Z. Ghahramani. Bayesian and L1 Approaches for Sparse Unsupervised Learning. International Conference on Machine Learning (ICML), June 2012 . The questions were very good and I thought it would be useful to post these for future reference. The paper looked at Bayesian ...

Marr's Levels of Analysis 5

Marr's Levels of Analysis
Marr's three levels of analysis promotes the idea that complex systems such as the brain, a computer or human behaviour should be understood at different levels. Marr's framework proved to be an elegant and popular way of reasoning about complex systems, and in the context of machine learning and statistics,  remains an intuitive framework that ...

On Marginal Likelihoods and Widely Applicable BIC 2

The marginal likelihood of a model is one the key quantities appearing throughout machine learning and statistics, since it provides an intuitive and natural objective function for model selection and parameter estimation. I recently read a new paper by Sumio Watanabe on A Widely applicable Bayesian information criterion (WBIC) (and to appear in JMLR soon) ...

Hello World!

Hello blogging world! All the pieces in this blog will be ways for me to explore my current understanding of concepts and topics in Machine Learning. Putting thoughts into writing really does force us to think clearly about what we think and why, and I put this online in the hope that some of my explorations ...