A Statistical View of Deep Learning (VI): What is Deep? 4

A Statistical View of Deep Learning (VI): What is Deep?
Throughout this series, we have discussed deep networks by examining prototypical instances of these models, e.g., deep feed-forward networks, deep auto-encoders, deep generative models, but have not yet interrogated the key word we have been using. We have not posed the question what does 'deep' mean, and what makes a model deep. There is little in way of ...