I have been crazily busy so blogging was rather slow for me. Though I have a stronger and stronger feeling that my understanding is closer to the state of the art of speech recognition. And for now, the state of the art of speech recognition, we got to talk about the whole deep neural network trend.
There is nothing conceptually new in the use of hybrid HMM-DBN-DNN. It has been proposed under the name HMM-ANN in the past. What is new is that there is new algorithm which allow fast training of multi-layered neural network. It is mainly due to Hinton's breakthrough in 2006: it suggests training a DBN-DNN can be first initialized by pretrained RBM.
I am naturally very interested in this new trend. IBM, Microsoft and Googles' results show that DBN-DNN is not a toy model we saw last two decades.
Well, that's all for my excitement on DBN, I still have tons of things to learn. Back to the "Grand Janitor Blog", as I had tried to improve the blog layout 4 months ago, I got to say I feel very frustrated by Blogger and finally decide to move to WordPress.
I hope to move within the next month or so. I will write a more proper announcement later on.