A language model is actually a probabilistic model of the normal language.[1] In 1980, the main important statistical language model was proposed, and during the ten years IBM carried out ‘Shannon-style’ experiments, where prospective resources for language modeling advancement were