Oxford University Neural Network language model OXLM installation and use

Pre-KnowledgeLanguage Model

[Excerpt from wikipedia]

A statistical language model is a string of words consisting of a probability distribution , and assigning probabilities to a word:

Language models are often used in many natural language processing applications, such as speech recognition , machine translation , part-of-speech tagging, syntactic analysis, and information retrieval . Since words and sentences are any combination of lengths, there are no strings (sparse data) in the trained language model, which makes it difficult to estimate the probability of a string in a corpus , which is also to use the approximate smoothed N-ary syntax (n-gram ) The reason for the model.

In the field of speech recognition and data compression , this pattern attempts to capture the characteristics of the language and predict the next word in the voice string.

When used for information retrieval , a language model is a collection of files. By querying the word "Q" as input, the file is sorted according to probability , and the probability represents the probability of the statement produced by the language model of the file.

Neural Network language model: Knowledge-Neural network language modelOxford University Neural Network language model paper address: Click the Open link

Dependent package version requirements and installation

1.1 Installation of GCC

GCC version >= 4.6

Installation of GCC

1.2 Boost Installation

Boost version >= 1.45.0

Boost installation

installation of 1.3 CMake

CMake version >= 2.6

cmake installation may be error:

Error resolution see link Click to open link

dependency Configuration and Requirements reference: Click to open the linkInstallation StepsStep1. Unzip the fileStep2. Enter the extracted file and mkdir build, at which time the directory is empty. step3. Go to the build directory and execute the command

CMake. /src

command execution output:
After the command executes, the following files appear in the build directory:
step4. Execute make command
Simple to use

Oxford University Neural Network language model OXLM installation and use