Common NLP tools

NLP tools transferred from http://www.cppblog.com/baby-fly/archive/2010/10/08/129003.html

* NLP toolbox
CLT Http://complingone.georgetown.edu /~ Linguist/compling.html
Gate Http://gate.ac.uk/
Natural Language Toolkit (nltk) Http://nltk.org
Mallet Http://mallet.cs.umass.edu/index.php/Main_Page
Opennlp Http://opennlp.sourceforge.net/

* English Stemmer
SnowballHttp://snowball.tartarus.org/

* English POS tagger
Stanford POS taggerHttp://nlp.stanford.edu/software/tagger.shtml
TreetaggerHttp://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/
TNTHttp://www.coli.uni-saarland.de /~ Thorsten/TNT/

* English & Chinese parser
Stanford parserHttp://nlp.stanford.edu/software/lex-parser.shtml
Berkeley parserHttp://nlp.cs.berkeley.edu/Main.html#Parsing

* English keyphrase Extractor
KEAHttp://www.nzdl.org/Kea/index_old.html

* English name entity recognizer
Stanford nerHttp://nlp.stanford.edu/software/CRF-NER.shtml

* Chinese Word segmentator
Chinese Emy of Sciences ICTCLASHttp://www.nlp.org.cn/project/project.php? Proj_id = 6
Stanford word segmenterHttp://nlp.stanford.edu/software/segmenter.shtml

* Topic modeling tools
MATLABHttp://psiexp.ss.uci.edu/research/programs_data/toolbox.htm
Gibbslda ++Http://gibbslda.sourceforge.net/
GldaHttp://code.google.com/p/glda/

* Conditional Random Fields
FlexcrfsHttp://flexcrfs.sourceforge.net/Contains the MPI parallel version.
CRF ++Http://crfpp.sourFceforge.net/
CRF packageHttp://crf.sourceforge.net/
CRF MATLABHttp://www.cs.ubc.ca /~ Murphyk/software/crfall.zip
CrfsuitHttp://www.chokkan.org/software/crfsuite/
SGD with CRFHttp://leon.bottou.org/projects/sgd
HcrfHttp://sourceforge.net/projects/hcrf/

* Support Vector Machine
LibsvmHttp://www.csie.ntu.edu.tw /~ Cjlin/libsvm/
LiblinearHttp://www.csie.ntu.edu.tw /~ Cjlin/liblinear/
PegasosHttp://www.cs.huji.ac.il /~ Shais/code/index.html

* Search engines
LuceneHttp://lucene.apache.org/
Chinese Emy of Sciences firtexHttp://www.firtex.org/

* Machine learning and Data Mining toolbox
WEKA http://www.cs.waikato.ac.nz/ml/weka/