最近參加了一個sem-eval 2013的task 8:Cross-lingual Textual Entailment for Content Synchronization.打算研究生畢設就做這個了。
想到的一個方法就是先把非英語翻譯為英語,再做常規的文本推理。無奈google的翻譯API竟然關閉了,但你網頁總不會關閉吧?於是找到了前人做好的工具:Google翻譯post提交無長度限制的線上翻譯例子,原理是直接抽取網頁。可以支援長文本,這樣就可以一次翻譯多句話了。
但是上述的工具存在一個缺陷,翻譯出來的結果中含有HTML逸出字元,如"&","""。解決方案見我另一篇部落格:將HTML中的特殊字元轉化為可顯示的字元。
附上國家語言簡稱表:
| Language |
Language code |
| Afrikaans |
af |
| Albanian |
sq |
| Arabic |
ar |
| Belarusian |
be |
| Bulgarian |
bg |
| Catalan |
ca |
| Chinese Simplified |
zh-CN |
| Chinese Traditional |
zh-TW |
| Croatian |
hr |
| Czech |
cs |
| Danish |
da |
| Dutch |
nl |
| English |
en |
| Estonian |
et |
| Filipino |
tl |
| Finnish |
fi |
| French |
fr |
| Galician |
gl |
| German |
de |
| Greek |
el |
| Haitian Creole |
ht |
| Hebrew |
iw |
| Hindi |
hi |
| Hungarian |
hu |
| Icelandic |
is |
| Indonesian |
id |
| Irish |
ga |
| Italian |
it |
| Japanese |
ja |
| Latvian |
lv |
| Lithuanian |
lt |
| Macedonian |
mk |
| Malay |
ms |
| Maltese |
mt |
| Norwegian |
no |
| Persian |
fa |
| Polish |
pl |
| Portuguese |
pt |
| Romanian |
ro |
| Russian |
ru |
| Serbian |
sr |
| Slovak |
sk |
| Slovenian |
sl |
| Spanish |
es |
| Swahili |
sw |
| Swedish |
sv |
| Thai |
th |
| Turkish |
tr |
| Ukrainian |
uk |
| Vietnamese |
vi |
| Welsh |
cy |
| Yiddish |
yi |
PS:幾近荒蕪的空間,太久沒有幹正事了……
附上國家語言簡稱表:
| Language |
Language code |
| Afrikaans |
af |
| Albanian |
sq |
| Arabic |
ar |
| Belarusian |
be |
| Bulgarian |
bg |
| Catalan |
ca |
| Chinese Simplified |
zh-CN |
| Chinese Traditional |
zh-TW |
| Croatian |
hr |
| Czech |
cs |
| Danish |
da |
| Dutch |
nl |
| English |
en |
| Estonian |
et |
| Filipino |
tl |
| Finnish |
fi |
| French |
fr |
| Galician |
gl |
| German |
de |
| Greek |
el |
| Haitian Creole |
ht |
| Hebrew |
iw |
| Hindi |
hi |
| Hungarian |
hu |
| Icelandic |
is |
| Indonesian |
id |
| Irish |
ga |
| Italian |
it |
| Japanese |
ja |
| Latvian |
lv |
| Lithuanian |
lt |
| Macedonian |
mk |
| Malay |
ms |
| Maltese |
mt |
| Norwegian |
no |
| Persian |
fa |
| Polish |
pl |
| Portuguese |
pt |
| Romanian |
ro |
| Russian |
ru |
| Serbian |
sr |
| Slovak |
sk |
| Slovenian |
sl |
| Spanish |
es |
| Swahili |
sw |
| Swedish |
sv |
| Thai |
th |
| Turkish |
tr |
| Ukrainian |
uk |
| Vietnamese |
vi |
| Welsh |
cy |
| Yiddish |
yi |