Python: stopwords Indonesia: Difference between revisions

From OnnoCenterWiki
Jump to navigationJump to search
Onnowpurbo (talk | contribs)
Created page with " https://github.com/masdevid/ID-Stopwords"
 
Onnowpurbo (talk | contribs)
No edit summary
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:


https://github.com/masdevid/ID-Stopwords
* https://github.com/masdevid/ID-Stopwords
 
 
==Cara lain adalah mengumpulkan sendiri stopwords==
 
Jalankan script
 
cari-stopwords.py -i input.txt > kumpulan-words.txt
 
Edit
 
vi kumpulan-words.txt
 
buang kata-kata yang bukan stopwords
kata-kata yang penting yang akan menjadi node di graph
 
==simpan stopwords==
 
rename
 
cp kumpulan-words.txt indonesia-sementara
 
merging dengan berbagai stopwords yang ada
 
rm ~/nltk_data/corpora/stopwords/indonesia
touch ~/nltk_data/corpora/stopwords/indonesia
cp indonesia-id1 ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-angka >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-jam >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-merek >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-politik >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-stemmped >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-sementara >> ~/nltk_data/corpora/stopwords/indonesia

Latest revision as of 22:24, 1 February 2017


Cara lain adalah mengumpulkan sendiri stopwords

Jalankan script

cari-stopwords.py -i input.txt > kumpulan-words.txt

Edit

vi kumpulan-words.txt

buang kata-kata yang bukan stopwords kata-kata yang penting yang akan menjadi node di graph

simpan stopwords

rename

cp kumpulan-words.txt indonesia-sementara

merging dengan berbagai stopwords yang ada

rm ~/nltk_data/corpora/stopwords/indonesia
touch ~/nltk_data/corpora/stopwords/indonesia
cp indonesia-id1 ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-angka >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-jam >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-merek >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-politik >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-stemmped >> ~/nltk_data/corpora/stopwords/indonesia
cat indonesia-sementara >> ~/nltk_data/corpora/stopwords/indonesia