Hello, I am emmanuel who is natural language researcher who studies low resourced languages such as East Asian or East African languages, time to time trying to learn Ancient Runes ;)
I noticed that Korean stopwords are not there, and it was from my efforts to use Korean stopwords at bm25s repo, which uses NLTK stopwords. It is possible that I make an exception at there, but I reckoned, it would be such a meaningful endeavor if I merely talk to the NLTK community (I noticed that there was very similar issue raised for Polish and Hindi, so it gave me a bit more of a courage to make this issue).
NLTK was the first toolkit from which I ever learned the NLP, and I am merely honored to just upload this issue.
BTW, for the specific stopwords, I am considering to add the stopwords at https://github.com/stopwords-iso/stopwords-ko with minimal edits.
I am thinking about two options (1) add those without modification at all / (2) with minimal modification such as removing numbers (and mere special characters which would be hard to be considered as stopwords) and those with space (" ") within.
It is something that makes feel like I am talking to the Harry Potter studio (NLTK is that much to me), I sincerely thank you all for the efforts for the maintaining of the repo.
any feedback is welcome, and please consider allowing me having the honor to make a new small casual PR for it.
again, thank you very much for this project, I am such a fan.
with warm regards
emmanuel
Hello, I am emmanuel who is natural language researcher who studies low resourced languages such as East Asian or East African languages, time to time trying to learn Ancient Runes ;)
I noticed that Korean stopwords are not there, and it was from my efforts to use Korean stopwords at bm25s repo, which uses NLTK stopwords. It is possible that I make an exception at there, but I reckoned, it would be such a meaningful endeavor if I merely talk to the NLTK community (I noticed that there was very similar issue raised for Polish and Hindi, so it gave me a bit more of a courage to make this issue).
NLTK was the first toolkit from which I ever learned the NLP, and I am merely honored to just upload this issue.
BTW, for the specific stopwords, I am considering to add the stopwords at https://github.com/stopwords-iso/stopwords-ko with minimal edits.
I am thinking about two options (1) add those without modification at all / (2) with minimal modification such as removing numbers (and mere special characters which would be hard to be considered as stopwords) and those with space (" ") within.
It is something that makes feel like I am talking to the Harry Potter studio (NLTK is that much to me), I sincerely thank you all for the efforts for the maintaining of the repo.
any feedback is welcome, and please consider allowing me having the honor to make a new small casual PR for it.
again, thank you very much for this project, I am such a fan.
with warm regards
emmanuel