Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chinese scattertext #55

Open
sound118 opened this issue Apr 6, 2020 · 1 comment
Open

Chinese scattertext #55

sound118 opened this issue Apr 6, 2020 · 1 comment

Comments

@sound118
Copy link

sound118 commented Apr 6, 2020

Your Environment

  • Operating System:
  • Python Version Used:
  • Scattertext Version Used:
  • Environment Information:
  • Browser used (if an HTML error):
    Hi,

It seems in your demo code, developer can directly use "chinese_nlp" module from scattertext package. I am wondering for plotting Chinese scatter text, if we could add a list of user defined stopwords and probably some user-defined dictionary specific for certain Chinese context, then use jieba to do the word segmentation and tie all these cleaned results to your demo program?

Thanks

@JasonKessler
Copy link
Owner

You could stop list after tokenization by running corpus.remove_terms(...). Otherwise, feel free to modify AsianNLP.py to fit your use case. It just ducktypes spaCy’s interface.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants