Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About language #371

Open
mc112611 opened this issue Jul 5, 2024 · 3 comments
Open

About language #371

mc112611 opened this issue Jul 5, 2024 · 3 comments

Comments

@mc112611
Copy link

mc112611 commented Jul 5, 2024

what language does GraphRAG support? Can I use Japanese document to do RAG?

@eyast
Copy link

eyast commented Jul 5, 2024

I believe so. GraphRAG makes calls to an OpenAI or AzureOpenAI LLM, and they support Japanese in their tokenizers. Keep in mind that the instructions (and examples) provided to the LLM to do entity extraction and summarization are all in English. You might want to modify these prompts.

For example, when you intiate the indexer, you will see prompts in prompts\entity_extraction.txt. Line 20 says "Return output in English". You might want to modify this so that the result is returned in Japanese.

@mc112611
Copy link
Author

mc112611 commented Jul 5, 2024

I believe so. GraphRAG makes calls to an OpenAI or AzureOpenAI LLM, and they support Japanese in their tokenizers. Keep in mind that the instructions (and examples) provided to the LLM to do entity extraction and summarization are all in English. You might want to modify these prompts.

For example, when you intiate the indexer, you will see prompts in prompts\entity_extraction.txt. Line 20 says "Return output in English". You might want to modify this so that the result is returned in Japanese.

Thank you so much , hope this project will support local LLM, not only chatGPT。

@jgbradley1
Copy link
Contributor

Thank you so much , hope this project will support local LLM, not only chatGPT。

We welcome contributions from the community 😉 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants