Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(GraphRAG): Support concurrent community summarization #2160

Merged
merged 14 commits into from
Nov 29, 2024

Conversation

Appointat
Copy link
Contributor

@Appointat Appointat commented Nov 27, 2024

Description

We batch summarize the graph communities and reduce indexing time by 50%. And now, compared to GraphRAG (Microsoft), GraphRAG (DB-GPT) takes less indexing time (about 80%) and consumes fewer tokens (about 40%) to build a knowledge graph of the same size.

Snapshots:

image

Checklist:

  • My code follows the style guidelines of this project
  • I have already rebased the commits and make the commit message conform to the project standard.
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • Any dependent changes have been merged and published in downstream modules

@fanzhidongyzby fanzhidongyzby changed the title [Feat] Async summary communities [Feat] Support concurrent community summarization Nov 29, 2024
@fanzhidongyzby fanzhidongyzby changed the title [Feat] Support concurrent community summarization feat(GraphRAG): Support concurrent community summarization Nov 29, 2024
@fanzhidongyzby fanzhidongyzby added the GraphRAG Module: GraphRAG label Nov 29, 2024
@github-actions github-actions bot added the enhancement New feature or request label Nov 29, 2024
Copy link
Collaborator

@fanzhidongyzby fanzhidongyzby left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Copy link
Collaborator

@csunny csunny left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM~

@csunny csunny merged commit a14eeb5 into eosphoros-ai:main Nov 29, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request GraphRAG Module: GraphRAG
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants