We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
In embed_docsite, we download the docs source from github repos before processing and uploading to pinecone.
In github_utils right now, we download these files one at a time by downloading the index and then fetching each file.
github_utils
I'd be willing to bet a shiny pound that git clone --depth 1 will be easier, faster, and more robust.
git clone --depth 1
I've love to swap out the implementation here on a slow day. And run a quick test on the time-to-download before and after the change
The text was updated successfully, but these errors were encountered:
No branches or pull requests
In embed_docsite, we download the docs source from github repos before processing and uploading to pinecone.
In
github_utils
right now, we download these files one at a time by downloading the index and then fetching each file.I'd be willing to bet a shiny pound that
git clone --depth 1
will be easier, faster, and more robust.I've love to swap out the implementation here on a slow day. And run a quick test on the time-to-download before and after the change
The text was updated successfully, but these errors were encountered: