Skip to content

Simple optimizations to block protocol #1260

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 20 commits into
base: master
Choose a base branch
from
+1,078 −524
Draft

Simple optimizations to block protocol #1260

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
41f94d7
feat: add dataset request batching
gmega Jun 5, 2025
d80b7dd
switch nph branch to provisional which compiles in 2.2.x
gmega Jun 5, 2025
1dcb998
feat: cap how many blocks we can pack in a single message
gmega Jun 6, 2025
b6e1203
update engine tests; add BlockAddress hashing tests
gmega Jun 6, 2025
a53f8da
replace list operations with sets
gmega Jun 6, 2025
e18996e
optimize remaining list joins so they're not quadratic
gmega Jun 9, 2025
fbd378e
adapt existing tests to new data structures, remove vestigial tests
gmega Jun 9, 2025
03a1cc7
Update codex/stores/networkstore.nim
gmega Jun 9, 2025
313d6ba
fix: refresh timestamp before issuing request to prevent flood of kno…
gmega Jun 10, 2025
d94bfe6
feat: add SafeAsyncIter chaining
gmega Jun 27, 2025
db279d8
feat: remove quadratic joins in cancelBlocks; use SafeAsyncIterator f…
gmega Jun 30, 2025
83fd83f
feat: allow futures to be returned out-of-order to decrease memory co…
gmega Jun 30, 2025
cdab172
chore: remove file committed by accident
gmega Jun 30, 2025
ad8e250
feat: modify retry mechanism; add DHT guard rails; improve block canc…
gmega Jul 2, 2025
97fd68e
feat: drop peer on activity timeout
gmega Jul 2, 2025
572b448
fix: fix block exchange test to stricter protocol; minor refactor
gmega Jul 3, 2025
b274b29
fix: fix testdiscovery so it works with stricter block protocol
gmega Jul 3, 2025
d7c403e
feat: add stopgap "adaptive" refresh
gmega Jul 3, 2025
2ada4b5
feat: add block knowledge request mechanism, implement tests
gmega Jul 8, 2025
6891824
fix: randomize block refresh time, optimize context store checks
gmega Jul 9, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions codex/blockexchange/engine/discovery.nim
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,8 @@ proc discoveryTaskLoop(b: DiscoveryEngine) {.async: (raises: []).} =
trace "Discovery request already in progress", cid
continue

trace "Running discovery task for cid", cid

let haves = b.peers.peersHave(cid)

if haves.len < b.minPeersPerBlock:
Expand Down
Loading