Skip to content

refactor: update Eth indexer to prefetch batches concurrently - #994

Draft
isSerge wants to merge 9 commits into
developfrom
isserge/refactor-eth-indexer-futures-stream
Draft

refactor: update Eth indexer to prefetch batches concurrently#994
isSerge wants to merge 9 commits into
developfrom
isserge/refactor-eth-indexer-futures-stream

Conversation

@isSerge

@isSerge isSerge commented Jul 13, 2026

Copy link
Copy Markdown
Contributor
  • Config: add EthConfig.catchup_concurrent_batches: usize, with DEFAULT_CATCHUP_CONCURRENT_BATCHES (3) and MAX_CATCHUP_CONCURRENT_BATCHES (8)
  • Client: delete CatchupIter struct and add EthereumClient::catchup_batch_stream(&self, start, end, concurrency), which returns a stream of CatchupItem
  • Indexer: type Iter changed to futures_util::Stream
  • Benchmark: include batch_wait_ms metric for critical-path fetch wait

@isSerge isSerge changed the title refactor: update Eth indexer to fetch batches in parallel refactor: update Eth indexer to prefetch batches concurrently Jul 13, 2026
@github-actions

Copy link
Copy Markdown

⚠️ Integration tests were re-run (attempt 2)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants