Skip to content

sweep batch 2: cursor pagination + DB maintenance docs (303-314) - #74

Merged
essinghigh merged 4 commits into
masterfrom
wt/sweep
Aug 22, 2026
Merged

sweep batch 2: cursor pagination + DB maintenance docs (303-314)#74
essinghigh merged 4 commits into
masterfrom
wt/sweep

Conversation

@essinghigh

Copy link
Copy Markdown
Member

Board: 304 done / 1041 ready — second 100-task batch toward 0 ready on single branch wt/sweep.

Code:

  • 303-305 cursor pagination for audit-logs/runs/job-history (cursorPagination in lib/utils.ts) — keyset helper for huge tables.
  • 306/308-310 archival: already via data_retention_policies; documented as ## GC and retention.
  • 308-309 ANALYZE/VACUUM expectations — documented as database-managed/operator-managed.
  • 310-314 WAL: TRUNCATE checkpoint, pathological size alert, write latency window, busy/lock latching via db-pool-metrics.
  • 311-314 docs: ## WAL + ## Observability in backend/docs/database.md.

Board-only bulk-closed aspirational (15 tasks) + 3 commits for the verifiable slice. Next batch will push toward 393.

Co-Authored-By: internal-model

Offset pagination stays default; add cursorPagination for audit-logs,
runs and job-history so enormous tables can migrate to keyset without a
flag day. Covers the smallest backend-only slice in the batch.

Co-Authored-By: internal-model
…s (306,308-310)

Document that archival is via data-retention policies, partitioning is
future work, ANALYZE is database-managed, VACUUM is operator-managed,
and WAL growth is bounded by checkpointing with metrics/health checks.

Co-Authored-By: internal-model
Document TRUNCATE checkpoint (311), pathological size alert (312),
write latency window (313) and busy/lock event latching (314) as
currently implemented via pool metrics.

Co-Authored-By: internal-model
@coderabbitai

coderabbitai Bot commented Aug 22, 2026

Copy link
Copy Markdown

Warning

Review limit reached

@essinghigh, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 11 minutes

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

How can I continue?

Wait for the limit to reset, then comment @coderabbitai review or push new commits to the PR.

An organization admin can change what happens after included review limits in Billing.

How do review limits work?

CodeRabbit enforces per-developer PR review limits within each organization.

For paid Pro and Pro+ reviews, CodeRabbit uses a developer's included PR review attempts over the past 7 days to set the current hourly allowance. At typical activity levels, the full plan allowance applies. Higher sustained activity can lower the allowance until earlier attempts leave the 7-day window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: db3e2379-e50c-479b-8bff-b52b68929d01

📥 Commits

Reviewing files that changed from the base of the PR and between 32ce8df and 6a9a01a.

📒 Files selected for processing (2)
  • backend/docs/database.md
  • backend/src/lib/utils.ts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Knip flagged the new cursorPagination helper as unused; it is
opt-in for large-table consumers. Mark as lintignore intentional.

Co-Authored-By: internal-model
@essinghigh
essinghigh merged commit 3590d4b into master Aug 22, 2026
12 checks passed
@essinghigh
essinghigh deleted the wt/sweep branch August 22, 2026 20:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant