Skip to content

Simple partitioned aggregation#298

Merged
serprex merged 1 commit into
mainfrom
simple-partitioned-aggregate
Jul 1, 2026
Merged

Simple partitioned aggregation#298
serprex merged 1 commit into
mainfrom
simple-partitioned-aggregate

Conversation

@serprex

@serprex serprex commented Jun 27, 2026

Copy link
Copy Markdown
Member

Implements support for pushing down some partial aggregates. This opens up having partitioned tables with mix of postgres/clickhouse partitions. Useful for example where old data is dropped from postgres, but kept in ClickHouse

@serprex serprex requested a review from theory June 27, 2026 17:05
@serprex serprex force-pushed the simple-partitioned-aggregate branch 4 times, most recently from f5d93af to 4691d40 Compare June 27, 2026 17:42

@theory theory left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is SPLENDID, thank you! Just a few things to tweak and some questions. Documentation to explain how this works and when it doesn't work could be a different PR, as long as it happens. I want it to be clear to people why some aggregate across partitions will or won't map/reduce.

Comment thread CHANGELOG.md Outdated
Comment thread src/deparse.c
Comment thread src/deparse.c
Comment thread src/deparse.c
Comment thread src/deparse.c
Comment thread src/deparse.c
Comment thread test/expected/partitioning_http.out
Comment thread test/expected/partitioning_http.out
Comment thread test/expected/partitioning_http.out
Comment thread src/deparse.c
@serprex serprex force-pushed the simple-partitioned-aggregate branch 2 times, most recently from 6780f7c to 1b5d167 Compare June 29, 2026 19:43
@serprex serprex requested a review from theory June 29, 2026 20:02
@serprex serprex force-pushed the simple-partitioned-aggregate branch from 1b5d167 to 9f6beb8 Compare June 30, 2026 00:20
Comment thread doc/pg_clickhouse.md Outdated
Comment thread doc/pg_clickhouse.md Outdated
Comment thread doc/pg_clickhouse.md Outdated
Comment thread doc/pg_clickhouse.md Outdated
Comment thread doc/pg_clickhouse.md Outdated
Comment thread doc/pg_clickhouse.md Outdated
@serprex serprex force-pushed the simple-partitioned-aggregate branch from 9f6beb8 to 6c5c48e Compare June 30, 2026 16:15
@serprex serprex requested a review from theory June 30, 2026 16:16
@serprex serprex force-pushed the simple-partitioned-aggregate branch from 6c5c48e to ad34590 Compare June 30, 2026 16:37
Comment thread CHANGELOG.md Outdated
@serprex serprex force-pushed the simple-partitioned-aggregate branch 5 times, most recently from 6b942de to 278f191 Compare July 1, 2026 01:46
enables aggregate pushdown of partitioned table with some partitions on ClickHouse

only supports simple aggregates for now
@serprex serprex force-pushed the simple-partitioned-aggregate branch from 278f191 to 74c725e Compare July 1, 2026 02:30
@serprex serprex merged commit 74c725e into main Jul 1, 2026
30 of 31 checks passed
@serprex serprex deleted the simple-partitioned-aggregate branch July 1, 2026 02:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants