Sync master branch of confluentinc/benchmark with openmessaging/benchmark by tsrivatsavs · Pull Request #21 · confluentinc/benchmark

Tarun Srivatsa (tsrivatsavs) · 2026-05-11T05:16:09Z

No description provided.

* Load balance topics on RabbitMQ nodes * Replace isOpen() checks by catching AlreadyClosedException

… (#245)

… script (#246) * [Pulsar] Fix available zone not configured and clean up the terraform script * Fix wrong output of zookeeper instances

* Support configuring protocol handlers and many other options * Fix deployment failure for RedHat 8 * Fix protocol handlers not loaded * Adjust the extra_vars.yaml * Use the original name of deloy.yaml * Add document for skip_journal * Update README * Support configuring max heap/direct memory

* Update gRPC version for Pravega 0.12. Signed-off-by: Andrey Koltsov <a99920641@gmail.com> * Add comment @ pom.xml Signed-off-by: AndreyKoltsov1997 <a99920641@gmail.com>

* update git repository address * Cannot create topic with partitions in RabbitMQ, so use 1 partition for rabbitmq

Bumps [jackson-databind](https://github.com/FasterXML/jackson) from 2.9.10.8 to 2.12.6.1. - [Release notes](https://github.com/FasterXML/jackson/releases) - [Commits](https://github.com/FasterXML/jackson/commits) --- updated-dependencies: - dependency-name: com.fasterxml.jackson.core:jackson-databind dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…#259)" (#264) This reverts commit 800e1af.

…oundError (#266) Co-authored-by: zhangjidi2016 <zhangjidi@cmss.chinamobile.com>

Co-authored-by: zhangjidi <zhangjidi@cmss.chinamobile.com>

* Fix license check and modify configurations for multi topics test * Update driver-pulsar/pom.xml Co-authored-by: Matteo Merli <mmerli@apache.org>

* Fixing infinite loop waiting for consumers to be ready * Throw an exception when the timeout is raised when waiting for consumers to be ready

Bumps [jetty-server](https://github.com/eclipse/jetty.project) from 9.4.42.v20210604 to 10.0.10. - [Release notes](https://github.com/eclipse/jetty.project/releases) - [Commits](jetty/jetty.project@jetty-9.4.42.v20210604...jetty-10.0.10) --- updated-dependencies: - dependency-name: org.eclipse.jetty:jetty-server dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

License

Update comment Spotless Pass credentials Remove final Typo

* Resilient resource creation # Conflicts: # benchmark-framework/src/main/java/io/openmessaging/benchmark/worker/LocalWorker.java # driver-api/src/main/java/io/openmessaging/benchmark/driver/BenchmarkDriver.java Resilient resource creation # Conflicts: # benchmark-framework/src/main/java/io/openmessaging/benchmark/worker/LocalWorker.java # driver-api/src/main/java/io/openmessaging/benchmark/driver/BenchmarkDriver.java # driver-rabbitmq/deploy/templates/rabbitmq-quorum.yaml License header Missing import spotless * findbugs exclude

* Pulsar 2.10.2 * More version changes Co-authored-by: Matteo Merli <mmerli@apache.org>

Bumps [testng](https://github.com/cbeust/testng) from 7.6.1 to 7.7.0. - [Release notes](https://github.com/cbeust/testng/releases) - [Changelog](https://github.com/cbeust/testng/blob/master/CHANGES.txt) - [Commits](testng-team/testng@7.6.1...7.7.0) --- updated-dependencies: - dependency-name: org.testng:testng dependency-type: direct:development ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fix failed drive-kop tests * Fix format violation

* exclude artemis netty transitive dependency * lint pom.xml --------- Co-authored-by: sky.kistler <sky.kistler@reddit.com>

* [nats] Add storage type to config so one can test with file or memory stream. * [nats] Add maxBytes to config so one can prevent NATS running out of memory incase the storage type is set to "Memory"

…n-plugin:2.25.0:check (check) on project driver-rocketmq: The following files had format violations: [ERROR] src/main/java/io/openmessaging/benchmark/driver/rocketmq/RocketMQBenchmarkDriver.java' (#399) Co-authored-by: nuolin <lushiji@xiaohongshu.com>

* Grow the histogram buffer if it is too small When we serialize a histogram to a byte array, the intermediate ByteBuffer that we pass may be too small which may result in silent truncation of the encoded histogram. This will manifest on the driver side as a decoding failure. This change detects this case and grows the buffer by a factor of 2 until it fits. Fixes #369. * Add Histogram deserialization test Add an addition test to the HistogramSerDeTest which tests that histogram deserialization roundtrips even when the serialized size exceeds the initial buffer. * Fixed spotbugs warnings --------- Co-authored-by: Matteo Merli <mmerli@apache.org>

#394) Bumps [com.rabbitmq:amqp-client](https://github.com/rabbitmq/rabbitmq-java-client) from 4.8.0 to 5.18.0. - [Release notes](https://github.com/rabbitmq/rabbitmq-java-client/releases) - [Commits](rabbitmq/rabbitmq-java-client@v4.8.0...v5.18.0) --- updated-dependencies: - dependency-name: com.rabbitmq:amqp-client dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…397) Signed-off-by: Ning Yu <ningyu@automq.com>

Some known issues with current version: - PEM files cannot be used because of a bug.

* Support set client.id with Zone ID for Kafka driver * Apply spotless fix

* Updated README.md * Squash merge feature/update-docker-image into master * Install vim on the openmessaging image * Start shell by default * Start shell by default also for Dockerfile.build * Use eclipse-temurin:17, fix apt install, and document image tagging\n\n- Switch base images to eclipse-temurin:17 for best practice\n- Remove version pinning for vim/tzdata to avoid apt errors\n- Update README to show -t usage and new image names\n- Prevent dangling images by tagging in build commands

* feat: implement driver-mqtt5 * use actions/upload-artifact@v4 because v3 is deprecated Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> * chore: fix code style issues Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> * chore: fix line length Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> * chore: adapt spotless code format Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> * chore: use lambada Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> --------- Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>

* Support RocketMQ5 benchmark using grpc sdk * chore: update README Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> --------- Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>

#443) * feat: Add message size distribution support for realistic workload testing (#1) * plan * compiles with java 21 * cleanup * top of range sizes --------- Co-authored-by: Fab <fabian.haupt@klaviyo.com>

Copilot

Copilot wasn't able to review this pull request because it exceeds the maximum number of files (300). Try reducing the number of changed files and requesting a review from Copilot again.

Penghui Li (codelipenghui) and others added 30 commits January 19, 2022 21:22

Bump Pulsar 2.9.1 and Kafka client 3.0.0 (#238)

4a555ea

Set flushEntrylogBytes (#240)

3b793a2

Fix missing dash (#244)

ddd4b90

Use the latest apache pulsar grafana dashboard (#252)

8c116f5

Load balance topics on RabbitMQ nodes (#239)

44293d5

* Load balance topics on RabbitMQ nodes * Replace isOpen() checks by catching AlreadyClosedException

Create a benchmark driver for KoP (https://github.com/streamnative/kop)…

73081cf

… (#245)

[Pulsar] Fix available zone not configured and clean up the terraform…

380acf7

… script (#246) * [Pulsar] Fix available zone not configured and clean up the terraform script * Fix wrong output of zookeeper instances

[Pulsar] Add ansible playbook to restart broker (#257)

1701fca

[Pravega Driver] [Draft] Update dependencies for Pravega 0.12 (#259)

800e1af

* Update gRPC version for Pravega 0.12. Signed-off-by: Andrey Koltsov <a99920641@gmail.com> * Add comment @ pom.xml Signed-off-by: AndreyKoltsov1997 <a99920641@gmail.com>

Fix RabbitMQ docs (#255) (#256)

0d02d56

* update git repository address * Cannot create topic with partitions in RabbitMQ, so use 1 partition for rabbitmq

Test warmup option (#260)

64cc01d

Fixes #247 Fix Coordinated Omission (#248)

64eff25

Fix copyright (#243) (#263)

0209bd1

Revert "[Pravega Driver] [Draft] Update dependencies for Pravega 0.12 (…

214e33e

…#259)" (#264) This reverts commit 800e1af.

[ISSUE #265]Fix com/fasterxml/jackson/annotation/JsonKey: NoClassDefF…

2d5e568

…oundError (#266) Co-authored-by: zhangjidi2016 <zhangjidi@cmss.chinamobile.com>

[ISSUE #268]rocketmq benchmark support acl (#269)

c1200d6

Co-authored-by: zhangjidi <zhangjidi@cmss.chinamobile.com>

Switch to RHEL-8 since RHEL-7.4 doesn't work anymore on EC2

4a02411

Simplified JVM GC options

7ec1817

Disabling protocol handlers in ansible

48c31db

Upgrade to Pulsar 2.10.1

0aa74e3

[Pulsar] Specify the NIC speed when deploying brokers

72778d8

Fixed benchmark worker config to work with Java 17

3241915

Use bigger VMs for ZooKeeper deployment

5b8209f

Fixed BK memory settings

7a16bc5

Fixing infinite loop waiting for consumers to be ready (#276)

cca7698

Fix license check and modify configurations for multi topics test (#282)

31855cd

* Fix license check and modify configurations for multi topics test * Update driver-pulsar/pom.xml Co-authored-by: Matteo Merli <mmerli@apache.org>

[issue #275] fix waiting for consumers to be ready (#277)

df0d9d3

* Fixing infinite loop waiting for consumers to be ready * Throw an exception when the timeout is raised when waiting for consumers to be ready

Elliot West (teabot) and others added 27 commits January 9, 2023 10:31

Create and share consumer (#356)

1066759

Stream type (#357)

7f910c4

Set partition handling behaviour (#358)

9cb6764

License

Clients require all broker address to fail over (#359)

d04724a

Update comment Spotless Pass credentials Remove final Typo

[Improvement] Pulsar 2.10.2 (#354)

ed82764

* Pulsar 2.10.2 * More version changes Co-authored-by: Matteo Merli <mmerli@apache.org>

Pulsar 2.11.0

defa46f

Fix failed drive-kop tests (#387)

6a947eb

* Fix failed drive-kop tests * Fix format violation

Bump log4j from 2.17.1 to 2.20.0 (#374)

31215cc

Add maven exclusion for netty transitive dependency in artemis (#376)

1c681e9

* exclude artemis netty transitive dependency * lint pom.xml --------- Co-authored-by: sky.kistler <sky.kistler@reddit.com>

[NATS] Extend to support in-memory stream (#370)

b3a9044

* [nats] Add storage type to config so one can test with file or memory stream. * [nats] Add maxBytes to config so one can prevent NATS running out of memory incase the storage type is set to "Memory"

Bumped Jedis to v5.0.0 - fixed breaking changes from v3.7.0 (#390)

f2a4e8c

Issue 391: Update Pravega library versions and deployment script (#392)

0a68a61

update rocketmq engine

71b6ff2

fix codestyle

d0c0277

fix(driver-kafka): Fix the ineffective KAFKA_JVM_PERFORMANCE_OPTS (#…

d84465c

…397) Signed-off-by: Ning Yu <ningyu@automq.com>

kafka: chore: upgrade kafka version (#404)

c361cbc

Some known issues with current version: - PEM files cannot be used because of a bug.

Enable optimized Netty direct bytebuffer reflection access (#412)

fe3c5a0

Support set client.id with Zone ID for Kafka driver (#424)

b10b227

* Support set client.id with Zone ID for Kafka driver * Apply spotless fix

Support RocketMQ5 benchmark using grpc sdk (#444)

8559989

* Support RocketMQ5 benchmark using grpc sdk * chore: update README Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> --------- Signed-off-by: Li Zhanhui <lizhanhui@gmail.com> Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>

feat: Add message size distribution support for realistic workload te… (

5b1fa70

#443) * feat: Add message size distribution support for realistic workload testing (#1) * plan * compiles with java 21 * cleanup * top of range sizes --------- Co-authored-by: Fab <fabian.haupt@klaviyo.com>

Copilot AI review requested due to automatic review settings May 11, 2026 05:16

Tarun Srivatsa (tsrivatsavs) requested a review from a team as a code owner May 11, 2026 05:16

Copilot AI reviewed May 11, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sync master branch of confluentinc/benchmark with openmessaging/benchmark#21

Sync master branch of confluentinc/benchmark with openmessaging/benchmark#21
Tarun Srivatsa (tsrivatsavs) wants to merge 111 commits into
confluentinc:masterfrom
openmessaging:master

Tarun Srivatsa (tsrivatsavs) commented May 11, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

Tarun Srivatsa (tsrivatsavs) commented May 11, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants