Bump apache-beam[gcp] from 2.28.0 to 2.42.0 in /megalist_dataflow

[dependabot]

Bumps apache-beam[gcp] from 2.28.0 to 2.42.0.

Release notes

Sourced from apache-beam[gcp]'s releases.

Beam 2.42.0 release

We are happy to present the new 2.42.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.

For more information on changes in 2.42.0, check out the detailed release notes.

Highlights

• Added support for stateful DoFns to the Go SDK.

New Features / Improvements

• Added support for Zstd compression to the Python SDK.
• Added support for Google Cloud Profiler to the Go SDK.
• Added support for stateful DoFns to the Go SDK.

Breaking Changes

• The Go SDK's Row Coder now uses a different single-precision float encoding for float32 types to match Java's behavior (#22629).

Bugfixes

• Fixed Python cross-language JDBC IO Connector cannot read or write rows containing Timestamp type values 19817.

Known Issues

• Go SDK doesn't yet support Slowly Changing Side Input pattern (#23106)
• See a full list of open issues that affect this version.

What's Changed

• Remove stripping of step name and replace with substring search by @​AnandInguva in apache/beam#22415
• [Website] Remove beam-summit 2022 by @​bullet03 in apache/beam#22444
• Add read/write PubSub integration example fhirio pipeline by @​lnogueir in apache/beam#22306
• [Go SDK]: Remove deprecated Session runner by @​jrmccluskey in apache/beam#22505
• Add Go test status to the PR template by @​jrmccluskey in apache/beam#22508
• Fix typo in Datastore V1ReadIT test by @​yixiaoshen in apache/beam#22484
• Remove unnecessary reference to use_runner_v2 experiment in x-lang examples and documentation by @​chamikaramj in apache/beam#22376
• Relax the google-api-core dependency. by @​tvalentyn in apache/beam#22513
• Bump google.golang.org/protobuf from 1.28.0 to 1.28.1 in /sdks by @​dependabot in apache/beam#22517
• Bump google.golang.org/api from 0.89.0 to 0.90.0 in /sdks by @​dependabot in apache/beam#22518
• Change _build import from setuptools to distutils by @​AnandInguva in apache/beam#22503
• Remove stringx package by @​damccorm in apache/beam#22534
• Improve concrete error message by @​damccorm in apache/beam#22536
• Exclude grpcio==1.48.0 by @​tvalentyn in apache/beam#22539
• Fix JDBCIOIT by @​Abacn in apache/beam#22304
• Update pytest to support Python 3.10 by @​AnandInguva in apache/beam#22055

... (truncated)

Changelog

Sourced from apache-beam[gcp]'s changelog.

[2.42.0] - 2022-10-17

Highlights

• Added support for stateful DoFns to the Go SDK.

New Features / Improvements

• Added support for Zstd compression to the Python SDK.
• Added support for Google Cloud Profiler to the Go SDK.
• Added support for stateful DoFns to the Go SDK.

Breaking Changes

• The Go SDK's Row Coder now uses a different single-precision float encoding for float32 types to match Java's behavior (#22629).

Bugfixes

• Fixed Python cross-language JDBC IO Connector cannot read or write rows containing Timestamp type values #19817.
• Fixed AfterProcessingTime behavior in Python's DirectRunner to match Java (#23071)

Known Issues

• Go SDK doesn't yet support Slowly Changing Side Input pattern (#23106)

[2.41.0] - 2022-08-23

I/Os

• Projection Pushdown optimizer is now on by default for streaming, matching the behavior of batch pipelines since 2.38.0. If you encounter a bug with the optimizer, please file an issue and disable the optimizer using pipeline option --experiments=disable_projection_pushdown.

New Features / Improvements

• Previously available in Java sdk, Python sdk now also supports logging level overrides per module. (#18222).
• Added support for accessing GCP PubSub Message ordering keys (Java) (BEAM-13592)

Breaking Changes

• Projection Pushdown optimizer may break Dataflow upgrade compatibility for optimized pipelines when it removes unused fields. If you need to upgrade and encounter a compatibility issue, disable the optimizer using pipeline option --experiments=disable_projection_pushdown.

Deprecations

• Support for Spark 2.4.x is deprecated and will be dropped with the release of Beam 2.44.0 or soon after (Spark runner) (#22094).
• The modules amazon-web-services and kinesis for AWS Java SDK v1 are deprecated in favor of amazon-web-services2 and will be eventually removed after a few Beam releases (Java) (#21249).

Bugfixes

... (truncated)

Commits

• dc8bce5 Set version for 2.42.0 RC2
• c7f2cab [CherryPick]#23062 Fix Java Examples_Flink in 2.42.0 release. (#23605)
• 926fb53 fix: only report backlog bytes on data records (#23493) (#23530)
• 135877e Fix IllegalStateException in StorageApiWriteUnshardedRecords error handling. ...
• 6f75987 Update cut_release_branch.sh
• 557020e [release-2.42.0] Only close committers after all CheckpointMarks have gone aw...
• 22f672e Pin the version of cloudpickle to 2.1.x for Beam 2.42.0 (#23121)
• 4d4fd06 Revert "#19857 Migrate to using a memory aware cache within the Python SDK ...
• 3137081 [release-2.42.0] Use existing pickle_library flag in expansion service. (#23118)
• 3d64d63 Use cloudpickle for Java Python transforms. (#23093)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #100.