Bump apache-beam[gcp] from 2.28.0 to 2.44.0 in /megalist_dataflow

[dependabot]

Bumps apache-beam[gcp] from 2.28.0 to 2.44.0.

Release notes

Sourced from apache-beam[gcp]'s releases.

v2.44.0

We are happy to present the new 2.44.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.

For more information on changes in 2.44.0, check out the detailed release notes.

I/Os

• Support for Bigtable sink (Write and WriteBatch) added (Go) (#23324).
• S3 implementation of the Beam filesystem (Go) (#23991).
• Support for SingleStoreDB source and sink added (Java) (#22617).
• Added support for DefaultAzureCredential authentication in Azure Filesystem (Python) (#24210).
• Added new CdapIO for CDAP Batch and Streaming Source/Sinks (Java) (#24961).
• Added new SparkReceiverIO for Spark Receivers 2.4.* (Java) (#24960).

New Features / Improvements

• Beam now provides a portable "runner" that can render pipeline graphs with graphviz. See python -m apache_beam.runners.render --help for more details.
• Local packages can now be used as dependencies in the requirements.txt file, rather than requiring them to be passed separately via the --extra_package option (Python) (#23684).
• Pipeline Resource Hints now supported via --resource_hints flag (Go) (#23990).
• Make Python SDK containers reusable on portable runners by installing dependencies to temporary venvs (BEAM-12792).
• RunInference model handlers now support the specification of a custom inference function in Python (#22572)
• Support for map_windows urn added to Go SDK (#24307).

Breaking Changes

• ParquetIO.withSplit was removed since splittable reading has been the default behavior since 2.35.0. The effect of this change is to drop support for non-splittable reading (Java)(#23832).
• beam-sdks-java-extensions-google-cloud-platform-core is no longer a dependency of the Java SDK Harness. Some users of a portable runner (such as Dataflow Runner v2) may have an undeclared dependency on this package (for example using GCS with TextIO) and will now need to declare the dependency.
• beam-sdks-java-core is no longer a dependency of the Java SDK Harness. Users of a portable runner (such as Dataflow Runner v2) will need to provide this package and its dependencies.
• Slices now use the Beam Iterable Coder. This enables cross language use, but breaks pipeline updates if a Slice type is used as a PCollection element or State API element. (Go)#24339

Bugfixes

• Fixed JmsIO acknowledgment issue (Java) (#20814)
• Fixed Beam SQL CalciteUtils (Java) and Cross-language JdbcIO (Python) did not support JDBC CHAR/VARCHAR, BINARY/VARBINARY logical types (#23747, #23526).
• Ensure iterated and emitted types are used with the generic register package are registered with the type and schema registries.(Go) (#23889)

List of Contributors

... (truncated)

Changelog

Sourced from apache-beam[gcp]'s changelog.

[2.44.0] - 2023-01-12

Highlights

• New highly anticipated feature X added to Python SDK (#X).
• New highly anticipated feature Y added to Java SDK (#Y).

I/Os

• Support for Bigtable sink (Write and WriteBatch) added (Go) (#23324).
• S3 implementation of the Beam filesystem (Go) (#23991).
• Support for SingleStoreDB source and sink added (Java) (#22617).
• Added support for DefaultAzureCredential authentication in Azure Filesystem (Python) (#24210).

New Features / Improvements

• Beam now provides a portable "runner" that can render pipeline graphs with graphviz. See python -m apache_beam.runners.render --help for more details.
• Local packages can now be used as dependencies in the requirements.txt file, rather than requiring them to be passed separately via the --extra_package option (Python) (#23684).
• Pipeline Resource Hints now supported via --resource_hints flag (Go) (#23990).
• Make Python SDK containers reusable on portable runners by installing dependencies to temporary venvs (BEAM-12792).
• RunInference model handlers now support the specification of a custom inference function in Python (#22572)
• Support for map_windows urn added to Go SDK (#24307).

Breaking Changes

• ParquetIO.withSplit was removed since splittable reading has been the default behavior since 2.35.0. The effect of this change is to drop support for non-splittable reading (Java)(#23832).
• beam-sdks-java-extensions-google-cloud-platform-core is no longer a dependency of the Java SDK Harness. Some users of a portable runner (such as Dataflow Runner v2) may have an undeclared dependency on this package (for example using GCS with TextIO) and will now need to declare the dependency.
• beam-sdks-java-core is no longer a dependency of the Java SDK Harness. Users of a portable runner (such as Dataflow Runner v2) will need to provide this package and its dependencies.
• Slices now use the Beam Iterable Coder. This enables cross language use, but breaks pipeline updates if a Slice type is used as a PCollection element or State API element. (Go)#24339

Deprecations

• X behavior is deprecated and will be removed in X versions (#X).

Bugfixes

• Fixed X (Java/Python) (#X).
• Fixed JmsIO acknowledgment issue (Java) (#20814)
• Fixed Beam SQL CalciteUtils (Java) and Cross-language JdbcIO (Python) did not support JDBC CHAR/VARCHAR, BINARY/VARBINARY logical types (#23747, #23526).
• Ensure iterated and emitted types are used with the generic register package are registered with the type and schema registries.(Go) (#23889)

... (truncated)

Commits

• b5faa33 Set version for 2.44.0 RC1
• cad6513 Merge pull request #24925: [release-2.44.0] Cherry pick: Attempt deserialize ...
• 190997e Attempt deserialize all non-standard portable logical types from proto (#24910)
• 342e3bb Merge pull request #24883: [release-2.44.0]Install sklearn < 1.20.0 for sklea...
• e29d3b3 Install sklearn < 1.20.0 for sklearn postcommit tests (#24788)
• 0d1c3f0 Merge pull request #24884: [release-2.44.0] Restrict tox to be in 3.x version...
• 73c1de5 Restrict tox to be in 3.x version (#24601)
• 56a8973 Merge pull request #24650: Remove 'Hidden' attribute from serviceAccount Pipe...
• d6b9c95 Remove 'Hidden' attribute from serviceAccount PipelineOption (#24642)
• 74ca77b Merge pull request #24632: Cherrypick #24606 to 2.44.0 release branch (disall...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #110.