Skip to content

Update Spark in PySpark to use newer Spark stubs #653

@yruslan

Description

@yruslan

Background

This is because Spark 3.1.3 has reported vulnerabilities. The suggestion is to switch to 3.3.4+

Feature

Update Spark in PySpark to use newer Spark stubs.

Example [Optional]

--

Proposed Solution [Optional]

--

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions