feat: expose spark-compatible functions#1564

Draft

timsaucer wants to merge 16 commits into

apache:mainfrom

timsaucer:feat/expose-spark-functions

Commits on May 30, 2026

feat: expose Spark-compatible functions (#1482)

timsaucer
and
claude
committed
chore: drop unused borrow_deref_ref allows

timsaucer
and
claude
committed
refactor: tighten spark_functions macros via expr_fn

timsaucer
and
claude
committed
docs: clarify spark functions cover DataFrame API too

timsaucer
and
claude
committed
docs: rewrite spark DataFrame intro for users

timsaucer
and
claude
committed
docs: defer spark function list to API reference

timsaucer
and
claude
committed
Merge branch 'main' into feat/expose-spark-functions
timsaucer
committed
test: replace spark doctest skips with verified examples

timsaucer
and
claude
committed
refactor(spark): rename function params to match pyspark

timsaucer
and
claude
committed
feat(spark): make pyspark-optional params optional

timsaucer
and
claude
committed
refactor(spark): reshape varargs to match pyspark signatures

timsaucer
and
claude
committed
docs(skills): cover the new spark function namespace

timsaucer
and
claude
committed
docs(skills): drop references to PYSPARK_ALIGNMENT_PLAN.md

timsaucer
and
claude
committed
docs(skills): make-pythonic also targets functions.spark

timsaucer
and
claude
committed
docs(skill): point at spark __all__ instead of enumerating

timsaucer
and
claude
committed

Commits on Jun 1, 2026

docs(spark): use isoformat in spark_cast doctest

timsaucer
and
claude
committed