Skip to content

Conversation

kaxil
Copy link
Member

@kaxil kaxil commented Aug 31, 2025

Introduces server-side SerializedParam and SerializedParamsDict classes to eliminate SDK dependencies during DAG deserialization. This change ensures the scheduler and API server can deserialize DAGs without importing Task SDK modules.

Part of #52141

TODO:

  • Param Validation

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@kaxil kaxil added this to the Airflow 3.1.0 milestone Aug 31, 2025
@uranusjr uranusjr force-pushed the params-s10n branch 6 times, most recently from 7643d52 to 4697efa Compare September 5, 2025 04:05
@uranusjr uranusjr added the full tests needed We need to run full set of tests for this PR to merge label Sep 5, 2025
@uranusjr uranusjr marked this pull request as ready for review September 5, 2025 04:06
Introduces server-side `SerializedParam` and `SerializedParamsDict` classes
to eliminate SDK dependencies during DAG deserialization. This change
ensures the scheduler and API server can deserialize DAGs without
importing Task SDK modules.

Part of apache#52141
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:serialization full tests needed We need to run full set of tests for this PR to merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Make the SerializedDAG & SerializedBaseOp be independent of Task SDK's DAG & BaseOP
2 participants