Skip to content

Add Fetch Property to OutputRequirementExec#16892

Merged
berkaysynnada merged 2 commits into
apache:mainfrom
synnada-ai:or-fetch
Jul 28, 2025
Merged

Add Fetch Property to OutputRequirementExec#16892
berkaysynnada merged 2 commits into
apache:mainfrom
synnada-ai:or-fetch

Conversation

@berkaysynnada

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

  • Closes #.

Rationale for this change

In some of our use cases, OutputRequirementExec requires fetch capability during planning. I believe including this functionality upstream would benefit everyone.

What changes are included in this PR?

  • Added a fetch field to OutputRequirementExec, similar to many other operators. Since it is not an actual operator converted into a stream, this addition has no runtime effect.

Are these changes tested?

Are there any user-facing changes?

@github-actions github-actions Bot added optimizer Optimizer rules core Core DataFusion crate labels Jul 24, 2025
@berkaysynnada

Copy link
Copy Markdown
Contributor Author

I'll add a test if I can reproduce a failing case

@alamb alamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Again, this one makes sense to me, though I do wonder if we should add some sort of tests or something to make sure it doesn't get broken accidentally

@comphead

Copy link
Copy Markdown
Contributor

is it okay to be merged or we waiting for the test ?

@alamb

alamb commented Jul 27, 2025

Copy link
Copy Markdown
Contributor

is it okay to be merged or we waiting for the test ?

It is ok in my opinion, but let's wait to see if @berkaysynnada has any thoughts

@berkaysynnada

Copy link
Copy Markdown
Contributor Author

We don't want to risk discovering a feature breakage later in downstream projects but let's merge this now. Once I'm able to reproduce the case, I'll open a follow-up PR with the necessary tests ASAP

@berkaysynnada
berkaysynnada merged commit 9f3e7dc into apache:main Jul 28, 2025
27 checks passed
adriangb pushed a commit to pydantic/datafusion that referenced this pull request Jul 28, 2025
* ore fetch

* Update output_requirements.rs
Standing-Man pushed a commit to Standing-Man/datafusion that referenced this pull request Aug 4, 2025
* ore fetch

* Update output_requirements.rs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Core DataFusion crate optimizer Optimizer rules

3 participants