Skip to content

fix: set distinct_count to Absent when merging statistics#17385

Merged
crepererum merged 1 commit into
apache:mainfrom
pydantic:drop-distinct-count
Sep 4, 2025
Merged

fix: set distinct_count to Absent when merging statistics#17385
crepererum merged 1 commit into
apache:mainfrom
pydantic:drop-distinct-count

Conversation

@adriangb

@adriangb adriangb commented Sep 3, 2025

Copy link
Copy Markdown
Contributor

Summary

  • Fixed issue where distinct_count was not properly handled when merging statistics
  • Set distinct_count to Precision::Absent during merge operations as the actual distinct count cannot be accurately determined from merged statistics

Test plan

  • Added test test_try_merge_distinct_count_absent to verify distinct_count becomes Absent after merge
  • All existing tests continue to pass

🤖 Generated with Claude Code
@adriangb @claude
fix: set distinct_count to Absent when merging statistics
c08cb6c 
When merging statistics, the distinct count cannot be accurately
determined from the merged data, so it should be set to Absent
rather than attempting to combine the values.

Added test to verify distinct_count becomes Absent after merge.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@github-actions github-actions Bot added the common Related to common crate label Sep 3, 2025
crepererum
crepererum approved these changes Sep 4, 2025
View reviewed changes

@crepererum crepererum left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you
@crepererum
crepererum merged commit 71d3d29 into apache:main Sep 4, 2025
28 checks passed
@adriangb
adriangb deleted the drop-distinct-count branch September 4, 2025 13:31
destrex271 pushed a commit to destrex271/datafusion that referenced this pull request Sep 5, 2025
@adriangb @claude @destrex271
fix: set distinct_count to Absent when merging statistics (apache#17385)
5792621 
When merging statistics, the distinct count cannot be accurately
determined from the merged data, so it should be set to Absent
rather than attempting to combine the values.

Added test to verify distinct_count becomes Absent after merge.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: Claude <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

common Related to common crate

2 participants

@adriangb @crepererum