Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Blog post about TopK filter pushdown #15513

Open
Tracked by #15512 ...
alamb opened this issue Mar 31, 2025 · 0 comments
Open
Tracked by #15512 ...

Blog post about TopK filter pushdown #15513

alamb opened this issue Mar 31, 2025 · 0 comments
Labels
documentation Improvements or additions to documentation enhancement New feature or request

Comments

@alamb
Copy link
Contributor

alamb commented Mar 31, 2025

Is your feature request related to a problem or challenge?

@adriangb has a great PR to add dynamic filtering with TopK in DataFusion here:

Describe the solution you'd like

It would be really nice to write a blog post about this optimization in DataFusion (and maybe call out how it works)

Here are some related work

High level points

  • Study DuckDB plan Make ClickBench Q23 Go Faster #15177 (hos much faster)
  • Went back and forth to design something that could be general purpose
  • Did benchmarking,
  • Results are amazing, etc

Describe alternatives you've considered

No response

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant