We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test fails:
[info] - filter pushdown - StringPredicate *** FAILED *** (3 seconds, 333 milliseconds) [info] 0 was not greater than 0 (ParquetFilterSuite.scala:242)
Debug logging shows the filter that should have been pushed down:
testStringPredicate filter=value like 'a%' shouldFilterOut=true
Comet plan shows that the filter is pushed down:
*(1) CometColumnarToRow +- CometFilter [value#14], (isnotnull(value#14) AND StartsWith(value#14, a)) +- CometScan parquet [value#14] Batched: true, DataFilters: [isnotnull(value#14), StartsWith(value#14, a)], Format: CometParquet, Location: InMemoryFileIndex(1 paths)[file:/Users/andy/git/apache/apache-spark/target/tmp/spark-e8f77490-5e9..., PartitionFilters: [], PushedFilters: [IsNotNull(value), StringStartsWith(value,a)], ReadSchema: struct<value:string>
However, this fails to filter out partitions during Spark execution.
No response
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Uh oh!
There was an error while loading. Please reload this page.
Describe the bug
Test fails:
Debug logging shows the filter that should have been pushed down:
Comet plan shows that the filter is pushed down:
However, this fails to filter out partitions during Spark execution.
Steps to reproduce
No response
Expected behavior
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: