pavibhai commented on a change in pull request #936:
URL: https://github.com/apache/orc/pull/936#discussion_r728210589
##########
File path: java/core/src/java/org/apache/orc/OrcConf.java
##########
@@ -176,6 +176,15 @@
+ "must have the filter\n"
+ "reapplied to avoid using unset values in the
unselected rows.\n"
+ "If unsure please leave this as false."),
+ ALLOW_PLUGIN_FILTER("orc.filter.plugin.enable",
+ "orc.filter.plugin.enable",
Review comment:
Renamed to `orc.filter.plugin`
##########
File path: java/core/src/java/org/apache/orc/OrcConf.java
##########
@@ -176,6 +176,15 @@
+ "must have the filter\n"
+ "reapplied to avoid using unset values in the
unselected rows.\n"
+ "If unsure please leave this as false."),
+ ALLOW_PLUGIN_FILTER("orc.filter.plugin.enable",
+ "orc.filter.plugin.enable",
+ false,
+ "Enables the use of plugin filters during read. The
plugin filters "
+ + "are discovered against the service "
+ + "org.apache.orc.filter.PluginFilterService, if
multiple filters are "
+ + "determined they are combined using AND. The order of
application is "
Review comment:
Done
##########
File path: java/core/src/java/org/apache/orc/Reader.java
##########
@@ -637,6 +639,15 @@ public Options useSelected(boolean newValue) {
this.useSelected = newValue;
return this;
}
+
+ public boolean isAllowPluginFilters() {
Review comment:
Renamed to `allowPluginFilters()`
##########
File path: java/core/src/java/org/apache/orc/impl/filter/FilterFactory.java
##########
@@ -46,16 +49,35 @@
* @param isSchemaCaseAware identifies if the schema is case-sensitive
* @param version provides the ORC file version
* @param normalize identifies if the SArg should be normalized or
not
+ * @param filePath that is fully qualified to determine plugin filter(s)
+ * @param conf configuration shared when determining Plugin filter(s)
Review comment:
Done
##########
File path: java/core/src/java/org/apache/orc/impl/filter/FilterFactory.java
##########
@@ -74,11 +96,6 @@ public static BatchFilter createBatchFilter(Reader.Options
opts,
}
}
- // 2. Process input filter
- if (opts.getFilterCallback() != null) {
Review comment:
Yeah it feels cleaner that we go from the more specific to the more
generic ones.
1. Input Filter
2. Filter Plugin
3. SArg Filters
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
