[
https://issues.apache.org/jira/browse/DRILL-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16816534#comment-16816534
]
ASF GitHub Bot commented on DRILL-7062:
---------------------------------------
Ben-Zvi commented on pull request #1738: DRILL-7062: Initial implementation of
run-time row-group pruning
URL: https://github.com/apache/drill/pull/1738#discussion_r275007436
##########
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/metadata/Metadata.java
##########
@@ -448,23 +476,23 @@ private ColTypeInfo getColTypeInfo(MessageType schema,
Type type, String[] path,
/**
* Get the metadata for a single file
*/
- private ParquetFileMetadata_v3
getParquetFileMetadata_v3(ParquetTableMetadata_v3 parquetTableMetadata,
- final FileStatus file, final FileSystem fs, boolean allColumns,
Set<String> columnSet) throws IOException, InterruptedException {
- final ParquetMetadata metadata;
- final UserGroupInformation processUserUgi =
ImpersonationUtil.getProcessUserUGI();
- final Configuration conf = new Configuration(fs.getConf());
- try {
- metadata =
processUserUgi.doAs((PrivilegedExceptionAction<ParquetMetadata>)() -> {
- try (ParquetFileReader parquetFileReader =
ParquetFileReader.open(HadoopInputFile.fromStatus(file, conf),
readerConfig.toReadOptions())) {
- return parquetFileReader.getFooter();
- }
- });
- } catch(Exception e) {
- logger.error("Exception while reading footer of parquet file [Details -
path: {}, owner: {}] as process user {}",
- file.getPath(), file.getOwner(), processUserUgi.getShortUserName(), e);
- throw e;
+ public static ParquetFileMetadata_v3
getParquetFileMetadata_v3(ParquetTableMetadata_v3 parquetTableMetadata,
ParquetMetadata footer,
Review comment:
Done
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Run-time row group pruning
> --------------------------
>
> Key: DRILL-7062
> URL: https://issues.apache.org/jira/browse/DRILL-7062
> Project: Apache Drill
> Issue Type: Sub-task
> Components: Metadata
> Reporter: Venkata Jyothsna Donapati
> Assignee: Boaz Ben-Zvi
> Priority: Major
> Fix For: 1.17.0
>
> Original Estimate: 504h
> Remaining Estimate: 504h
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
