[
https://issues.apache.org/jira/browse/DRILL-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812040#comment-16812040
]
ASF GitHub Bot commented on DRILL-7062:
---------------------------------------
amansinha100 commented on pull request #1738: DRILL-7062: Initial
implementation of run-time row-group pruning
URL: https://github.com/apache/drill/pull/1738#discussion_r272858014
##########
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/metadata/Metadata.java
##########
@@ -448,23 +476,23 @@ private ColTypeInfo getColTypeInfo(MessageType schema,
Type type, String[] path,
/**
* Get the metadata for a single file
*/
- private ParquetFileMetadata_v3
getParquetFileMetadata_v3(ParquetTableMetadata_v3 parquetTableMetadata,
- final FileStatus file, final FileSystem fs, boolean allColumns,
Set<String> columnSet) throws IOException, InterruptedException {
- final ParquetMetadata metadata;
- final UserGroupInformation processUserUgi =
ImpersonationUtil.getProcessUserUGI();
- final Configuration conf = new Configuration(fs.getConf());
- try {
- metadata =
processUserUgi.doAs((PrivilegedExceptionAction<ParquetMetadata>)() -> {
- try (ParquetFileReader parquetFileReader =
ParquetFileReader.open(HadoopInputFile.fromStatus(file, conf),
readerConfig.toReadOptions())) {
- return parquetFileReader.getFooter();
- }
- });
- } catch(Exception e) {
- logger.error("Exception while reading footer of parquet file [Details -
path: {}, owner: {}] as process user {}",
- file.getPath(), file.getOwner(), processUserUgi.getShortUserName(), e);
- throw e;
+ public static ParquetFileMetadata_v3
getParquetFileMetadata_v3(ParquetTableMetadata_v3 parquetTableMetadata,
ParquetMetadata footer,
Review comment:
A reminder that a similar change would need to be done for V4 once it is
merged.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Run-time row group pruning
> --------------------------
>
> Key: DRILL-7062
> URL: https://issues.apache.org/jira/browse/DRILL-7062
> Project: Apache Drill
> Issue Type: Sub-task
> Components: Metadata
> Reporter: Venkata Jyothsna Donapati
> Assignee: Boaz Ben-Zvi
> Priority: Major
> Fix For: 1.16.0
>
> Original Estimate: 504h
> Remaining Estimate: 504h
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
