[
https://issues.apache.org/jira/browse/DRILL-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14126419#comment-14126419
]
Jason Altekruse commented on DRILL-1388:
----------------------------------------
{
"head" : {
"version" : 1,
"generator" : {
"type" : "DefaultSqlHandler",
"info" : ""
},
"type" : "APACHE_DRILL_PHYSICAL",
"options" : [ ],
"queue" : 0,
"resultMode" : "EXEC"
},
"graph" : [ {
"pop" : "parquet-scan",
"@id" : 1,
"entries" : [ {
"path" : "file:/tmp/store_sales"
} ],
"storage" : {
"type" : "file",
"enabled" : true,
"connection" : "file:///",
"workspaces" : {
"root" : {
"location" : "/",
"writable" : false,
"storageformat" : null
},
"tmp" : {
"location" : "/tmp",
"writable" : true,
"storageformat" : "csv"
}
},
"formats" : {
"psv" : {
"type" : "text",
"extensions" : [ "tbl" ],
"delimiter" : "|"
},
"csv" : {
"type" : "text",
"extensions" : [ "csv" ],
"delimiter" : ","
},
"tsv" : {
"type" : "text",
"extensions" : [ "tsv" ],
"delimiter" : "\t"
},
"parquet" : {
"type" : "parquet"
},
"json" : {
"type" : "json"
}
}
},
"format" : {
"type" : "parquet"
},
"columns" : [ "`pig_schema`", "`ss_sold_date_sk`", "`ss_item_sk`",
"`ss_cdemo_sk`", "`ss_addr_sk`", "`ss_hdemo_sk`" ],
"selectionRoot" : "/tmp/store_sales",
"cost" : 2880404.0
}, {
"pop" : "screen",
"@id" : 0,
"child" : 1,
"initialAllocation" : 1000000,
"maxAllocation" : 10000000000,
"cost" : 2880404.0
} ]
}
> Incorrect results when projecting nulls
> ---------------------------------------
>
> Key: DRILL-1388
> URL: https://issues.apache.org/jira/browse/DRILL-1388
> Project: Apache Drill
> Issue Type: Bug
> Reporter: Jason Altekruse
>
> While testing fixed for the parquet nullable support I ran into an issue with
> unexpected results. I was selecting several columns out of file parquet file,
> which supports project pushdown. Currently the planner still includes a
> project operation after the scan in this case (to properly modify schema in
> the case of array indexing, project pushdown into scans is currently not
> supposed to be changing structure). I pulled the physical plan from the query
> and ran it without the extra project (as I was not selecting any array
> values) and got the expected results.
> Here is the query I ran, the file is too large to attach so you can e-mail me
> to get a copy of it.
> select pig_schema,ss_sold_date_sk,ss_item_sk,ss_cdemo_sk,ss_addr_sk,
> ss_hdemo_sk from store_sales
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
