[
https://issues.apache.org/jira/browse/DRILL-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637627#comment-14637627
]
Stefán Baxter commented on DRILL-3533:
--------------------------------------
Hi,
Should this step be taking forever? (+10 minutes on i7+ssd):
[INFO]
[INFO]
------------------------------------------------------------------------
[INFO] Building Packaging and Distribution Assembly 1.2.0-SNAPSHOT
[INFO]
------------------------------------------------------------------------
[INFO]
[INFO] --- apache-rat-plugin:0.10:check (rat-checks) @ distribution ---
[INFO] 51 implicit excludes (use -debug for more details).
[INFO] Exclude: **/conffiles
[INFO] Exclude: **/git.properties
[INFO] Exclude: **/control
[INFO] Exclude: **/*.checkstyle
[INFO] Exclude: **/*.json
[INFO] Exclude: **/README.md
[INFO] Exclude: **/hadoop-excludes.txt
[INFO] 844 resources included (use -debug for more details)
Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property '
http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not
recognized.
Compiler warnings:
WARNING: 'org.apache.xerces.jaxp.SAXParserImpl: Property '
http://javax.xml.XMLConstants/property/accessExternalDTD' is not
recognized.'
Warning: org.apache.xerces.parsers.SAXParser: Feature '
http://javax.xml.XMLConstants/feature/secure-processing' is not recognized.
Warning: org.apache.xerces.parsers.SAXParser: Property '
http://javax.xml.XMLConstants/property/accessExternalDTD' is not recognized.
Warning: org.apache.xerces.parsers.SAXParser: Property '
http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not
recognized.
Regards,
-Stefán
> null values in a sub-structure in Parquet returns unexpected/misleading
> results
> -------------------------------------------------------------------------------
>
> Key: DRILL-3533
> URL: https://issues.apache.org/jira/browse/DRILL-3533
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 1.1.0
> Reporter: Stefán Baxter
> Assignee: Parth Chandra
> Priority: Critical
>
> With this minimal dataset as /tmp/test.json:
> {"dimensions":{"adults":"A"}}
> select lower(p.dimensions.budgetLevel) as `field1`,
> lower(p.dimensions.adults) as `field2` from dfs.tmp.`/test.json` as p;
> Returns this:
> +---------+---------+
> | field1 | field2 |
> +---------+---------+
> | null | a |
> +---------+---------+
> With the same data as a Parquet file
> CREATE TABLE dfs.tmp.`/test` AS SELECT * FROM dfs.tmp.`/test.json`;
> The same query:
> select lower(p.dimensions.budgetLevel) as `field1`,
> lower(p.dimensions.adults) as `field2` from dfs.tmp.`/test/0_0_0.parquet` as
> p;
> Return this:
> +---------+---------+
> | field1 | field2 |
> +---------+---------+
> | a | null |
> +---------+---------+
> After some more testing it appears that this has nothing to do with trim.
> (any non existing nested-value will be pushed aside)
> select p.dimensions.budgetLevel as `field1`, lower(p.dimensions.adults) as
> `field2` from dfs.tmp.`/test/0_0_0.parquet` as p;
> also returns:
> +---------+---------+
> | field1 | field2 |
> +---------+---------+
> | a | null |
> +---------+---------+
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
