[jira] [Updated] (DRILL-5736) SYSTEM ERROR: NullPointerException when selecting 88 parquet files(132MB)
[
https://issues.apache.org/jira/browse/DRILL-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris updated DRILL-5736:
-
Summary: SYSTEM ERROR: NullPointerException when selecting 88 parquet
files(132MB) (was: SYSTEM ERROR NullPointerException when selecting 88
parquet files(132MB))
> SYSTEM ERROR: NullPointerException when selecting 88 parquet files(132MB)
> --
>
> Key: DRILL-5736
> URL: https://issues.apache.org/jira/browse/DRILL-5736
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill
>Affects Versions: 1.11.0
> Environment: java version "1.8.0_40"
> Java(TM) SE Runtime Environment (build 1.8.0_40-b26)
> Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> System Software Overview:
> System Version: OS X 10.11.4 (15E65)
> Kernel Version: Darwin 15.4.0
> Boot Volume: Macintosh HD
> Boot Mode: Normal
> Computer Name: smallworld的MacBook Pro
> User Name: smallworld (smallworld)
> Secure Virtual Memory: Enabled
> System Integrity Protection: Enabled
> Time since boot: 1:38
>Reporter: Chris
> Labels: multiple, nullpointerexception, parquet
> Attachments: error_log20170822.txt, report1and2_error.png,
> report1and2_struct.png, report1_ok.png, report2_ok.png
>
>
> *1. Parquet file structure to be queried.* There're three directories
> /reports1, /reports2, and /reports1and2, as png files attached.
>
> /reports1(36 subdirectories and 36 parquet files
> included.)
> |__report1/0_0_0.parquet(1.5MB)
> |__report2/0_0_0.parquet(1.5MB)
> ...
> |__report36/0_0_0.parquet(1.5MB)
> /reports2(50 subdirectories and 50 parquet files
> included.)
> |__report37/0_0_0.parquet(1.5MB)
> |__report38/0_0_0.parquet(1.5MB)
> ...
> |__report88/0_0_0.parquet(1.5MB)
> /reports1and2 88 subdirectories and 88 parquet files
> merged above.
> |__report1/0_0_0.parquet(1.5MB)
> |__report2/0_0_0.parquet(1.5MB)
> ...
> |__report88/0_0_0.parquet(1.5MB)
> *2. Error when doing SELECT query.*
> *2.1 SELECT reports1, it is ok.*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1/report_HCB*`;
> 61,994 rows selected (0.744 seconds)
> *2.2 SELECT reports2, it is ok.*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports2/report_HCB*`;
> 85,452 rows selected (0.743 seconds)
> *{color:red}2.3 SELECT reports1and2, errors occur.{color}*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1and2/report_HCB*`;
> {color:red}Error: SYSTEM ERROR: NullPointerException
> Fragment 1:1
> [Error Id: 54595882-3767-4b0a-91c4-671b16b86fdf on 192.168.0.13:31010]
> (state=,code=0){color}
> *3. Error log*
> See attached error_log20170822.txt
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (DRILL-5736) SYSTEM ERROR NullPointerException when selecting 88 parquet files(132MB)
[
https://issues.apache.org/jira/browse/DRILL-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris updated DRILL-5736:
-
Description:
*1. Parquet file structure to be queried.* There're three directories
/reports1, /reports2, and /reports1and2, as png files attached.
/reports1(36 subdirectories and 36 parquet files
included.)
|__report1/0_0_0.parquet(1.5MB)
|__report2/0_0_0.parquet(1.5MB)
...
|__report36/0_0_0.parquet(1.5MB)
/reports2(50 subdirectories and 50 parquet files
included.)
|__report37/0_0_0.parquet(1.5MB)
|__report38/0_0_0.parquet(1.5MB)
...
|__report88/0_0_0.parquet(1.5MB)
/reports1and2 88 subdirectories and 88 parquet files
merged above.
|__report1/0_0_0.parquet(1.5MB)
|__report2/0_0_0.parquet(1.5MB)
...
|__report88/0_0_0.parquet(1.5MB)
*2. Error when doing SELECT query.*
*2.1 SELECT reports1, it is ok.*
0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1/report_HCB*`;
61,994 rows selected (0.744 seconds)
*2.2 SELECT reports2, it is ok.*
0: jdbc:drill:zk=local> SELECT snp_id from db.`reports2/report_HCB*`;
85,452 rows selected (0.743 seconds)
*{color:red}2.3 SELECT reports1and2, errors occur.{color}*
0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1and2/report_HCB*`;
{color:red}Error: SYSTEM ERROR: NullPointerException
Fragment 1:1
[Error Id: 54595882-3767-4b0a-91c4-671b16b86fdf on 192.168.0.13:31010]
(state=,code=0){color}
*3. Error log*
See attached error_log20170822.txt
was:
*1. Parquet file structure to be queried.* There're three directories
/reports1, /reports2, and /reports1and2.
/reports1(36 subdirectories and 36 parquet files
included.)
|__report1/0_0_0.parquet(1.5MB)
|__report2/0_0_0.parquet(1.5MB)
...
|__report36/0_0_0.parquet(1.5MB)
/reports2(50 subdirectories and 50 parquet files
included.)
|__report37/0_0_0.parquet(1.5MB)
|__report38/0_0_0.parquet(1.5MB)
...
|__report88/0_0_0.parquet(1.5MB)
/reports1and2 88 subdirectories and 88 parquet files
merged above.
|__report1/0_0_0.parquet(1.5MB)
|__report2/0_0_0.parquet(1.5MB)
...
|__report88/0_0_0.parquet(1.5MB)
*2. Error when doing SELECT query.*
*2.1 SELECT reports1, it is ok.*
0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1/report_HCB*`;
61,994 rows selected (0.744 seconds)
*2.2 SELECT reports2, it is ok.*
0: jdbc:drill:zk=local> SELECT snp_id from db.`reports2/report_HCB*`;
85,452 rows selected (0.743 seconds)
*{color:red}2.3 SELECT reports1and2, errors occur.{color}*
0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1and2/report_HCB*`;
{color:red}Error: SYSTEM ERROR: NullPointerException
Fragment 1:1
[Error Id: 54595882-3767-4b0a-91c4-671b16b86fdf on 192.168.0.13:31010]
(state=,code=0){color}
*3. Error log*
2017-08-22 13:03:43,435 [266444d0-30ca-5bf6-5b85-4d147fcc9379:frag:1:1] ERROR
o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: NullPointerException
Fragment 1:1
[Error Id: a9e14b40-5ccb-424d-9c9b-fbc3cd397fe7 on 192.168.0.13:31010]
org.apache.drill.common.exceptions.UserException: SYSTEM ERROR:
NullPointerException
Fragment 1:1
[Error Id: a9e14b40-5ccb-424d-9c9b-fbc3cd397fe7 on 192.168.0.13:31010]
at
org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:550)
~[drill-common-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:295)
[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:160)
[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:264)
[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
[drill-common-1.11.0.jar:1.11.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_40]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_40]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Instantiation
of [simple type, class org.apache.drill.exec.store.parquet.ParquetRowGroupScan]
value failed (java.lang.NullPointerException): null
at [Source: {
"pop" : "single-sender",
"@id" : 0,
"receiver-major-fragment" : 0,
"receiver-minor-fragment" : 0,
"child" : {
"pop" : "parquet-row-group
[jira] [Updated] (DRILL-5736) SYSTEM ERROR NullPointerException when selecting 88 parquet files(132MB)
[
https://issues.apache.org/jira/browse/DRILL-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris updated DRILL-5736:
-
Attachment: error_log20170822.txt
report1and2_error.png
report2_ok.png
report1_ok.png
report1and2_struct.png
> SYSTEM ERROR NullPointerException when selecting 88 parquet files(132MB)
> -
>
> Key: DRILL-5736
> URL: https://issues.apache.org/jira/browse/DRILL-5736
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill
>Affects Versions: 1.11.0
> Environment: java version "1.8.0_40"
> Java(TM) SE Runtime Environment (build 1.8.0_40-b26)
> Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> System Software Overview:
> System Version: OS X 10.11.4 (15E65)
> Kernel Version: Darwin 15.4.0
> Boot Volume: Macintosh HD
> Boot Mode: Normal
> Computer Name: smallworld的MacBook Pro
> User Name: smallworld (smallworld)
> Secure Virtual Memory: Enabled
> System Integrity Protection: Enabled
> Time since boot: 1:38
>Reporter: Chris
> Labels: multiple, nullpointerexception, parquet
> Attachments: error_log20170822.txt, report1and2_error.png,
> report1and2_struct.png, report1_ok.png, report2_ok.png
>
>
> *1. Parquet file structure to be queried.* There're three directories
> /reports1, /reports2, and /reports1and2.
>
> /reports1(36 subdirectories and 36 parquet files
> included.)
> |__report1/0_0_0.parquet(1.5MB)
> |__report2/0_0_0.parquet(1.5MB)
> ...
> |__report36/0_0_0.parquet(1.5MB)
> /reports2(50 subdirectories and 50 parquet files
> included.)
> |__report37/0_0_0.parquet(1.5MB)
> |__report38/0_0_0.parquet(1.5MB)
> ...
> |__report88/0_0_0.parquet(1.5MB)
> /reports1and2 88 subdirectories and 88 parquet files
> merged above.
> |__report1/0_0_0.parquet(1.5MB)
> |__report2/0_0_0.parquet(1.5MB)
> ...
> |__report88/0_0_0.parquet(1.5MB)
> *2. Error when doing SELECT query.*
> *2.1 SELECT reports1, it is ok.*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1/report_HCB*`;
> 61,994 rows selected (0.744 seconds)
> *2.2 SELECT reports2, it is ok.*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports2/report_HCB*`;
> 85,452 rows selected (0.743 seconds)
> *{color:red}2.3 SELECT reports1and2, errors occur.{color}*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1and2/report_HCB*`;
> {color:red}Error: SYSTEM ERROR: NullPointerException
> Fragment 1:1
> [Error Id: 54595882-3767-4b0a-91c4-671b16b86fdf on 192.168.0.13:31010]
> (state=,code=0){color}
> *3. Error log*
> 2017-08-22 13:03:43,435 [266444d0-30ca-5bf6-5b85-4d147fcc9379:frag:1:1] ERROR
> o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: NullPointerException
> Fragment 1:1
> [Error Id: a9e14b40-5ccb-424d-9c9b-fbc3cd397fe7 on 192.168.0.13:31010]
> org.apache.drill.common.exceptions.UserException: SYSTEM ERROR:
> NullPointerException
> Fragment 1:1
> [Error Id: a9e14b40-5ccb-424d-9c9b-fbc3cd397fe7 on 192.168.0.13:31010]
> at
> org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:550)
> ~[drill-common-1.11.0.jar:1.11.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:295)
> [drill-java-exec-1.11.0.jar:1.11.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:160)
> [drill-java-exec-1.11.0.jar:1.11.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:264)
> [drill-java-exec-1.11.0.jar:1.11.0]
> at
> org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
> [drill-common-1.11.0.jar:1.11.0]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_40]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_40]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
> Caused by: com.fasterxml.jackson.databind.JsonMappingException: Instantiation
> of [simple type, class
> org.apache.drill.exec.store.parquet.ParquetRowGroupScan] value failed
> (java.lang.NullPointerException): null
> at [Source: {
> "pop" : "single-sender",
> "@id" : 0,
> "receiver-major-fragment" : 0,
> "receiver-minor-fragment" : 0,
> "child" : {
> "pop" : "parquet-row-group-scan",
> "@id" : 1,
> "userName" : "smallworld",
> "storage" : {
> "type" : "file",
> "enabled"
[jira] [Updated] (DRILL-5736) SYSTEM ERROR NullPointerException when selecting 88 parquet files(132MB)
[
https://issues.apache.org/jira/browse/DRILL-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris updated DRILL-5736:
-
Labels: multiple nullpointerexception parquet (was: )
> SYSTEM ERROR NullPointerException when selecting 88 parquet files(132MB)
> -
>
> Key: DRILL-5736
> URL: https://issues.apache.org/jira/browse/DRILL-5736
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill
>Affects Versions: 1.11.0
> Environment: java version "1.8.0_40"
> Java(TM) SE Runtime Environment (build 1.8.0_40-b26)
> Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> System Software Overview:
> System Version: OS X 10.11.4 (15E65)
> Kernel Version: Darwin 15.4.0
> Boot Volume: Macintosh HD
> Boot Mode: Normal
> Computer Name: smallworld的MacBook Pro
> User Name: smallworld (smallworld)
> Secure Virtual Memory: Enabled
> System Integrity Protection: Enabled
> Time since boot: 1:38
>Reporter: Chris
> Labels: multiple, nullpointerexception, parquet
>
> *1. Parquet file structure to be queried.* There're three directories
> /reports1, /reports2, and /reports1and2.
>
> /reports1(36 subdirectories and 36 parquet files
> included.)
> |__report1/0_0_0.parquet(1.5MB)
> |__report2/0_0_0.parquet(1.5MB)
> ...
> |__report36/0_0_0.parquet(1.5MB)
> /reports2(50 subdirectories and 50 parquet files
> included.)
> |__report37/0_0_0.parquet(1.5MB)
> |__report38/0_0_0.parquet(1.5MB)
> ...
> |__report88/0_0_0.parquet(1.5MB)
> /reports1and2 88 subdirectories and 88 parquet files
> merged above.
> |__report1/0_0_0.parquet(1.5MB)
> |__report2/0_0_0.parquet(1.5MB)
> ...
> |__report88/0_0_0.parquet(1.5MB)
> *2. Error when doing SELECT query.*
> *2.1 SELECT reports1, it is ok.*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1/report_HCB*`;
> 61,994 rows selected (0.744 seconds)
> *2.2 SELECT reports2, it is ok.*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports2/report_HCB*`;
> 85,452 rows selected (0.743 seconds)
> *{color:red}2.3 SELECT reports1and2, errors occur.{color}*
> 0: jdbc:drill:zk=local> SELECT snp_id from db.`reports1and2/report_HCB*`;
> {color:red}Error: SYSTEM ERROR: NullPointerException
> Fragment 1:1
> [Error Id: 54595882-3767-4b0a-91c4-671b16b86fdf on 192.168.0.13:31010]
> (state=,code=0){color}
> *3. Error log*
> 2017-08-22 13:03:43,435 [266444d0-30ca-5bf6-5b85-4d147fcc9379:frag:1:1] ERROR
> o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: NullPointerException
> Fragment 1:1
> [Error Id: a9e14b40-5ccb-424d-9c9b-fbc3cd397fe7 on 192.168.0.13:31010]
> org.apache.drill.common.exceptions.UserException: SYSTEM ERROR:
> NullPointerException
> Fragment 1:1
> [Error Id: a9e14b40-5ccb-424d-9c9b-fbc3cd397fe7 on 192.168.0.13:31010]
> at
> org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:550)
> ~[drill-common-1.11.0.jar:1.11.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:295)
> [drill-java-exec-1.11.0.jar:1.11.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:160)
> [drill-java-exec-1.11.0.jar:1.11.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:264)
> [drill-java-exec-1.11.0.jar:1.11.0]
> at
> org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
> [drill-common-1.11.0.jar:1.11.0]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_40]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_40]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
> Caused by: com.fasterxml.jackson.databind.JsonMappingException: Instantiation
> of [simple type, class
> org.apache.drill.exec.store.parquet.ParquetRowGroupScan] value failed
> (java.lang.NullPointerException): null
> at [Source: {
> "pop" : "single-sender",
> "@id" : 0,
> "receiver-major-fragment" : 0,
> "receiver-minor-fragment" : 0,
> "child" : {
> "pop" : "parquet-row-group-scan",
> "@id" : 1,
> "userName" : "smallworld",
> "storage" : {
> "type" : "file",
> "enabled" : true,
> "connection" : "file:///",
> "config" : null,
> "workspaces" : {
> "root" : {
> "location" : "/Users/sw/gdb_v1",
> "writable" : true,
> "defaultInputFormat" : null
> },
>
