[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579784#comment-14579784 ] Xuefu Zhang commented on HIVE-10816: Yeah. I think it makes sense to commit it to branch-1 as well. NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Fix For: 1.3.0 Attachments: HIVE-10816.1.patch, HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579672#comment-14579672 ] Lefty Leverenz commented on HIVE-10816: --- Version question: Since this was committed to master shouldn't it say Fix Version 2.0.0, or will it also be committed to branch-1 for 1.3.0? NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Fix For: 1.3.0 Attachments: HIVE-10816.1.patch, HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579865#comment-14579865 ] Rui Li commented on HIVE-10816: --- Thanks [~leftylev] and [~xuefuz] for catching this. I didn't realize master is on 2.0.0 now. Committed to branch-1 as well. NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Fix For: 1.3.0 Attachments: HIVE-10816.1.patch, HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580013#comment-14580013 ] Navis commented on HIVE-10816: -- [~lirui] I don't know why I've not been notified but here is my late +1 NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Fix For: 1.3.0, 2.0.0 Attachments: HIVE-10816.1.patch, HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577232#comment-14577232 ] Xuefu Zhang commented on HIVE-10816: +1 NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Attachments: HIVE-10816.1.patch, HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570622#comment-14570622 ] Hive QA commented on HIVE-10816: {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12737091/HIVE-10816.1.patch {color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 8992 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_nondeterministic org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx_cbo_2 {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4155/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4155/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4155/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 3 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12737091 - PreCommit-HIVE-TRUNK-Build NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Attachments: HIVE-10816.1.patch, HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571995#comment-14571995 ] Rui Li commented on HIVE-10816: --- Hi [~navis], would you mind take a look at this when you got time? NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Attachments: HIVE-10816.1.patch, HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558259#comment-14558259 ] Xuefu Zhang commented on HIVE-10816: [~lirui], just curious, what's the cause? is that conf is null when submitting via child? Patch looks good. NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Attachments: HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558294#comment-14558294 ] Hive QA commented on HIVE-10816: {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12735156/HIVE-10816.1.patch {color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 8973 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_crc32 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_sha1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_join30 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_null_projection {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4031/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4031/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4031/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 4 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12735156 - PreCommit-HIVE-TRUNK-Build NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Attachments: HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558609#comment-14558609 ] Rui Li commented on HIVE-10816: --- [~xuefuz] - Yeah, when submitted via child, the ExecDriver is not initialized (ExecDriver extends Task) and the HiveConf is null. I'll look at the failures. NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Attachments: HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10816) NPE in ExecDriver::handleSampling when submitted via child JVM
[ https://issues.apache.org/jira/browse/HIVE-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558630#comment-14558630 ] Rui Li commented on HIVE-10816: --- The 4 tests fail on master as well. Don't suppose they're related to the patch here. NPE in ExecDriver::handleSampling when submitted via child JVM -- Key: HIVE-10816 URL: https://issues.apache.org/jira/browse/HIVE-10816 Project: Hive Issue Type: Bug Reporter: Rui Li Assignee: Rui Li Attachments: HIVE-10816.1.patch When {{hive.exec.submitviachild = true}}, parallel order by fails with NPE and falls back to single-reducer mode. Stack trace: {noformat} 2015-05-25 08:41:04,446 ERROR [main]: mr.ExecDriver (ExecDriver.java:execute(386)) - Sampling error java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:513) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:379) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:750) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)