[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527997#comment-16527997 ] Sahil Takiar commented on HIVE-18916: - There was a clean run on the 18th, since then there have only been minor formatting fixes to make checkstyles pass. I don't think its worth the effort to get another clean run given how slow Hive QA is. Unless anyone objects, I'll merge this later today. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch, HIVE-18916.5.patch, HIVE-18916.6.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527196#comment-16527196 ] Aihua Xu commented on HIVE-18916: - [~stakiar] Right now we need to make tests clear before commit. Can you rebase your code? Otherwise, the change looks good to me. +1. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch, HIVE-18916.5.patch, HIVE-18916.6.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527009#comment-16527009 ] Sahil Takiar commented on HIVE-18916: - [~aihuaxu] any other comments on this? > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch, HIVE-18916.5.patch, HIVE-18916.6.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520794#comment-16520794 ] Hive QA commented on HIVE-18916: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12928646/HIVE-18916.6.patch {color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 14593 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.metastore.TestCatalogNonDefaultClient.functions (batchId=212) org.apache.hadoop.hive.ql.TestTxnCommands.testSimpleAcidInsert (batchId=306) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12001/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12001/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12001/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12928646 - PreCommit-HIVE-Build > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch, HIVE-18916.5.patch, HIVE-18916.6.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520760#comment-16520760 ] Hive QA commented on HIVE-18916: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 43s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 15s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 51s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 2s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 44s{color} | {color:blue} itests/util in master has 52 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 57s{color} | {color:blue} ql in master has 2282 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 25s{color} | {color:blue} spark-client in master has 10 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 27s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 10s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 14s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 48s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 48s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 12s{color} | {color:green} The patch util passed checkstyle {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 37s{color} | {color:red} ql: The patch generated 1 new + 14 unchanged - 3 fixed = 15 total (was 17) {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 10s{color} | {color:green} spark-client: The patch generated 0 new + 26 unchanged - 3 fixed = 26 total (was 29) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m 34s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 27s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 30m 47s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-12001/dev-support/hive-personality.sh | | git revision | master / 6d532e7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-12001/yetus/diff-checkstyle-ql.txt | | modules | C: itests itests/util ql spark-client U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-12001/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch, HIVE-18916.5.patch,
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519007#comment-16519007 ] Hive QA commented on HIVE-18916: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12928401/HIVE-18916.5.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/11962/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11962/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11962/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12928401/HIVE-18916.5.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12928401 - PreCommit-HIVE-Build > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch, HIVE-18916.5.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518691#comment-16518691 ] Hive QA commented on HIVE-18916: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12928401/HIVE-18916.5.patch {color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 14540 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_cores] (batchId=259) org.apache.hive.jdbc.TestTriggersWorkloadManager.testMultipleTriggers2 (batchId=243) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitions (batchId=243) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitionsMultiInsert (batchId=243) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitionsUnionAll (batchId=243) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedFiles (batchId=243) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomNonExistent (batchId=243) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighBytesRead (batchId=243) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighShuffleBytes (batchId=243) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerVertexRawInputSplitsNoKill (batchId=243) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/11952/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11952/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11952/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 10 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12928401 - PreCommit-HIVE-Build > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch, HIVE-18916.5.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518663#comment-16518663 ] Hive QA commented on HIVE-18916: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 1s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 32s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 30s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m 12s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 10s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 54s{color} | {color:blue} itests/util in master has 55 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 45s{color} | {color:blue} ql in master has 2280 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 29s{color} | {color:blue} spark-client in master has 10 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 42s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 10s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 28s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m 5s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m 5s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 15s{color} | {color:green} The patch util passed checkstyle {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 43s{color} | {color:red} ql: The patch generated 1 new + 14 unchanged - 3 fixed = 15 total (was 17) {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 11s{color} | {color:green} spark-client: The patch generated 0 new + 26 unchanged - 3 fixed = 26 total (was 29) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 6m 33s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 42s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 15s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 35m 44s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-11952/dev-support/hive-personality.sh | | git revision | master / aea5908 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-11952/yetus/diff-checkstyle-ql.txt | | modules | C: itests itests/util ql spark-client U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-11952/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch, HIVE-18916.5.patch > > > If
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517083#comment-16517083 ] Sahil Takiar commented on HIVE-18916: - [~aihuaxu] addressed comments. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch, HIVE-18916.4.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516433#comment-16516433 ] Aihua Xu commented on HIVE-18916: - Got it. Can you take care of checkstyle errors above? One file is missing license header. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515938#comment-16515938 ] Sahil Takiar commented on HIVE-18916: - [~aihuaxu] we actually already do that. There is an {{List}} called {{childErrorLog}} which contains the STDERR. Unfortunately, even the STDERR contains some extraneous information. For example, for the test {{spark_submit_negative_executor_memory.q}} the {{childErrLog}} log is below: {code Run with --help for usage help or --verbose for debug output Error: Executor Memory cores must be a positive number {code} Based on the Spark class {{org.apache.spark.util.CommandLineUtils}} errors should usually start with "Error: " > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511568#comment-16511568 ] Aihua Xu commented on HIVE-18916: - [~stakiar] One thought on how to get the error: Rather than checking the log for "Error", can we separate the STDERR from STDOUT from bin/spark-submit process so when there is an error, we can capture the error from STDERR? Is that possible? > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511191#comment-16511191 ] Sahil Takiar commented on HIVE-18916: - [~aihuaxu] can you take a look. Here is a brief summary of the changes: * {{SparkClientImpl}} has been modified so that if the thread that is monitoring the {{bin/spark-submit}} process detects that {{bin/spark-submit}} fails, it parses the stdout / stderr of {{bin/spark-submit}} and checks for any log lines that contain "Error" and then includes those lines in the exception that gets thrown ** {{SparkClientImpl}} was actually already doing this, but the information wasn't getting propagated all the way to the end user * A few changes to {{RpcServer}} were necessary to make sure the exception thrown by the "Driver" thread gets propagated to the user * A few other minor changes to classes like {{RemoteSparkJobMonitor}}, {{SparkTask}} and the constructor of {{SparkClientImpl}} to prevent double logging of exceptions * Added a few unit tests for this, which required masking a few additional patterns in .q files The motivation for this is that {{bin/spark-submit}} errors out when certain parameters are misconfigured. This allows HoS to propagate these error messages to the end-user, which should improve debuggability. The added .q files are a good example of this. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479722#comment-16479722 ] Hive QA commented on HIVE-18916: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12923934/HIVE-18916.3.patch {color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 14411 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/11034/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11034/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11034/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12923934 - PreCommit-HIVE-Build > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479651#comment-16479651 ] Hive QA commented on HIVE-18916: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 37s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 24s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 43s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 58s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 41s{color} | {color:blue} itests/util in master has 55 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 52s{color} | {color:blue} ql in master has 2320 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 23s{color} | {color:blue} spark-client in master has 15 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 24s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 9s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 2s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 41s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 41s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 41s{color} | {color:red} ql: The patch generated 2 new + 15 unchanged - 2 fixed = 17 total (was 17) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 10s{color} | {color:red} spark-client: The patch generated 2 new + 28 unchanged - 0 fixed = 30 total (was 28) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m 19s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 23s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m 12s{color} | {color:red} The patch generated 1 ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 28m 49s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-11034/dev-support/hive-personality.sh | | git revision | master / 0b6bea8 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-11034/yetus/diff-checkstyle-ql.txt | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-11034/yetus/diff-checkstyle-spark-client.txt | | asflicense | http://104.198.109.242/logs//PreCommit-HIVE-Build-11034/yetus/patch-asflicense-problems.txt | | modules | C: itests itests/util ql spark-client U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-11034/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Assignee: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch, HIVE-18916.2.patch, > HIVE-18916.3.patch > > >
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16457021#comment-16457021 ] Sahil Takiar commented on HIVE-18916: - Did some work on this a while ago, attaching what I have so far. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Priority: Major > Attachments: HIVE-18916.1.WIP.patch > > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396254#comment-16396254 ] Sahil Takiar commented on HIVE-18916: - hmm yeah I'll have to dig out the stack-trace. I can't remember exactly how I triggered this, so let me double check > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Priority: Major > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18916) SparkClientImpl doesn't error out if spark-submit fails
[ https://issues.apache.org/jira/browse/HIVE-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395269#comment-16395269 ] Rui Li commented on HIVE-18916: --- [~stakiar], is this issue easy to reproduce? When the thread monitoring {{spark-submit}} finds it returns non-zero, the thread calls {{rpcServer.cancelClient}} which should ideally cancel the waiting for client to connect. > SparkClientImpl doesn't error out if spark-submit fails > --- > > Key: HIVE-18916 > URL: https://issues.apache.org/jira/browse/HIVE-18916 > Project: Hive > Issue Type: Sub-task > Components: Spark >Reporter: Sahil Takiar >Priority: Major > > If {{spark-submit}} returns a non-zero exit code, {{SparkClientImpl}} will > simply log the exit code, but won't throw an error. Eventually, the > connection timeout will get triggered and an exception like {{Timed out > waiting for client connection}} will be logged, which is pretty misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)