[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977797#comment-15977797 ] Siddharth Seth commented on HIVE-15786: --- Thanks for the review. Committed. [~owen.omalley] - I'd like to get this into the 2.2 release as well. It could not be committed earlier because a slider release was not available. > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Critical > Attachments: HIVE-15786.01.patch, HIVE-15786.03.patch, > HIVE-15786.04.patch, HIVE-15786.05.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977694#comment-15977694 ] Prasanth Jayachandran commented on HIVE-15786: -- +1 > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Critical > Attachments: HIVE-15786.01.patch, HIVE-15786.03.patch, > HIVE-15786.04.patch, HIVE-15786.05.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975578#comment-15975578 ] Siddharth Seth commented on HIVE-15786: --- [~prasanth_j] - could you take another look please. THis is the old patch with a fixed dependency version. > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Critical > Attachments: HIVE-15786.01.patch, HIVE-15786.03.patch, > HIVE-15786.04.patch, HIVE-15786.05.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[
https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974303#comment-15974303
]
Hive QA commented on HIVE-15786:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12863955/HIVE-15786.05.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 10581 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr]
(batchId=143)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4754/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4754/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4754/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12863955 - PreCommit-HIVE-Build
> Provide additional information from the llapstatus command
> --
>
> Key: HIVE-15786
> URL: https://issues.apache.org/jira/browse/HIVE-15786
> Project: Hive
> Issue Type: Improvement
>Reporter: Siddharth Seth
>Assignee: Siddharth Seth
>Priority: Critical
> Attachments: HIVE-15786.01.patch, HIVE-15786.03.patch,
> HIVE-15786.04.patch, HIVE-15786.05.patch
>
>
> Slider is making enhancements to provide additional information like
> completed containers, pending containers etc.
> Integrate with this to provide additional details in llapstatus.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941919#comment-15941919 ] Pengcheng Xiong commented on HIVE-15786: I am deferring this to Hive 3.0 as we are going to cut the first RC and it is not marked as blocker. Please feel free to commit to the branch if this can be resolved before the release. > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Critical > Attachments: HIVE-15786.01.patch, HIVE-15786.03.patch, > HIVE-15786.04.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893344#comment-15893344 ] Siddharth Seth commented on HIVE-15786: --- Needs a slider release before it can be committed. > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Critical > Attachments: HIVE-15786.01.patch, HIVE-15786.03.patch, > HIVE-15786.04.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892971#comment-15892971 ] Sergey Shelukhin commented on HIVE-15786: - What's up with this JIRA? > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Critical > Attachments: HIVE-15786.01.patch, HIVE-15786.03.patch, > HIVE-15786.04.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862639#comment-15862639 ] Prasanth Jayachandran commented on HIVE-15786: -- lgtm, +1 > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: HIVE-15786.01.patch, HIVE-15786.03.patch, > HIVE-15786.04.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[
https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862534#comment-15862534
]
Hive QA commented on HIVE-15786:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12852218/HIVE-15786.04.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3506/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3506/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3506/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2017-02-11 21:02:53.853
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-3506/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2017-02-11 21:02:53.856
+ cd apache-github-source-source
+ git fetch origin
>From https://github.com/apache/hive
0959e77..38ad779 master -> origin/master
+ git reset --hard HEAD
HEAD is now at 0959e77 HIVE-15866: LazySimpleDeserializeRead doesn't recognized
lower case 'true' properly (Matt McCline, reviewed by Gunther Hagleitner)
+ git clean -f -d
Removing jdbc-handler/
Removing ql/src/test/queries/clientpositive/jdbc_handler.q
Removing ql/src/test/results/clientpositive/jdbc_handler.q.out
Removing ql/src/test/results/clientpositive/llap/jdbc_handler.q.out
+ git checkout master
Already on 'master'
Your branch is behind 'origin/master' by 2 commits, and can be fast-forwarded.
(use "git pull" to update your local branch)
+ git reset --hard origin/master
HEAD is now at 38ad779 HIVE-15873: Remove Windows-specific code (Gunther
Hagleitner, reviewed by Ashtuosh Chauhan)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2017-02-11 21:02:55.706
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
Going to apply patch with: patch -p0
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapSliderUtils.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapStatusOptionsProcessor.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapStatusServiceDriver.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/status/LlapStatusHelpers.java
patching file llap-server/src/main/resources/llap-cli-log4j2.properties
patching file pom.xml
+ [[ maven == \m\a\v\e\n ]]
+ rm -rf /data/hiveptest/working/maven/org/apache/hive
+ mvn -B clean install -DskipTests -T 4 -q
-Dmaven.repo.local=/data/hiveptest/working/maven
ANTLR Parser Generator Version 3.5.2
Output file
/data/hiveptest/working/apache-github-source-source/metastore/target/generated-sources/antlr3/org/apache/hadoop/hive/metastore/parser/FilterParser.java
does not exist: must build
/data/hiveptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g
org/apache/hadoop/hive/metastore/parser/Filter.g
DataNucleus Enhancer (version 4.1.6) for API "JDO"
DataNucleus Enhancer : Classpath
>> /usr/share/maven/boot/plexus-classworlds-2.x.jar
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MDatabase
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MFieldSchema
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MType
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MTable
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MConstraint
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MSerDeInfo
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MOrder
ENHANCED (Persistable) :
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[
https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861814#comment-15861814
]
Hive QA commented on HIVE-15786:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12852108/HIVE-15786.03.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3495/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3495/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3495/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2017-02-10 20:18:46.223
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-3495/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2017-02-10 20:18:46.226
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at 0959e77 HIVE-15866: LazySimpleDeserializeRead doesn't recognized
lower case 'true' properly (Matt McCline, reviewed by Gunther Hagleitner)
+ git clean -f -d
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at 0959e77 HIVE-15866: LazySimpleDeserializeRead doesn't recognized
lower case 'true' properly (Matt McCline, reviewed by Gunther Hagleitner)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2017-02-10 20:18:47.335
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
Going to apply patch with: patch -p0
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapSliderUtils.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapStatusOptionsProcessor.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapStatusServiceDriver.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/status/LlapStatusHelpers.java
patching file llap-server/src/main/resources/llap-cli-log4j2.properties
patching file pom.xml
+ [[ maven == \m\a\v\e\n ]]
+ rm -rf /data/hiveptest/working/maven/org/apache/hive
+ mvn -B clean install -DskipTests -T 4 -q
-Dmaven.repo.local=/data/hiveptest/working/maven
ANTLR Parser Generator Version 3.5.2
Output file
/data/hiveptest/working/apache-github-source-source/metastore/target/generated-sources/antlr3/org/apache/hadoop/hive/metastore/parser/FilterParser.java
does not exist: must build
/data/hiveptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g
org/apache/hadoop/hive/metastore/parser/Filter.g
DataNucleus Enhancer (version 4.1.6) for API "JDO"
DataNucleus Enhancer : Classpath
>> /usr/share/maven/boot/plexus-classworlds-2.x.jar
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MDatabase
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MFieldSchema
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MType
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MTable
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MConstraint
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MSerDeInfo
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MOrder
ENHANCED (Persistable) :
org.apache.hadoop.hive.metastore.model.MColumnDescriptor
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MStringList
ENHANCED (Persistable) :
org.apache.hadoop.hive.metastore.model.MStorageDescriptor
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MPartition
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MIndex
ENHANCED
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[
https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856611#comment-15856611
]
Prasanth Jayachandran commented on HIVE-15786:
--
The default pattern layout used in llap-cli properties files is
{code}
%p %c{2}: %m%n
{code}
p - log level
c - logger name
m - message
n - line ending
Maybe we can just use %m%n?
We can use this layout for console appender.
If we want different layouts for different loggers, then we need to create 2
appenders with different pattern layouts and use appenderRef in logger to
reference corresponding appenders.
I don't think we need different pattern layouts. Do we?
Also, if it is easy it will be good to print out last few lines/KBs from the
logs, also point to log url for more info. If this is not easy, we can take it
up in a follow up.
> Provide additional information from the llapstatus command
> --
>
> Key: HIVE-15786
> URL: https://issues.apache.org/jira/browse/HIVE-15786
> Project: Hive
> Issue Type: Improvement
>Reporter: Siddharth Seth
>Assignee: Siddharth Seth
> Attachments: HIVE-15786.01.patch
>
>
> Slider is making enhancements to provide additional information like
> completed containers, pending containers etc.
> Integrate with this to provide additional details in llapstatus.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856531#comment-15856531 ] Siddharth Seth commented on HIVE-15786: --- bq. Printing the logger name seems wasteful. LlapStatusServiceDriverConsole in every line. Maybe we should drop the logger name in pattern layout? I tried this. Could not figure out what pattern to use to get rid of the logger name. Ended up with logs going to multiple places, being split across lines etc. Any pointers on what the layout string will be? bq. There are bunch of TODOs, can you please create follow up for tracking. Will do. bq. nit: typo in appCompelte Will fix. bq. Wondering if it would be possible to propagate the exception from application (apart form PMEM, VMEM issues)? Have a request out to Slider to provide such information. I think that will require some time though, since it requires a mechanism for the container to communicate with slider - which does not exist today. Best we can do at the moment is to look at the last few lines in the logs. > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: HIVE-15786.01.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855450#comment-15855450 ] Prasanth Jayachandran commented on HIVE-15786: -- Mostly looks good. - Printing the logger name seems wasteful. LlapStatusServiceDriverConsole in every line. Maybe we should drop the logger name in pattern layout? - There are bunch of TODOs, can you please create follow up for tracking. - nit: typo in appCompelte - Wondering if it would be possible to propagate the exception from application (apart form PMEM, VMEM issues)? > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: HIVE-15786.01.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849287#comment-15849287 ] Siddharth Seth commented on HIVE-15786: --- PreCommit won't work because slider doesn't seem to publish artifacts... also dependence on a snapshot will cause failure. > Provide additional information from the llapstatus command > -- > > Key: HIVE-15786 > URL: https://issues.apache.org/jira/browse/HIVE-15786 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: HIVE-15786.01.patch > > > Slider is making enhancements to provide additional information like > completed containers, pending containers etc. > Integrate with this to provide additional details in llapstatus. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command
[
https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849205#comment-15849205
]
Hive QA commented on HIVE-15786:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12850512/HIVE-15786.01.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3314/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3314/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3314/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2017-02-02 01:01:25.472
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-3314/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2017-02-02 01:01:25.475
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at a67eb03 HIVE-15783 : small glitch in LlapServiceDriver on small
VMs (Sergey Shelukhin, reviewed by Gopal V)
+ git clean -f -d
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at a67eb03 HIVE-15783 : small glitch in LlapServiceDriver on small
VMs (Sergey Shelukhin, reviewed by Gopal V)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2017-02-02 01:01:26.502
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
Going to apply patch with: patch -p0
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapStatusOptionsProcessor.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapStatusServiceDriver.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/SliderUtils.java
patching file
llap-server/src/java/org/apache/hadoop/hive/llap/cli/status/LlapStatusHelpers.java
patching file llap-server/src/main/resources/llap-cli-log4j2.properties
patching file pom.xml
+ [[ maven == \m\a\v\e\n ]]
+ rm -rf /data/hiveptest/working/maven/org/apache/hive
+ mvn -B clean install -DskipTests -T 4 -q
-Dmaven.repo.local=/data/hiveptest/working/maven
ANTLR Parser Generator Version 3.5.2
Output file
/data/hiveptest/working/apache-github-source-source/metastore/target/generated-sources/antlr3/org/apache/hadoop/hive/metastore/parser/FilterParser.java
does not exist: must build
/data/hiveptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g
org/apache/hadoop/hive/metastore/parser/Filter.g
DataNucleus Enhancer (version 4.1.6) for API "JDO"
DataNucleus Enhancer : Classpath
>> /usr/share/maven/boot/plexus-classworlds-2.x.jar
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MDatabase
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MFieldSchema
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MType
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MTable
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MConstraint
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MSerDeInfo
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MOrder
ENHANCED (Persistable) :
org.apache.hadoop.hive.metastore.model.MColumnDescriptor
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MStringList
ENHANCED (Persistable) :
org.apache.hadoop.hive.metastore.model.MStorageDescriptor
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MPartition
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MIndex
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MRole
ENHANCED
