[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193618#comment-14193618 ] Sumit Mohanty commented on SLIDER-584: -- FYI [~ste...@apache.org]. I did not notice any failure in last set of functional test runs. CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191689#comment-14191689 ] Steve Loughran commented on SLIDER-584: --- possible race condition of some sort, at least that is what it looks like. See if this fixes it before I can confirm CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[
https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189953#comment-14189953
]
Steve Loughran commented on SLIDER-584:
---
Test output
{code}
--
Test set: org.apache.slider.funtest.commands.CommandEnvironmentIT
---
Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 34.876 sec
FAILURE! - in org.apache.slider.funtest.commands.CommandEnvironmentIT
testLibdirPython(org.apache.slider.funtest.commands.CommandEnvironmentIT) Time
elapsed: 5.482 sec FAILURE!
Assertion failed:
assert shell.outputContains(lookThisUp)
| | |
| false slider.libdir
0
=/grid/0/hadoopqe/artifacts/fun-tests/slider-0.51.0.2.2.0.0/slider-assembly/target/slider-0.51.0.2.2.0.0-1162-all/slider-0.51.0.2.2.0.0-1162/bin/slider.py
diagnostics --client --verbose
at
org.codehaus.groovy.runtime.InvokerHelper.assertFailed(InvokerHelper.java:398)
at
org.codehaus.groovy.runtime.ScriptBytecodeAdapter.assertFailed(ScriptBytecodeAdapter.java:646)
at
org.apache.slider.funtest.framework.CommandTestBase.assertOutputContains(CommandTestBase.groovy:498)
at
org.apache.slider.funtest.framework.CommandTestBase.assertOutputContains(CommandTestBase.groovy)
at
org.apache.slider.funtest.commands.CommandEnvironmentIT.testLibdirPython(CommandEnvironmentIT.groovy:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
testConfdirPython(org.apache.slider.funtest.commands.CommandEnvironmentIT)
Time elapsed: 5.195 sec FAILURE!
{code}
CommandEnvironmentIT failing on HA cluster - assertion failures
---
Key: SLIDER-584
URL: https://issues.apache.org/jira/browse/SLIDER-584
Project: Slider
Issue Type: Sub-task
Components: test
Affects Versions: Slider 0.60
Environment: HA yarn cluster
Reporter: Steve Loughran
Assignee: Steve Loughran
Fix For: Slider 0.60
The CommandEnvironmentIT test is failing, assertions that slider.confdir and
slider libdir are in stdout are failing
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[
https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189956#comment-14189956
]
Steve Loughran commented on SLIDER-584:
---
output as printed
{code}
/
2014-10-29 22:50:53,301 [main] DEBUG main.ServiceLauncher
(ServiceLauncher.java:serviceMain(622)) - org.apache.slider.Slider
diagnostics --client --verbose
2014-10-29 22:50:53,419 [main] DEBUG utility.LaunchedWorkflowCompositeService
(LaunchedWorkflowCompositeService.java:bindArgs(80)) - Binding 3 Arguments:
2014-10-29 22:50:53,419 [main] DEBUG utility.LaunchedWorkflowCompositeService
(LaunchedWorkflowCompositeService.java:bindArgs(86)) - diagnostics --client
--verbose
2014-10-29 22:50:53,659 [main] DEBUG params.CommonArgs
(CommonArgs.java:validate(241)) - action=diagnostics
2014-10-29 22:50:54,370 [main] DEBUG tools.ConfigHelper
(ConfigHelper.java:loadFromResource(511)) - loaded resources from
file:/grid/0/hadoopqe/artifacts/fun-tests/slider-conf/slider-client.xml
2014-10-29 22:50:56,176 [main] INFO impl.TimelineClientImpl
(TimelineClientImpl.java:serviceInit(284)) - Timeline service address:
http://ip-172-31-45-192.ec2.internal:8188/ws/v1/timeline/
2014-10-29 22:50:56,667 [main] WARN hdfs.DFSClient
(DFSClient.java:init(624)) - dfs.client.test.drop.namenode.response.number is
set to 1, this hacked client will proactively drop responses
2014-10-29 22:50:57,373 [main] WARN shortcircuit.DomainSocketFactory
(DomainSocketFactory.java:init(116)) - The short-circuit local reads feature
cannot be used because libhadoop cannot be loaded.
2014-10-29 22:50:57,557 [main] INFO client.SliderClient
(SliderVersionInfo.java:loadAndPrintVersionInfo(95)) - Slider Core-0.51 Built
against commit# 8f7593d863 on Java 1.7.0_67 by hrt_qa
2014-10-29 22:50:57,558 [main] INFO client.SliderClient
(SliderVersionInfo.java:loadAndPrintVersionInfo(96)) - Compiled against Hadoop
2.6.0
2014-10-29 22:50:57,560 [main] INFO client.SliderClient
(SliderVersionInfo.java:loadAndPrintVersionInfo(98)) - Hadoop runtime version
(no branch) with source checksum 5910844e41d553e4b21e14c3cc68c84 and build date
2014-10-29T03:38Z
The slider command path:
/grid/0/hadoopqe/artifacts/fun-tests/slider-0.51/slider-assembly/target/slider-0.51-all/slider-0.51/lib/slider-core-0.51.jar
The slider-client.xml used by current running command path:
file:/grid/0/hadoopqe/artifacts/fun-tests/slider-conf/slider-client.xml
The version of the JDK invoking the current running slider command: 1.7.0_67;
The path to it is: /usr/jdk64/jdk1.7.0_67/jre
Hadoop Cluster is insecure
Environment variables:
CVS_RSH=ssh
G_BROKEN_FILENAMES=1
HADOOP_CONF_DIR=/etc/hadoop/conf
HISTSIZE=1000
HOME=/home/hrt_qa
HOSTNAME=ip-172-31-45-190
JAVA_HOME=/usr/hadoop-jdk1.6.0_31
JAVA_OPTS= -Duser.timezone=UTC
LANG=en_US.UTF-8
LESSOPEN=|/usr/bin/lesspipe.sh %s
LOGNAME=hrt_qa
M2_HOME=/grid/0/hadoopqe/tools/apache-maven-3.0.4
MAIL=/var/spool/mail/root
NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat
PATH=/sbin:/bin:/usr/sbin:/usr/bin
PWD=/grid/0/hadoopqe/artifacts/fun-tests/slider-0.51/slider-funtest
PYTHONPATH=:/usr/lib/python2.6/site-packages
QTDIR=/usr/lib64/qt-3.3
SHELL=/bin/bash
SHLVL=4
SLIDER_CONF_DIR=/grid/0/hadoopqe/artifacts/fun-tests/slider-conf
SLIDER_JVM_OPTS=-DtestpropertySetInFuntest=TestPropertyValue
SUDO_COMMAND=/bin/su hrt_qa
SUDO_GID=0
SUDO_UID=0
SUDO_USER=root
TERM=xterm-256color
USER=hrt_qa
USERNAME=root
XFILESEARCHPATH=/usr/dt/app-defaults/%L/Dt
_=/grid/0/hadoopqe/artifacts/fun-tests/slider-0.51/slider-assembly/target/slider-0.51-all/slider-0.51/bin/slider.py
JVM Properties
awt.toolkit=sun.awt.X11.XToolkit
file.encoding=UTF-8
file.encoding.pkg=sun.io
file.separator=/
java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
java.awt.printerjob=sun.print.PSPrinterJob
/stdout
]]/system-out
{code}
CommandEnvironmentIT failing on HA cluster - assertion failures
---
Key: SLIDER-584
URL: https://issues.apache.org/jira/browse/SLIDER-584
Project: Slider
Issue Type: Sub-task
Components: test
Affects Versions: Slider 0.60
Environment: HA yarn cluster
Reporter: Steve Loughran
Assignee: Steve Loughran
Fix For: Slider 0.60
The CommandEnvironmentIT test is failing, assertions that slider.confdir and
slider libdir are in stdout are failing
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[
https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189957#comment-14189957
]
Steve Loughran commented on SLIDER-584:
---
Notable that stdout stops early —more specifically it stops before
{{java.class.path}} is output.
Maybe the string is too long for the groovy readline logic to handle
CommandEnvironmentIT failing on HA cluster - assertion failures
---
Key: SLIDER-584
URL: https://issues.apache.org/jira/browse/SLIDER-584
Project: Slider
Issue Type: Sub-task
Components: test
Affects Versions: Slider 0.60
Environment: HA yarn cluster
Reporter: Steve Loughran
Assignee: Steve Loughran
Fix For: Slider 0.60
The CommandEnvironmentIT test is failing, assertions that slider.confdir and
slider libdir are in stdout are failing
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1419#comment-1419 ] ASF subversion and git services commented on SLIDER-584: Commit 035dbe7fec92baf97f97b45038f0882ff3306a44 in incubator-slider's branch refs/heads/feature/SLIDER-584_CommandEnvironmentIT from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=035dbe7 ] SLIDER-584 ensure that all of stdout/stderr gets through the test run CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190036#comment-14190036 ] ASF subversion and git services commented on SLIDER-584: Commit 514d87e6d2592efb7b8d0bbf869e0d0085015def in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=514d87e ] Merge branch 'feature/SLIDER-584_CommandEnvironmentIT' into develop CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190035#comment-14190035 ] ASF subversion and git services commented on SLIDER-584: Commit 2826027e260b9d278769eb22a87d37238eb4419a in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=2826027 ] SLIDER-584 flush output after every line and at the end of the run CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190040#comment-14190040 ] Steve Loughran commented on SLIDER-584: --- changed how python code prints output and has a teardown phase to stream through all final bytes from the spawned process. Also cleanly split stderr and stdout output into the respective channels. Manually tested on windows as well as manual + CommandEnvironmentIT on unix to verify processes complete, print their output CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190091#comment-14190091 ] ASF subversion and git services commented on SLIDER-584: Commit 2826027e260b9d278769eb22a87d37238eb4419a in incubator-slider's branch refs/heads/feature/SLIDER-584_CommandEnvironmentIT from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=2826027 ] SLIDER-584 flush output after every line and at the end of the run CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190092#comment-14190092 ] ASF subversion and git services commented on SLIDER-584: Commit 05cf898288af14da01a0481c2ad5d69c6fcb19dd in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=05cf898 ] SLIDER-584 and convert to utf8 before printing CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190676#comment-14190676 ] Gour Saha commented on SLIDER-584: -- Just wondering why they passed in non-HA. Does HA dump more text to stdout? CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (SLIDER-584) CommandEnvironmentIT failing on HA cluster - assertion failures
[ https://issues.apache.org/jira/browse/SLIDER-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190748#comment-14190748 ] ASF subversion and git services commented on SLIDER-584: Commit e7713527ea61c9da7ce2d20cee431abfe2288989 in incubator-slider's branch refs/heads/develop from [~ste...@apache.org] [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=e771352 ] SLIDER-584 don't drop the rest of the line before the closedown loop kicks in CommandEnvironmentIT failing on HA cluster - assertion failures --- Key: SLIDER-584 URL: https://issues.apache.org/jira/browse/SLIDER-584 Project: Slider Issue Type: Sub-task Components: test Affects Versions: Slider 0.60 Environment: HA yarn cluster Reporter: Steve Loughran Assignee: Steve Loughran Fix For: Slider 0.60 The CommandEnvironmentIT test is failing, assertions that slider.confdir and slider libdir are in stdout are failing -- This message was sent by Atlassian JIRA (v6.3.4#6332)
