[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661531#comment-16661531
]
Takanobu Asanuma commented on YARN-8919:
Thanks for the reviews and the commit, [~rkanter] and [~eyang]!
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
> Fix For: 3.3.0
>
> Attachments: YARN-8919.2.patch, YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661280#comment-16661280
]
Hudson commented on YARN-8919:
--
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15296 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/15296/])
YARN-8919. Some tests fail due to NoClassDefFoundError for (rkanter: rev
5e294e950b9d1b6f852f2d3467a9809a82f9860e)
* (edit) hadoop-tools/hadoop-extras/pom.xml
* (edit) hadoop-tools/hadoop-gridmix/pom.xml
* (edit) hadoop-tools/hadoop-streaming/pom.xml
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
> Fix For: 3.3.0
>
> Attachments: YARN-8919.2.patch, YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661244#comment-16661244
]
Robert Kanter commented on YARN-8919:
-
Given how complicated our dependencies are, I'd be concerned about removing any
hadoop-* dependency from another hadoop-* module.
Committed to trunk! Thanks [~tasanuma0829] for the patch and [~eyang] for the
discussion.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
> Fix For: 3.3.0
>
> Attachments: YARN-8919.2.patch, YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661004#comment-16661004
]
Eric Yang commented on YARN-8919:
-
[~rkanter] I am +0 on this patch because the dependencies are unnecessary.
There is another approach by removing hadoop-yarn-server-web-proxy dependency
from hadoop-mapreduce-client-app. The test cases can pass without initializing
any of the server components or bouncy castle class files. I think this fix is
more precise solution.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.2.patch, YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16660945#comment-16660945
]
Robert Kanter commented on YARN-8919:
-
+1 LGTM
[~eyang], does that look good to you? I think this is the right solution given
that I don't think we want to completely refactor the tests into their own
module, as per [this
page|https://maven.apache.org/plugins/maven-jar-plugin/examples/create-test-jar.html].
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.2.patch, YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659927#comment-16659927
]
Hadoop QA commented on YARN-8919:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
16s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
26s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 21m
32s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
59s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
24s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
37m 42s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
56s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
12s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
4s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 58s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
5s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 6m
48s{color} | {color:green} hadoop-streaming in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 15m
49s{color} | {color:green} hadoop-gridmix in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 1m
6s{color} | {color:green} hadoop-extras in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
37s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 83m 55s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:4b8c2b1 |
| JIRA Issue | YARN-8919 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12945126/YARN-8919.2.patch |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient xml |
| uname | Linux cabd9c4e08e0 3.13.0-143-generic #192-Ubuntu SMP Tue Feb 27
10:45:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / e3cca12 |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_181 |
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/22294/testReport/ |
| Max. process+thread count | 972 (vs. ulimit of 1) |
| modules | C: hadoop-tools/hadoop-streaming hadoop-tools/hadoop-gridmix
hadoop-tools/hadoop-extras U: hadoop-tools |
| Console output |
https://builds.apa
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659872#comment-16659872
]
Takanobu Asanuma commented on YARN-8919:
Thanks [~rkanter] and [~eyang] for the discussion and the investigation.
Uploaded the 2nd patch.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.2.patch, YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659750#comment-16659750
]
Robert Kanter commented on YARN-8919:
-
The MR client is decoupled from the web-proxy server, in a deployment. The
problem is only during unit testing, where the MR client code wants to run
{{MiniMRCluster}}, (which uses {{MiniYarnCluster)}}, which requires all of the
server modules (and their dependencies) in order to run the RM, NM, etc.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659638#comment-16659638
]
Eric Yang commented on YARN-8919:
-
[~rkanter] Thank you for the explanation. I don't disagree with current
approach to band-aid the problem if this is the last resort. However, I wonder
if there is a way to decouple mapreduce client from server component web-proxy
to make cleaner separation between client and server?
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659370#comment-16659370
]
Robert Kanter commented on YARN-8919:
-
It does look like we should add both bouncycastle dependencies though. I tried
modifying the code to not use the {{OperatorCreationException}} to see if that
would help, but then it fails because it can't find some classes in the other
bouncycastle dependency. I'm guessing one must pull in the other, but it's
best to declare direct dependencies.
[~tasanuma0829], can you update the patch to also add {{bcprov-jdk15on}} as a
test dependency to those poms?
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659334#comment-16659334
]
Robert Kanter commented on YARN-8919:
-
It looks like what [~tasanuma0829] did is the right approach (unless we go and
do a lot of refactoring). According to [this
page|https://maven.apache.org/plugins/maven-jar-plugin/examples/create-test-jar.html],
if you use the maven-jar-plugin to create a test-jar, which we do for
hadoop-mapreduce-client-jobclient, then:
{quote}Note: The downside of this solution is that you don't get the transitive
test-scoped dependencies automatically. Maven only resolves the compile-time
dependencies, so you'll have to add all the other required test-scoped
dependencies by hand.{quote}
The alternative is to create a completely separate module.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659258#comment-16659258
]
Robert Kanter commented on YARN-8919:
-
[~eyang], I just tried that and it unfortunately doesn't seem to fix it. I'll
keep looking into it.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659118#comment-16659118
]
Eric Yang commented on YARN-8919:
-
[~rkanter] Hadoop-extras, hadoop-gridmix, and hadoop-streaming projects maven
pom.xml declares hadoop-mapreduce-client-jobclient jar file as provided. This
prevents the bouncy castle jar files to be brought into the projects because
the projects assume mapreduce-client-jobclient is provided.
hadoop-mapreduce-client-jobclient probably should be marked as test to bring in
bouncy castle dependencies. Thoughts?
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658574#comment-16658574
]
Hadoop QA commented on YARN-8919:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
19s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
28s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 19m
20s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
54s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
24s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
35m 36s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
58s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
12s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 51s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 5m
48s{color} | {color:green} hadoop-streaming in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 14m
26s{color} | {color:green} hadoop-gridmix in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
54s{color} | {color:green} hadoop-extras in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
28s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 77m 41s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:4b8c2b1 |
| JIRA Issue | YARN-8919 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12944763/YARN-8919.WIP.1.patch
|
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient xml |
| uname | Linux 67dbf44fb747 3.13.0-144-generic #193-Ubuntu SMP Thu Mar 15
17:03:53 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / a043dfa |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_181 |
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/22273/testReport/ |
| Max. process+thread count | 989 (vs. ulimit of 1) |
| modules | C: hadoop-tools/hadoop-streaming hadoop-tools/hadoop-gridmix
hadoop-tools/hadoop-extras U: hadoop-tools |
| Console output |
https://build
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658509#comment-16658509
]
Robert Kanter commented on YARN-8919:
-
Thanks [~tasanuma0829] for the patch. It seems fine to me, though it does seem
odd that we only need to add {{bcpkix-jdk15on}} and not also
{{bcprov-jdk15on}}. I've clicked "Submit Patch" so jenkins can run it.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658458#comment-16658458
]
Takanobu Asanuma commented on YARN-8919:
Hi [~rkanter] and [~eyang], could you please check it?
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
> See:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/931/#showFailuresLink
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657127#comment-16657127
]
Takanobu Asanuma commented on YARN-8919:
Uploaded the wip patch. It seems fix the tests in local though I'm not sure if
it is the right solution.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: YARN-8919.WIP.1.patch
>
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException
[
https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657104#comment-16657104
]
Takanobu Asanuma commented on YARN-8919:
They don't depend on hadoop-minicluster so YARN-8899 didn't fix the regressions.
> Some tests fail due to NoClassDefFoundError for OperatorCreationException
> -
>
> Key: YARN-8919
> URL: https://issues.apache.org/jira/browse/YARN-8919
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Priority: Critical
>
> These tests still fail due to {{NoClassDefFoundError:
> org/bouncycastle/operator/OperatorCreationException}}.
> {noformat}
> hadoop.streaming.TestFileArgs
> hadoop.streaming.TestMultipleCachefiles
> hadoop.streaming.TestStreamingBadRecords
> hadoop.streaming.TestSymLink
> hadoop.streaming.TestMultipleArchiveFiles
> hadoop.mapred.gridmix.TestGridmixSubmission
> hadoop.mapred.gridmix.TestDistCacheEmulation
> hadoop.mapred.gridmix.TestLoadJob
> hadoop.mapred.gridmix.TestSleepJob
> hadoop.tools.TestDistCh
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
