[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=746042&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746042 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 22/Mar/22 19:01 Start Date: 22/Mar/22 19:01 Worklog Time Spent: 10m Work Description: steveloughran commented on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1075521131 ok, merged in to branch-3.3 and trunk. thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 746042) Time Spent: 1.5h (was: 1h 20m) > `org.wildfly.openssl` should not be shaded by Hadoop build > -- > > Key: HADOOP-18160 > URL: https://issues.apache.org/jira/browse/HADOOP-18160 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.3.1 > Environment: hadoop 3.3.1 > spark 3.2.1 > JDK8 >Reporter: André F. >Assignee: André F. >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.3 > > Time Spent: 1.5h > Remaining Estimate: 0h > > `org.wildfly.openssl` is a runtime library and its references are being > shaded on Hadoop, breaking the integration with other frameworks like Spark, > whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error > produced in this situation is: > {code:java} > Suppressed: java.lang.NoClassDefFoundError: > org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider{code} > Whenever it tries to be instantiated from the `DelegatingSSLSocketFactory`. > Spark tries to add it to its classpath without the shade, thus creating this > issue. > Dependencies which are not on "compile" scope should probably not be shaded > to avoid this kind of integration issues. > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=746044&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746044 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 22/Mar/22 19:01 Start Date: 22/Mar/22 19:01 Worklog Time Spent: 10m Work Description: hadoop-yetus removed a comment on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069297089 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 746044) Time Spent: 1h 40m (was: 1.5h) > `org.wildfly.openssl` should not be shaded by Hadoop build > -- > > Key: HADOOP-18160 > URL: https://issues.apache.org/jira/browse/HADOOP-18160 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.3.1 > Environment: hadoop 3.3.1 > spark 3.2.1 > JDK8 >Reporter: André F. >Assignee: André F. >Priority: Minor > Labels: pull-request-available > Fix For: 3.3.3 > > Time Spent: 1h 40m > Remaining Estimate: 0h > > `org.wildfly.openssl` is a runtime library and its references are being > shaded on Hadoop, breaking the integration with other frameworks like Spark, > whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error > produced in this situation is: > {code:java} > Suppressed: java.lang.NoClassDefFoundError: > org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider{code} > Whenever it tries to be instantiated from the `DelegatingSSLSocketFactory`. > Spark tries to add it to its classpath without the shade, thus creating this > issue. > Dependencies which are not on "compile" scope should probably not be shaded > to avoid this kind of integration issues. > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=745961&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745961 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 22/Mar/22 17:32 Start Date: 22/Mar/22 17:32 Worklog Time Spent: 10m Work Description: steveloughran merged pull request #4074: URL: https://github.com/apache/hadoop/pull/4074 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 745961) Time Spent: 1h 20m (was: 1h 10m) > `org.wildfly.openssl` should not be shaded by Hadoop build > -- > > Key: HADOOP-18160 > URL: https://issues.apache.org/jira/browse/HADOOP-18160 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.3.1 > Environment: hadoop 3.3.1 > spark 3.2.1 > JDK8 >Reporter: André F. >Priority: Minor > Labels: pull-request-available > Time Spent: 1h 20m > Remaining Estimate: 0h > > `org.wildfly.openssl` is a runtime library and its references are being > shaded on Hadoop, breaking the integration with other frameworks like Spark, > whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error > produced in this situation is: > {code:java} > Suppressed: java.lang.NoClassDefFoundError: > org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider{code} > Whenever it tries to be instantiated from the `DelegatingSSLSocketFactory`. > Spark tries to add it to its classpath without the shade, thus creating this > issue. > Dependencies which are not on "compile" scope should probably not be shaded > to avoid this kind of integration issues. > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=745949&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745949 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 22/Mar/22 17:12 Start Date: 22/Mar/22 17:12 Worklog Time Spent: 10m Work Description: hadoop-yetus removed a comment on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069468112 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexec | 17m 34s | | Docker mode activated. | _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. | | +0 :ok: | codespell | 0m 0s | | codespell was not available. | | +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. | | -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | _ trunk Compile Tests _ | | +1 :green_heart: | mvninstall | 37m 9s | | trunk passed | | +1 :green_heart: | compile | 0m 18s | | trunk passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | compile | 0m 18s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | mvnsite | 0m 22s | | trunk passed | | +1 :green_heart: | javadoc | 0m 19s | | trunk passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javadoc | 0m 19s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | shadedclient | 61m 45s | | branch has no errors when building and testing our client artifacts. | _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 12s | | the patch passed | | +1 :green_heart: | compile | 0m 12s | | the patch passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javac | 0m 12s | | the patch passed | | +1 :green_heart: | compile | 0m 12s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | javac | 0m 12s | | the patch passed | | +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. | | +1 :green_heart: | mvnsite | 0m 14s | | the patch passed | | +1 :green_heart: | xml | 0m 1s | | The patch has no ill-formed XML file. | | +1 :green_heart: | javadoc | 0m 12s | | the patch passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javadoc | 0m 12s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | shadedclient | 23m 36s | | patch has no errors when building and testing our client artifacts. | _ Other Tests _ | | +1 :green_heart: | unit | 0m 15s | | hadoop-client-api in the patch passed. | | +1 :green_heart: | asflicense | 0m 29s | | The patch does not generate ASF License warnings. | | | | 109m 5s | | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/4074 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell xml | | uname | Linux 629688fc11e8 4.15.0-163-generic #171-Ubuntu SMP Fri Nov 5 11:55:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/bin/hadoop.sh | | git revision | trunk / 427a93ab844fa863e25f1893b105af9ee2c3cbfb | | Default Java | Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/2/testReport/ | | Max. process+thread count | 519 (vs. ulimit of 5500) | | modules | C: hadoop-client-modules/hadoop-client-api U: hadoop-client-modules/hadoop-client-api | | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/2/console | | versions | git=2.25.1 maven=3.6.3 | | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org | This message was automatically generated. -- This is an aut
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=745700&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745700 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 22/Mar/22 10:28 Start Date: 22/Mar/22 10:28 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1074997394 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexec | 1m 8s | | Docker mode activated. | _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. | | +0 :ok: | codespell | 0m 0s | | codespell was not available. | | +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. | | -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | _ trunk Compile Tests _ | | +1 :green_heart: | mvninstall | 36m 47s | | trunk passed | | +1 :green_heart: | compile | 0m 18s | | trunk passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | compile | 0m 18s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | mvnsite | 0m 22s | | trunk passed | | +1 :green_heart: | javadoc | 0m 20s | | trunk passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javadoc | 0m 19s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | shadedclient | 60m 55s | | branch has no errors when building and testing our client artifacts. | _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 16s | | the patch passed | | +1 :green_heart: | compile | 0m 12s | | the patch passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javac | 0m 12s | | the patch passed | | +1 :green_heart: | compile | 0m 12s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | javac | 0m 12s | | the patch passed | | +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. | | +1 :green_heart: | mvnsite | 0m 15s | | the patch passed | | +1 :green_heart: | xml | 0m 1s | | The patch has no ill-formed XML file. | | +1 :green_heart: | javadoc | 0m 12s | | the patch passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javadoc | 0m 13s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | shadedclient | 23m 8s | | patch has no errors when building and testing our client artifacts. | _ Other Tests _ | | +1 :green_heart: | unit | 0m 15s | | hadoop-client-api in the patch passed. | | +1 :green_heart: | asflicense | 0m 31s | | The patch does not generate ASF License warnings. | | | | 91m 22s | | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/3/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/4074 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell xml | | uname | Linux 4d1ed5004657 4.15.0-166-generic #174-Ubuntu SMP Wed Dec 8 19:07:44 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/bin/hadoop.sh | | git revision | trunk / 37f4364c44106f95854e8acc2af99382d2acb89c | | Default Java | Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/3/testReport/ | | Max. process+thread count | 521 (vs. ulimit of 5500) | | modules | C: hadoop-client-modules/hadoop-client-api U: hadoop-client-modules/hadoop-client-api | | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/3/console | | versions | git=2.25.1 maven=3.6.3 | | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org | This message was automatically generated. -- This is an automated m
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=745366&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745366 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 21/Mar/22 18:52 Start Date: 21/Mar/22 18:52 Worklog Time Spent: 10m Work Description: steveloughran commented on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1074288070 raised on the list...if nobody objects i will merge (remind me if I don't) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 745366) Time Spent: 50m (was: 40m) > `org.wildfly.openssl` should not be shaded by Hadoop build > -- > > Key: HADOOP-18160 > URL: https://issues.apache.org/jira/browse/HADOOP-18160 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.3.1 > Environment: hadoop 3.3.1 > spark 3.2.1 > JDK8 >Reporter: André F. >Priority: Minor > Labels: pull-request-available > Time Spent: 50m > Remaining Estimate: 0h > > `org.wildfly.openssl` is a runtime library and its references are being > shaded on Hadoop, breaking the integration with other frameworks like Spark, > whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error > produced in this situation is: > {code:java} > Suppressed: java.lang.NoClassDefFoundError: > org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider{code} > Whenever it tries to be instantiated from the `DelegatingSSLSocketFactory`. > Spark tries to add it to its classpath without the shade, thus creating this > issue. > Dependencies which are not on "compile" scope should probably not be shaded > to avoid this kind of integration issues. > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=742680&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742680 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 16/Mar/22 18:52 Start Date: 16/Mar/22 18:52 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069468112 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexec | 17m 34s | | Docker mode activated. | _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. | | +0 :ok: | codespell | 0m 0s | | codespell was not available. | | +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. | | -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | _ trunk Compile Tests _ | | +1 :green_heart: | mvninstall | 37m 9s | | trunk passed | | +1 :green_heart: | compile | 0m 18s | | trunk passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | compile | 0m 18s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | mvnsite | 0m 22s | | trunk passed | | +1 :green_heart: | javadoc | 0m 19s | | trunk passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javadoc | 0m 19s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | shadedclient | 61m 45s | | branch has no errors when building and testing our client artifacts. | _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 12s | | the patch passed | | +1 :green_heart: | compile | 0m 12s | | the patch passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javac | 0m 12s | | the patch passed | | +1 :green_heart: | compile | 0m 12s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | javac | 0m 12s | | the patch passed | | +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. | | +1 :green_heart: | mvnsite | 0m 14s | | the patch passed | | +1 :green_heart: | xml | 0m 1s | | The patch has no ill-formed XML file. | | +1 :green_heart: | javadoc | 0m 12s | | the patch passed with JDK Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 | | +1 :green_heart: | javadoc | 0m 12s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | shadedclient | 23m 36s | | patch has no errors when building and testing our client artifacts. | _ Other Tests _ | | +1 :green_heart: | unit | 0m 15s | | hadoop-client-api in the patch passed. | | +1 :green_heart: | asflicense | 0m 29s | | The patch does not generate ASF License warnings. | | | | 109m 5s | | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/4074 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell xml | | uname | Linux 629688fc11e8 4.15.0-163-generic #171-Ubuntu SMP Fri Nov 5 11:55:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/bin/hadoop.sh | | git revision | trunk / 427a93ab844fa863e25f1893b105af9ee2c3cbfb | | Default Java | Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.14+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/2/testReport/ | | Max. process+thread count | 519 (vs. ulimit of 5500) | | modules | C: hadoop-client-modules/hadoop-client-api U: hadoop-client-modules/hadoop-client-api | | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/2/console | | versions | git=2.25.1 maven=3.6.3 | | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org | This message was automatically generated. -- This is an automated m
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=742614&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742614 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 16/Mar/22 18:34 Start Date: 16/Mar/22 18:34 Worklog Time Spent: 10m Work Description: steveloughran commented on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069391316 thanks. will have to raise this with on the hadoop common list to discuss what to do here. i don't see any uses of the library other than hadoop azure and hadoop aws, so there isn't much else to worry about -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 742614) Time Spent: 0.5h (was: 20m) > `org.wildfly.openssl` should not be shaded by Hadoop build > -- > > Key: HADOOP-18160 > URL: https://issues.apache.org/jira/browse/HADOOP-18160 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.3.1 > Environment: hadoop 3.3.1 > spark 3.2.1 > JDK8 >Reporter: André F. >Priority: Minor > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > `org.wildfly.openssl` is a runtime library and its references are being > shaded on Hadoop, breaking the integration with other frameworks like Spark, > whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error > produced in this situation is: > {code:java} > Suppressed: java.lang.NoClassDefFoundError: > org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider{code} > Whenever it tries to be instantiated from the `DelegatingSSLSocketFactory`. > Spark tries to add it to its classpath without the shade, thus creating this > issue. > Dependencies which are not on "compile" scope should probably not be shaded > to avoid this kind of integration issues. > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=742497&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742497 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 16/Mar/22 16:24 Start Date: 16/Mar/22 16:24 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069297089 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexec | 1m 3s | | Docker mode activated. | _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. | | +0 :ok: | codespell | 0m 1s | | codespell was not available. | | +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. | | -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | _ trunk Compile Tests _ | | +1 :green_heart: | mvninstall | 36m 35s | | trunk passed | | +1 :green_heart: | compile | 0m 17s | | trunk passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 | | +1 :green_heart: | compile | 0m 18s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | mvnsite | 0m 21s | | trunk passed | | +1 :green_heart: | javadoc | 0m 19s | | trunk passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 | | +1 :green_heart: | javadoc | 0m 19s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | shadedclient | 61m 0s | | branch has no errors when building and testing our client artifacts. | _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 13s | | the patch passed | | +1 :green_heart: | compile | 0m 12s | | the patch passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 | | +1 :green_heart: | javac | 0m 12s | | the patch passed | | +1 :green_heart: | compile | 0m 12s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | javac | 0m 12s | | the patch passed | | -1 :x: | blanks | 0m 0s | [/blanks-tabs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/1/artifact/out/blanks-tabs.txt) | The patch 3 line(s) with tabs. | | +1 :green_heart: | mvnsite | 0m 14s | | the patch passed | | +1 :green_heart: | xml | 0m 1s | | The patch has no ill-formed XML file. | | +1 :green_heart: | javadoc | 0m 13s | | the patch passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 | | +1 :green_heart: | javadoc | 0m 12s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | +1 :green_heart: | shadedclient | 23m 21s | | patch has no errors when building and testing our client artifacts. | _ Other Tests _ | | +1 :green_heart: | unit | 0m 15s | | hadoop-client-api in the patch passed. | | +1 :green_heart: | asflicense | 0m 29s | | The patch does not generate ASF License warnings. | | | | 91m 49s | | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/4074 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell xml | | uname | Linux bb485d2cdd46 4.15.0-166-generic #174-Ubuntu SMP Wed Dec 8 19:07:44 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/bin/hadoop.sh | | git revision | trunk / f280f17045cacabef0081d9a1c8cce2263f0892d | | Default Java | Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 | | Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/1/testReport/ | | Max. process+thread count | 602 (vs. ulimit of 5500) | | modules | C: hadoop-client-modules/hadoop-client-api U: hadoop-client-modules/hadoop-client-api | | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4074/1/console | | versions | git=2.25.1 maven=3.6.3 | | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetu
[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=742396&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742396 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot Created on: 16/Mar/22 14:30 Start Date: 16/Mar/22 14:30 Worklog Time Spent: 10m Work Description: andreAmorimF opened a new pull request #4074: URL: https://github.com/apache/hadoop/pull/4074 ### Description of PR `org.wildfly.openssl` is a runtime library and its references are being shaded on Hadoop, breaking the integration with other frameworks like Spark, whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error produced in this situation is: ``` Suppressed: java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider ``` This PR aims to exclude `org.wildfly.openssl` from the shade, keeping the original namespace to be referenced whenever this runtime dependency is added to the classpath. ### How was this patch tested? Used the patched jar on a Spark 3.2.1 application which now correctly references the `org.wildfly.openssl` dependency added to the classpath. ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')? - [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation? - [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)? - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 742396) Remaining Estimate: 0h Time Spent: 10m > `org.wildfly.openssl` should not be shaded by Hadoop build > -- > > Key: HADOOP-18160 > URL: https://issues.apache.org/jira/browse/HADOOP-18160 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.3.1 > Environment: hadoop 3.3.1 > spark 3.2.1 > JDK8 >Reporter: André F. >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > `org.wildfly.openssl` is a runtime library and its references are being > shaded on Hadoop, breaking the integration with other frameworks like Spark, > whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error > produced in this situation is: > {code:java} > Suppressed: java.lang.NoClassDefFoundError: > org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider{code} > Whenever it tries to be instantiated from the `DelegatingSSLSocketFactory`. > Spark tries to add it to its classpath without the shade, thus creating this > issue. > Dependencies which are not on "compile" scope should probably not be shaded > to avoid this kind of integration issues. > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org