[
https://issues.apache.org/jira/browse/HADOOP-16810?focusedWorklogId=552124&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-552124
]
ASF GitHub Bot logged work on HADOOP-16810:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 13/Feb/21 06:36
Start Date: 13/Feb/21 06:36
Worklog Time Spent: 10m
Work Description: aajisaka commented on pull request #2697:
URL: https://github.com/apache/hadoop/pull/2697#issuecomment-778572201
Let's upgrade Yetus 0.13.0 in the Jenkinsfile instead of yetus-wrapper to
use Yetus 0.13.0 in the pre-commit job.
Note that Yetus 0.13.0 dropped Python 2 support and I want to merge #1738
first.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 552124)
Time Spent: 40m (was: 0.5h)
> Increase entropy to improve cryptographic randomness on precommit Linux VMs
> ---------------------------------------------------------------------------
>
> Key: HADOOP-16810
> URL: https://issues.apache.org/jira/browse/HADOOP-16810
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Ahmed Hussein
> Assignee: Ahmed Hussein
> Priority: Blocker
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> I was investigating a JUnit test (MAPREDUCE-7079
> :TestMRIntermediateDataEncryption is failing in precommit builds) that was
> consistently hanging on Linux VMs and failing Mapreduce pre-builds.
> I found that the test hangs slows or hangs indefinitely whenever Java reads
> the random file.
> I explored two different ways to get that test case to work properly on my
> local Linux VM running rel7:
> # To install "haveged" and "rng-tools" on the virtual machine running Rel7.
> Then, start rngd service {{sudo service rngd start}} . This will fix the
> problem for all the components on the image including java, native and any
> other component.
> # Change java configuration to load urandom
> {code:bash}
> sudo vim $JAVA_HOME/jre/lib/security/java.security
> ## Change the line “securerandom.source=file:/dev/random” to read:
> securerandom.source=file:/dev/./urandom
> {code}
> The first solution is better because this will fix the problem for everything
> that requires SSL/TLS or other services that depend upon encryption.
> Since the precommit build runs on Docker, then it would be best to mount
> {{/dev/urandom}} from the host as {{/dev/random}} into the container:
> {code:java}
> docker run -v /dev/urandom:/dev/random
> {code}
> For Yetus, we need to add the mount to the {{DOCKER_EXTRAARGS}} as follows:
> {code:java}
> DOCKER_EXTRAARGS+=("-v" "/dev/urandom:/dev/random")
> {code}
> ...
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
