[jira] [Commented] (HADOOP-17787) Refactor fetching of credentials in Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394951#comment-17394951 ] Íñigo Goiri commented on HADOOP-17787: -- Thanks [~gautham] for the contribution. The latest PR works fine. Merged PR 3167 to trunk. > Refactor fetching of credentials in Jenkins > --- > > Key: HADOOP-17787 > URL: https://issues.apache.org/jira/browse/HADOOP-17787 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.4.0 >Reporter: Gautham Banasandra >Assignee: Gautham Banasandra >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Attachments: image-2021-07-03-10-47-02-330.png > > Time Spent: 1h 40m > Remaining Estimate: 0h > > Need to refactor fetching of credentials in Jenkinsfile. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17787) Refactor fetching of credentials in Jenkins
[
https://issues.apache.org/jira/browse/HADOOP-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17374212#comment-17374212
]
Ayush Saxena commented on HADOOP-17787:
---
It is executing this command:
{noformat}
/bin/bash ${TESTPATCHBIN} "${YETUS_ARGS[@]}"
+ /bin/bash
/home/jenkins/jenkins-agent/workspace/PreCommit-HDFS-Build/yetus/precommit/src/main/shell/test-patch.sh
--archive-list=checkstyle-errors.xml,spotbugsXml.xml
--basedir=/home/jenkins/je:
nkins-agent/workspace/PreCommit-HDFS-Build/sourcedir
--brief-report-file=/home/jenkins/jenkins-agent/workspace/PreCommit-HDFS-Build/out/email-report.txt
--build-url-artifacts=artifact/out
--console-report-file=/home/jenkins/jenkins-agent/workspace/PreCommit-HDFS-Build/out/console-report.txt
--console-urls --docker
--dockerfile=/home/jenkins/jenkins-agent/workspace/PreCommit-HDFS-Build/sourcedir/dev-support/docker/Dockerfile
--dockermemlimit=20g --spotbugs-strict-precheck
--html-report-file=/home/jenkins/jenkins-agent/workspace/PreCommit-HDFS-Build/out/console-report.html
--java-home=/usr/lib/jvm/java-8-openjdk-amd64 --jira-password=
--jira-user=
--multijdkdirs=/usr/lib/jvm/zulu-7-amd64,/usr/lib/jvm/java-11-openjdk-amd64
--multijdktests=compile --mvn-custom-repos
--patch-dir=/home/jenkins/jenkins-agent/workspace/PreCommit-HDFS-Build/out
--personality=/home/jenkins/jenkins-agent/workspace/PreCommit-HDFS-Build/sourcedir/dev-support/bin/hadoop.sh
--project=hadoop --proclimit=5500 --reapermode=kill --resetrepo --robot
--sentinel
--shelldocs=/home/jenkins/jenkins-agent/workspace/PreCommit-HDFS-Build/sourcedir/dev-support/bin/shelldocs
--tests-filter=checkstyle,pylint,shelldocs
--mvn-javadoc-goals=process-sources,javadoc:javadoc-no-fork HDFS-16101{noformat}
Then there is:
{noformat}
WARNING: Working around Jenkins branch information
>From https://gitbox.apache.org/repos/asf/hadoop
= [up to date] HADOOP-10388 -> origin/HADOOP-10388
= [up to date] HADOOP-11671 -> origin/HADOOP-11671
= [up to date] HADOOP-11890 -> origin/HADOOP-11890
.
{noformat}
Then finally:
{noformat}
Modes: Jenkins MultiJDK Sentinel Robot Docker ResetRepo UnitTests
Processing: HDFS-16101
ERROR: Unsure how to process HDFS-16101.
{noformat}
Is there something changed that it is expecting a branch instead of downloading
the patch. or some yetus argument is being passed wrong to the script.
[~aajisaka] do you have any pointers, or atleast who might help us here
> Refactor fetching of credentials in Jenkins
> ---
>
> Key: HADOOP-17787
> URL: https://issues.apache.org/jira/browse/HADOOP-17787
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
>Affects Versions: 3.4.0
>Reporter: Gautham Banasandra
>Assignee: Gautham Banasandra
>Priority: Major
> Labels: pull-request-available
> Attachments: image-2021-07-03-10-47-02-330.png
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Need to refactor fetching of credentials in Jenkinsfile.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17787) Refactor fetching of credentials in Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17374209#comment-17374209 ] Ayush Saxena commented on HADOOP-17787: --- Any pointers what broke it? It can not be like it randomly stopped working. It could be either us or something on Infra end. Do let me know if everyone thinks, it is nothing we can do here or not something in the code. Can ask the Infra guys to take a look once, but I am pretty sure it is not on them. The first exception it started giving was hadoop.sh file not being found, which I corrected in HDFS precommit post that it is just a warning related to findbugs and spotbugs and some weird stuff . Which I don’t understand > Refactor fetching of credentials in Jenkins > --- > > Key: HADOOP-17787 > URL: https://issues.apache.org/jira/browse/HADOOP-17787 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.4.0 >Reporter: Gautham Banasandra >Assignee: Gautham Banasandra >Priority: Major > Labels: pull-request-available > Attachments: image-2021-07-03-10-47-02-330.png > > Time Spent: 50m > Remaining Estimate: 0h > > Need to refactor fetching of credentials in Jenkinsfile. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17787) Refactor fetching of credentials in Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17374208#comment-17374208 ] Gautham Banasandra commented on HADOOP-17787: - Ok. Thanks [~aajisaka]. Since the Jenkinsfile isn't used for the precommit jobs at all, then reverting my PRs won't help. > Refactor fetching of credentials in Jenkins > --- > > Key: HADOOP-17787 > URL: https://issues.apache.org/jira/browse/HADOOP-17787 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.4.0 >Reporter: Gautham Banasandra >Assignee: Gautham Banasandra >Priority: Major > Labels: pull-request-available > Attachments: image-2021-07-03-10-47-02-330.png > > Time Spent: 50m > Remaining Estimate: 0h > > Need to refactor fetching of credentials in Jenkinsfile. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17787) Refactor fetching of credentials in Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17374129#comment-17374129 ] Akira Ajisaka commented on HADOOP-17787: I'm not sure HADOOP-17778 broke the build because the Jenkinsfile is not actually used in the PreCommit-(HADOOP|HDFS|MAPREDUCE|YARN)-Build jobs. Now I want to disable the precommit jobs on JIRA and move to GitHub because we cannot differently configure the jobs per branch. > Refactor fetching of credentials in Jenkins > --- > > Key: HADOOP-17787 > URL: https://issues.apache.org/jira/browse/HADOOP-17787 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.4.0 >Reporter: Gautham Banasandra >Assignee: Gautham Banasandra >Priority: Major > Labels: pull-request-available > Attachments: image-2021-07-03-10-47-02-330.png > > Time Spent: 50m > Remaining Estimate: 0h > > Need to refactor fetching of credentials in Jenkinsfile. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17787) Refactor fetching of credentials in Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373905#comment-17373905 ] Gautham Banasandra commented on HADOOP-17787: - Hi [~ayushtkn], [~elgoiri], Thanks for bringing to my notice. Sorry for the inconvenience. I'll need some time to fix this. So, let's revert for now. It seems like these issues started happening when I created my PR "CI for Centos 8" and that the build artifacts were getting created fine for the PR before that. Build artifacts after my PR - https://ci-hadoop.apache.org/view/Hadoop/job/PreCommit-HDFS-Build/651/ Build artifacts before my PR - https://ci-hadoop.apache.org/view/Hadoop/job/PreCommit-YARN-Build/1084/ I've created a PR to revert my change. Please review and merge it - https://github.com/apache/hadoop/pull/3173. > Refactor fetching of credentials in Jenkins > --- > > Key: HADOOP-17787 > URL: https://issues.apache.org/jira/browse/HADOOP-17787 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.4.0 >Reporter: Gautham Banasandra >Assignee: Gautham Banasandra >Priority: Major > Labels: pull-request-available > Attachments: image-2021-07-03-10-47-02-330.png > > Time Spent: 0.5h > Remaining Estimate: 0h > > Need to refactor fetching of credentials in Jenkinsfile. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17787) Refactor fetching of credentials in Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373751#comment-17373751 ] Íñigo Goiri commented on HADOOP-17787: -- Thanks for bringing this up, yes, something is broken with the Docker setup. [~gautham] can you take a look? We should revert the CI changes if we cannot fix it quickly. > Refactor fetching of credentials in Jenkins > --- > > Key: HADOOP-17787 > URL: https://issues.apache.org/jira/browse/HADOOP-17787 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.4.0 >Reporter: Gautham Banasandra >Assignee: Gautham Banasandra >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > Need to refactor fetching of credentials in Jenkinsfile. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17787) Refactor fetching of credentials in Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373270#comment-17373270 ] Ayush Saxena commented on HADOOP-17787: --- [~gautham]/[~elgoiri] I see there are bunch of changes around the CI files by you folks, Any pointers is there anything which can break building of patches? The Precommits doesn't seems to work https://ci-hadoop.apache.org/view/Hadoop/job/PreCommit-YARN-Build/1085/ [https://ci-hadoop.apache.org/view/Hadoop/job/PreCommit-HDFS-Build/652/] I have started trying to fix the hdfs one, no luck as of now, do let me know, if you guys are aware of anything of that sort. > Refactor fetching of credentials in Jenkins > --- > > Key: HADOOP-17787 > URL: https://issues.apache.org/jira/browse/HADOOP-17787 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.4.0 >Reporter: Gautham Banasandra >Assignee: Gautham Banasandra >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > Need to refactor fetching of credentials in Jenkinsfile. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
