[jira] [Commented] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

2020-12-09 Thread Hyukjin Kwon (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246946#comment-17246946
 ] 

Hyukjin Kwon commented on SPARK-33713:
--

Yeah, I think it's fine. +1 no worries!

> Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names
> -
>
> Key: SPARK-33713
> URL: https://issues.apache.org/jira/browse/SPARK-33713
> Project: Spark
>  Issue Type: Task
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Shane Knapp
>Priority: Major
>
> We removed `hive-1.2` profile since branch-3.1. So, we can simplify the 
> Jenkins job title.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

2020-12-09 Thread Sean R. Owen (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246858#comment-17246858
 ] 

Sean R. Owen commented on SPARK-33713:
--

I don't think we care much about build history, yes. Don't worry about that.

> Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names
> -
>
> Key: SPARK-33713
> URL: https://issues.apache.org/jira/browse/SPARK-33713
> Project: Spark
>  Issue Type: Task
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Shane Knapp
>Priority: Major
>
> We removed `hive-1.2` profile since branch-3.1. So, we can simplify the 
> Jenkins job title.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

2020-12-09 Thread Shane Knapp (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246850#comment-17246850
 ] 

Shane Knapp commented on SPARK-33713:
-

got it.  gonna rejigger my rejiggering of the JJB configs.

> Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names
> -
>
> Key: SPARK-33713
> URL: https://issues.apache.org/jira/browse/SPARK-33713
> Project: Spark
>  Issue Type: Task
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Shane Knapp
>Priority: Major
>
> We removed `hive-1.2` profile since branch-3.1. So, we can simplify the 
> Jenkins job title.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

2020-12-09 Thread Dongjoon Hyun (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246833#comment-17246833
 ] 

Dongjoon Hyun commented on SPARK-33713:
---

For master and branch-3.1, we don't need a build history. And, `master` and 
`branch-3.1` have been already broken for a while. (cc [~hyukjin.kwon] and 
[~srowen])

> Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names
> -
>
> Key: SPARK-33713
> URL: https://issues.apache.org/jira/browse/SPARK-33713
> Project: Spark
>  Issue Type: Task
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Shane Knapp
>Priority: Major
>
> We removed `hive-1.2` profile since branch-3.1. So, we can simplify the 
> Jenkins job title.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

2020-12-09 Thread Dongjoon Hyun (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246830#comment-17246830
 ] 

Dongjoon Hyun commented on SPARK-33713:
---

Oh, this was a request for only `master/branch-3.1` ("Remove `hive-2.3` post 
fix at master/branch-3.1 Jenkins job names").

> Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names
> -
>
> Key: SPARK-33713
> URL: https://issues.apache.org/jira/browse/SPARK-33713
> Project: Spark
>  Issue Type: Task
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Shane Knapp
>Priority: Major
>
> We removed `hive-1.2` profile since branch-3.1. So, we can simplify the 
> Jenkins job title.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

2020-12-09 Thread Shane Knapp (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246816#comment-17246816
 ] 

Shane Knapp commented on SPARK-33713:
-

also, let me think about other sneaky ways of making this happen w/o needing to 
lose all the build logs...

> Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names
> -
>
> Key: SPARK-33713
> URL: https://issues.apache.org/jira/browse/SPARK-33713
> Project: Spark
>  Issue Type: Task
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Shane Knapp
>Priority: Major
>
> We removed `hive-1.2` profile since branch-3.1. So, we can simplify the 
> Jenkins job title.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

2020-12-09 Thread Shane Knapp (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246810#comment-17246810
 ] 

Shane Knapp commented on SPARK-33713:
-

fwiw, here's what the new and sexy build names will be:
{noformat}
INFO:jenkins_jobs.builder:Number of jobs generated: 30 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-2.4-test-maven-hadoop-2.6' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-2.4-test-maven-hadoop-2.7' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-2.4-test-sbt-hadoop-2.6' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-2.4-test-sbt-hadoop-2.7' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.0-test-maven-hadoop-2.7' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.0-test-maven-hadoop-2.7-jdk-11' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.0-test-maven-hadoop-3.2' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.0-test-maven-hadoop-3.2-jdk-11' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.0-test-sbt-hadoop-2.7' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.0-test-sbt-hadoop-3.2' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-maven-hadoop-2.7' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-maven-hadoop-2.7-jdk-11' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-maven-hadoop-2.7-jdk-11-scala-2.13' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-maven-hadoop-2.7-scala-2.13' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-maven-hadoop-3.2' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-maven-hadoop-3.2-jdk-11' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-maven-hadoop-3.2-jdk-11-scala-2.13' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-maven-hadoop-3.2-scala-2.13' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-sbt-hadoop-2.7' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-branch-3.1-test-sbt-hadoop-3.2' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-maven-hadoop-2.7' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-maven-hadoop-2.7-jdk-11' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-maven-hadoop-2.7-jdk-11-scala-2.13' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-maven-hadoop-2.7-scala-2.13' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-maven-hadoop-3.2' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-maven-hadoop-3.2-jdk-11' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-maven-hadoop-3.2-jdk-11-scala-2.13' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-maven-hadoop-3.2-scala-2.13' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-sbt-hadoop-2.7' 
DEBUG:jenkins_jobs.builder:Writing XML to 
'target/jenkins-xml/spark-master-test-sbt-hadoop-3.2'
{noformat}

> Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names
> -
>
> Key: SPARK-33713
> URL: https://issues.apache.org/jira/browse/SPARK-33713
> Project: Spark
>  Issue Type: Task
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Shane Knapp
>Priority: Major
>
> We removed `hive-1.2` profile since branch-3.1. So, we can simplify the 
> Jenkins job title.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

2020-12-09 Thread Shane Knapp (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246808#comment-17246808
 ] 

Shane Knapp commented on SPARK-33713:
-

hmm.  so while i heartily endorse this, there will be a side-effect of renaming 
the jobs (particularly as we use Jenkins Job Builder – JJB – to deploy and 
manage the build configs):

once i redeploy the updated JJB configs w/the shortened build names, it will 
create new builds and not change the names of existing ones.  unless i'm unable 
to read docs anymore (which is entirely possible) there's no 'rename' ability.

and since, according to jenkins, these are new builds, all previous build 
history will be lost...  unless i manually copy things over on the jenkins 
primary filesystem (which i'd like to avoid if possible).  given that we're 
only storing 2 weeks of builds, if we time it properly (aka at 3.1 release) the 
impact of losing these logs will be pretty insignificant.

my suggestion:

i want to do this, but i propose moving everything over when 3.1 is officially 
released.   we'll lose the previous 2 weeks of build history across all 
branches, but since we're "starting fresh"-ish i think the impact will be 
minimized.

 

thoughts?  comments?  should we pull anyone else in for their opions?  [~sowen] 
[~hyukjin.kwon] [~holden]

> Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names
> -
>
> Key: SPARK-33713
> URL: https://issues.apache.org/jira/browse/SPARK-33713
> Project: Spark
>  Issue Type: Task
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Shane Knapp
>Priority: Major
>
> We removed `hive-1.2` profile since branch-3.1. So, we can simplify the 
> Jenkins job title.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org