[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943951#comment-14943951 ] Ismael Juma commented on KAFKA-2566: We now have a summary of failed tests without having to look at the console output, which is a nice time saver: https://builds.apache.org/job/kafka-trunk-git-pr-jdk7/677/ > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task > Components: build >Reporter: Ismael Juma >Assignee: Flavio Junqueira > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle commands: > ./gradlew -PscalaVersion=2.10.1 test > ./gradlew -PscalaVersion=2.11 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not doing clean builds > * The versions tested are defined in Jenkins instead of the build > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean testAll` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > We only test the PR job against Java 7 as it's executed much more often than > the trunk job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943651#comment-14943651 ] Guozhang Wang commented on KAFKA-2566: -- Verified all builds are configured and working now. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task > Components: build >Reporter: Ismael Juma >Assignee: Flavio Junqueira > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle commands: > ./gradlew -PscalaVersion=2.10.1 test > ./gradlew -PscalaVersion=2.11 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not doing clean builds > * The versions tested are defined in Jenkins instead of the build > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean testAll` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > We only test the PR job against Java 7 as it's executed much more often than > the trunk job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943433#comment-14943433 ] Flavio Junqueira commented on KAFKA-2566: - I have changed the jenkins configuration with [~ijuma]'s input. If all three builds are fine, we can close this jira. Unless the current set of changes is broken, new changes should be proposed in a different jira. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle commands: > ./gradlew -PscalaVersion=2.10.1 test > ./gradlew -PscalaVersion=2.11 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not doing clean builds > * The versions tested are defined in Jenkins instead of the build > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean testAll` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > We only test the PR job against Java 7 as it's executed much more often than > the trunk job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942347#comment-14942347 ] Ismael Juma commented on KAFKA-2566: [~guozhang], I filed KAFKA-2608 to recommend the Scala 2.11 version on the downloads page of the website. We list all the versions, so the only thing to change is the recommendation that follows the list: http://kafka.apache.org/downloads.html > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle commands: > ./gradlew -PscalaVersion=2.10.1 test > ./gradlew -PscalaVersion=2.11 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not doing clean builds > * The versions tested are defined in Jenkins instead of the build > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean testAll` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > We only test the PR job against Java 7 as it's executed much more often than > the trunk job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942257#comment-14942257 ] Ismael Juma commented on KAFKA-2566: [~junrao], thanks for the correction, I had missed that we invoke gradle a second time with "-PscalaVersion=2.11". I will update the description to make this clear. I still think that it's better to use `testAll` because it will automatically do the right thing as we update the build. Having said that, this changes perhaps what we should do for the PR job, if we are already testing multiple Scala versions there. Maybe it should be: 1. kafka-trunk-jdk7: "Poll SCM" every hour, GRADLE_2_1, jdk-1.7u51, "./gradlew clean jarAll docsJarAll testAll" 2. kafka-trunk-jdk8: "Poll SCM" every hour, GRADLE_2_1, jdk1.8.0_45, "./gradlew clean jarAll docsJarAll testAll" 3. kafka-trunk-git-pr-jdk8: "Pull requests", GRADLE_2_1, jdk1.7.0_51, "./gradlew clean testAll" Thoughts? [~guozhang], for the Java 8 build, we need to merge Gwen's javadoc PR: https://github.com/apache/kafka/pull/147 > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942071#comment-14942071 ] Guozhang Wang commented on KAFKA-2566: -- [~junrao] Yeah, we plan to run testAll for trunk-jdk7/8, for trunk-git-pr I think it is sufficient to run with the default Scala version; and at the same time we may upgrade default version to 2.11.7 now. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942034#comment-14942034 ] Jun Rao commented on KAFKA-2566: The trunk Jenkins job actually runs test with both scala 2.10 and 2.11. We can change it to run testAll though. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941939#comment-14941939 ] Ismael Juma commented on KAFKA-2566: Not yet, I can do it tomorrow. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941931#comment-14941931 ] Guozhang Wang commented on KAFKA-2566: -- Cool, is there an existing ticket for upgrading the default scala distribution version? If not let's create one. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941928#comment-14941928 ] Ismael Juma commented on KAFKA-2566: It's the same reason as I just said. We build by default with 2.10.5 to ensure we don't use 2.11 features and APIs. I do think 2.11.7 should be the default distribution though. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941923#comment-14941923 ] Guozhang Wang commented on KAFKA-2566: -- Agree, will change accordingly. BTW, current default scala version specified in build.gradle is 2.10.5, shall we upgrade to 2.11.7 now? > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941903#comment-14941903 ] Ismael Juma commented on KAFKA-2566: Guozhang, it looks good to me apart from the PR job. We should use the lowest version of Java and Scala to ensure people don't use features from the newer version (as per my original suggestion). > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941567#comment-14941567 ] Guozhang Wang commented on KAFKA-2566: -- [~junrao] [~ijuma] [~fpj] I browse through the configs and here is a complete proposal: 1. kafka-trunk-jdk7: "Poll SCM" every hour, GRADLE_2_1, jdk-1.7u51, "./gradlew clean jarAll docsJarAll testAll" 2. kafka-trunk-jdk8: "Poll SCM" every hour, GRADLE_2_1, jdk1.8.0_45, "./gradlew clean jarAll docsJarAll testAll" 3. kafka-trunk-git-pr-jdk8: "Pull requests", GRADLE_2_1, jdk1.8.0_45, "./gradlew -PscalaVersion=2.11.7 clean test" > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941390#comment-14941390 ] Guozhang Wang commented on KAFKA-2566: -- [~fpj] Sure go ahead. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941044#comment-14941044 ] Flavio Junqueira commented on KAFKA-2566: - I'm a member of the hudson-jobadmin group and I can make this change, but I'm not a committer of this project. I'm willing to make this change if this isn't an issue with the PMC. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904239#comment-14904239 ] Ismael Juma commented on KAFKA-2566: [~guozhang], I changed the commands for the trunk Jenkins jobs to produce jars and doc jars (this implies compilation and javadoc generation). We also run the tests last because they can be a bit flaky at the moment. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean jarAll docsJarAll > testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean jarAll > docsJarAll testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903485#comment-14903485 ] Guozhang Wang commented on KAFKA-2566: -- +1 on the proposal, and also +1 on javadoc tool. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903124#comment-14903124 ] Ismael Juma commented on KAFKA-2566: One open question is whether we want to run run the javadoc tool in the Jenkins build in order to catch javadoc errors. > Improve Jenkins set-up > -- > > Key: KAFKA-2566 > URL: https://issues.apache.org/jira/browse/KAFKA-2566 > Project: Kafka > Issue Type: Task >Reporter: Ismael Juma > > There are currently two Jenkins jobs: > https://builds.apache.org/job/Kafka-trunk > https://builds.apache.org/job/kafka-trunk-git-pr > They both run with Java 7 and execute the following gradle command: > ./gradlew -PscalaVersion=2.10.1 test > There are a few issues with this: > * We don't test Java 8 even though that's the only stable release of the JDK > that still receives security fixes > * We are testing with Scala 2.10.1 even though we should be testing with > Scala 2.10.5 > * We are not testing with Scala 2.11.x > * We are not doing clean builds > I suggest the following: > 1. Change the `kafka-trunk-git-pr` job to use the `./gradlew clean test` > command. > 2. Change the `Kafka-trunk` job to use the `./gradlew clean testAll` command. > 3. Introduce a kafka-trunk-jdk8 job with the command `./gradlew clean testAll` > This is a compromise that doesn't slow down the PR job (which is executed > much more often) while still testing trunk in all of our supported JDK and > Scala versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
