Hi Luke,
Thanks a lot for your time and assistance.
Some how its wasn't attached, attaching again Kafka 3.0 unit test report.
For my work i need to generate binaries from kafka source code which i am doing
locally , so there is no PR in repo.
I am just running unit test( i think that should run fine as it ran for me
earlier).
if i run complete test or integration its not running at all , that i am not
considering as of now.
below is error for kafka 2.8.0 ( same is for kafka 3.0)
===========================================
gradle test
Starting a Gradle Daemon (subsequent builds will be faster)
> Starting Daemon> IDLE<-------------> 0% INITIALIZING [65ms]> Evaluating
> settings<-------------> 0% INITIALIZING [170ms]<-------------> 0%
> INITIALIZING [276ms]
......................................................
=------> 54% EXECUTING [1m 5s]<=======------> 54% EXECUTING [1m
6s]<=======------> 54% EXECUTING [1m 7s]<=======------> 54% EXECUTING [1m
8s]<=======------> 54% EXECUTING [1m 9s]<=======------> 54% EXECUTING [1m
10s]<=======------> 54% EXECUTING [1m 11s]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':spotlessScalaCheck'.
> The following files had format violations:
streams\streams-scala\src\main\scala\org\apache\kafka\streams\scala\FunctionConversions.scala
@@ -1,83 +1,83 @@
-/*\n
- * Licensed to the Apache Software Foundation (ASF) under one or
more\n
- * contributor license agreements. See the NOTICE file distributed
with\n
- * this work for additional information regarding copyright
ownership.\n
- * The ASF licenses this file to You under the Apache License,
Version 2.0\n
- * (the "License"); you may not use this file except in compliance
with\n
- * the License. You may obtain a copy of the License at\n
- *\n
- * http://www.apache.org/licenses/LICENSE-2.0\n
- *\n
- * Unless required by applicable law or agreed to in writing,
software\n
- * distributed under the License is distributed on an "AS IS"
BASIS,\n
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied.\n
- * See the License for the specific language governing permissions
and\n
- * limitations under the License.\n
- */\n
-package org.apache.kafka.streams.scala\n
-\n
-import org.apache.kafka.streams.KeyValue\n
-import org.apache.kafka.streams.kstream._\n
-import scala.jdk.CollectionConverters._\n
-import java.lang.{Iterable => JIterable}\n
-\n
-@deprecated("This object is for internal use only", since =
"2.1.0")\n
-object FunctionConversions {\n
-\n
- implicit private[scala] class ForeachActionFromFunction[K, V](val
p: (K, V) => Unit) extends AnyVal {\n
- def asForeachAction: ForeachAction[K, V] = (key, value) =>
p(key, value)\n
- }\n
-\n
- implicit class PredicateFromFunction[K, V](val p: (K, V) =>
Boolean) extends AnyVal {\n
- def asPredicate: Predicate[K, V] = (key: K, value: V) => p(key,
value)\n
- }\n
-\n
- implicit class MapperFromFunction[T, U, VR](val f: (T, U) => VR)
extends AnyVal {\n
- def asKeyValueMapper: KeyValueMapper[T, U, VR] = (key: T, value:
U) => f(key, value)\n
- def asValueJoiner: ValueJoiner[T, U, VR] = (value1: T, value2:
U) => f(value1, value2)\n
- }\n
-\n
- implicit class KeyValueMapperFromFunction[K, V, KR, VR](val f: (K,
V) => (KR, VR)) extends AnyVal {\n
- def asKeyValueMapper: KeyValueMapper[K, V, KeyValue[KR, VR]] =
(key: K, value: V) => {\n
- val (kr, vr) = f(key, value)\n
- KeyValue.pair(kr, vr)\n
- }\n
- }\n
-\n
- implicit class ValueMapperFromFunction[V, VR](val f: V => VR)
extends AnyVal {\n
- def asValueMapper: ValueMapper[V, VR] = (value: V) => f(value)\n
... (118 more lines that didn't fit)
Violations also present in 43 other files.
Run 'gradlew.bat :spotlessApply' to fix these violations.
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 13s
80 actionable tasks: 21 executed, 59 up-to-date
Thanks
SH@D@B
________________________________
From: Luke Chen <show...@gmail.com>
Sent: 25 December 2021 07:47 AM
To: Kafka Users <users@kafka.apache.org>
Subject: Re: [External] : Re: Unit Test falling for Kafka 2.8.0
Hi Mohammad,
I can't see your report.
But usually we won't run all tests on local environment.
If you want to submit PR to Kafka repo, there will be jenkins build/tests
for you.
And also, there are some flaky tests.
You can check the jenkins build results for v3.0 here:
https://urldefense.com/v3/__https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.0/__;!!ACWV5N9M2RV99hQ!coGD_4y47zhqH7KVPVvoNau88cddNXNAv9HVKRfb8I_gmOXq0BKKQlN7MoXAUBU8oI7mJQ$
Thank you.
Luke
On Fri, Dec 24, 2021 at 9:26 PM mohammad shadab <
mohammad.s.sha...@oracle.com> wrote:
> Thanks a lot Luke for this piece of information.
>
> Yesterday i downloaded kafka 3.0 and its even falling there.
> Do i need to take it from git as i tool from
> https://urldefense.com/v3/__https://kafka.apache.org/downloads__;!!ACWV5N9M2RV99hQ!coGD_4y47zhqH7KVPVvoNau88cddNXNAv9HVKRfb8I_gmOXq0BKKQlN7MoXAUBXLEHEOYQ$
> <https://urldefense.com/v3/__https://kafka.apache.org/downloads__;!!ACWV5N9M2RV99hQ!e8QWe1ktCCKG2r0b2uBU9ydXmVOXfq-7ERFXY0M6KKBWBvdg5Az6ZPZjUZ47_TgqfcjQbw$>
> .
>
> attaching kafka 3.0 unit test report.
>
>
> - Gradle 7.3.3
> -
> - java version "11.0.13" 2021-10-19 LTS
> - Java(TM) SE Runtime Environment 18.9 (build 11.0.13+10-LTS-370)
> - Java HotSpot(TM) 64-Bit Server VM 18.9 (build 11.0.13+10-LTS-370,
> mixed mode)
> -
> - Scala code runner version 2.13.0
>
>
> Thanks
> SH@D@B
> ------------------------------
> *From:* Luke Chen <show...@gmail.com>
> *Sent:* 24 December 2021 06:27 PM
> *To:* Kafka Users <users@kafka.apache.org>
> *Subject:* [External] : Re: Unit Test falling for Kafka 2.8.0
>
> Hi Mohammad
>
> This is a known issue because of JFrog sunset the Bintray repo.
> We've fixed this issue in v3.0 (PR:
>
> https://urldefense.com/v3/__https://github.com/apache/kafka/pull/10056__;!!ACWV5N9M2RV99hQ!Yvj5tMVbXKP49H5KxQPInd_i-cbrkzk2rPHFk2HZgVUVkkppuj5jfCAiT3hek5uJopPnZQ$
> ).
> You should build/run tests successfully in v3.0.
> If you can't change to v3.0, then you can refer to the PR above to fix it.
> But we're not sure if it works well in v2.8 (because of different
> dependencies)
>
> Thank you.
> Luke
>
> On Fri, Dec 24, 2021 at 5:44 PM mohammad shadab <
> mohammad.s.sha...@oracle.com> wrote:
>
> > Hi all,
> >
> > Need some assistance as unit test is falling for kafka 2.8.0 , below are
> > detail. Appreciate any guidance , Please redirect me to correct audience
> if
> > i am firing this email to wrong audience.
> >
> >
> > I have downloaded kafka 2.8.0 source code (from
> >
> https://urldefense.com/v3/__https://kafka.apache.org/downloads__;!!ACWV5N9M2RV99hQ!Yvj5tMVbXKP49H5KxQPInd_i-cbrkzk2rPHFk2HZgVUVkkppuj5jfCAiT3hek5vwPLA-0A$
> ) and build binaries (following
> >
> https://urldefense.com/v3/__https://github.com/apache/kafka/tree/2.8__;!!ACWV5N9M2RV99hQ!Yvj5tMVbXKP49H5KxQPInd_i-cbrkzk2rPHFk2HZgVUVkkppuj5jfCAiT3hek5vISx0xoQ$
> ) . Although build is successful
> > after changing gradle plugin url in gradle/buildscript.gradle but unit
> > test is falling. I have attached unit test result.
> >
> >
> > My env details:
> > ============
> >
> > - Gradle 6.8.3
> > -
> > - java version "11.0.13" 2021-10-19 LTS
> > - Java(TM) SE Runtime Environment 18.9 (build 11.0.13+10-LTS-370)
> > - Java HotSpot(TM) 64-Bit Server VM 18.9 (build 11.0.13+10-LTS-370,
> > mixed mode)
> > -
> > - Scala code runner version 2.13.0
> >
> >
> >
> > Few important points :
> >
> > 1. Build and unit+integration test was working fine , around a month
> > back.
> > 2. Since *url
> > '
> https://urldefense.com/v3/__https://dl.bintray.com/content/netflixoss/external-gradle-plugins/__;!!ACWV5N9M2RV99hQ!Yvj5tMVbXKP49H5KxQPInd_i-cbrkzk2rPHFk2HZgVUVkkppuj5jfCAiT3hek5uiVW2qzg$
> > <
> https://urldefense.com/v3/__https://dl.bintray.com/content/netflixoss/external-gradle-plugins/__;!!ACWV5N9M2RV99hQ!Yvj5tMVbXKP49H5KxQPInd_i-cbrkzk2rPHFk2HZgVUVkkppuj5jfCAiT3hek5uiVW2qzg$
> >' * is
> > down i have changed to *url '
> https://urldefense.com/v3/__https://plugins.gradle.org/m2/__;!!ACWV5N9M2RV99hQ!Yvj5tMVbXKP49H5KxQPInd_i-cbrkzk2rPHFk2HZgVUVkkppuj5jfCAiT3hek5vJiEzkKg$
> > <
> https://urldefense.com/v3/__https://plugins.gradle.org/m2/__;!!ACWV5N9M2RV99hQ!Yvj5tMVbXKP49H5KxQPInd_i-cbrkzk2rPHFk2HZgVUVkkppuj5jfCAiT3hek5vJiEzkKg$
> >'* in *gradle/buildscript.gradle* file
> > to make gradle command run.
> > 3.
> >
> >
> > 1.
> >
> > Steps followed:
> >
> > · gradle
> >
> > · gradle jar
> >
> > · gradle srcJar
> >
> > · gradle aggregatedJavadoc
> >
> > · gradle javadoc
> >
> > · gradle javadocJar
> >
> > · gradle scaladoc
> >
> > · gradle scaladocJar
> >
> > · gradle releaseTarGz
> >
> > · gradle unitTest *(Runs but few fails, attached report)*
> >
> > · gradle integrationTest *( throw error) *
> >
> >
> >
> >
> > NOTE: Tried on kafka 3.0 , still see unit test is falling, with gradle
> > 7.3
> >
> >
> >
> >
> >
> >
> >
> > Thanks
> > SH@D@B
> >
>
