Thanks so much Maximilian..I will follow this and enrich it with my own code &
see how far it goes.I tried the curl in the quick start tab, I get certificate
error, it seems:
$ curl https://flink.apache.org/q/quickstart.sh | bash % Total % Received %
Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed 0 0 0 0 0
0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (77) error setting
certificate verify locations: CAfile: /usr/share/ssl/certs/ca-bundle.crt
CApath: none
Cheers+thanks again.
From: Maximilian Michels <[email protected]>
To: [email protected]; amir bahmanyari <[email protected]>
Sent: Tuesday, May 10, 2016 7:15 AM
Subject: Re: Overlapping classes warnings when creating the fat jar for Flink
Cluster
Hi Amir,
Overlapping classes are not necessarily a problem; only if they are
not identical. Your output looks safe because all overlapping classes
seem to have the same jar version.
You are probably better off with the Quickstart POM which handles the
dependencies in a nicer way:
https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html
Cheers,
Max
On Tue, May 10, 2016 at 3:08 AM, amir bahmanyari <[email protected]> wrote:
> Hi Colleagues,
> After compilation, when I do: mvn clean package
> I get a list of overlapping classes warnings like these as an example (and
> many more):
>
> WARNING] flink-clients_2.10-1.0.0.jar, flink-runtime_2.10-1.0.0.jar,
> flink-java-1.0.0.jar, flink-optimizer_2.10-1.0.0.jar, flink-core-1.0.0.jar,
> flink-streaming-java_2.10-1.0.0.jar define 1690 overlapping classes:
> [WARNING] -
> org.apache.flink.shaded.com.google.common.collect.Synchronized$SynchronizedSortedSetMultimap
> [WARNING] -
> org.apache.flink.shaded.com.google.common.util.concurrent.FutureCallback
> [WARNING] -
> org.apache.flink.shaded.com.google.common.util.concurrent.Monitor$Guard
>
>
> flink-runtime_2.10-1.0.0.jar, flink-java-1.0.0.jar define 166 overlapping
> classes:
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$LocalVarRule
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.tree.InvokeDynamicInsnNode
> [WARNING] -
> org.apache.flink.shaded.org.objectweb.asm.xml.ASMContentHandler$ExceptionRule
> [WARNING] - org.apache.flink.shaded.org.objectweb.asm.Attribute
>
>
> java-sdk-all-0.1.0-incubating-SNAPSHOT.jar,
> google-cloud-dataflow-java-runner-0.1.0-incubating-SNAPSHOT.jar define 1717
> overlapping classes:
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.TreeRangeSet$ComplementRangesByLowerBound$2
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.WellBehavedMap$EntrySet$1$1
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.util.concurrent.CycleDetectingLockFactory$Policies$1
> [WARNING] -
> org.apache.beam.sdk.repackaged.com.google.common.collect.Maps$6
>
> Any idea pls?
> Thanks so much fr your time.
