[ https://issues.apache.org/jira/browse/BEAM-5723?focusedWorklogId=182672&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-182672 ]
ASF GitHub Bot logged work on BEAM-5723: ---------------------------------------- Author: ASF GitHub Bot Created on: 08/Jan/19 20:54 Start Date: 08/Jan/19 20:54 Worklog Time Spent: 10m Work Description: kennknowles commented on pull request #7237: [BEAM-5723] Changed shadow plugin configuration to avoid relocating g… URL: https://github.com/apache/beam/pull/7237#discussion_r246147720 ########## File path: sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraServiceImpl.java ########## @@ -45,6 +43,8 @@ import java.util.stream.Collectors; import javax.annotation.Nullable; import org.apache.beam.sdk.io.BoundedSource; +import org.apache.beam.vendor.guava.v20_0.com.google.common.annotations.VisibleForTesting; Review comment: I agree we need to work on the release process for the vendored bits. You proposal is exactly right. Once we manually port e.g. direct-runner to use `org.apache.beam.vendor.guava.v20_0.com.google.common` then we turn off shading of Guava for the direct-runner. For most modules, once we do this we can turn of shading completely, because they only shade Guava. It will speed & simplify the build a lot and work better with IntelliJ. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 182672) Time Spent: 6h 10m (was: 6h) > CassandraIO is broken because of use of bad relocation of guava > --------------------------------------------------------------- > > Key: BEAM-5723 > URL: https://issues.apache.org/jira/browse/BEAM-5723 > Project: Beam > Issue Type: Bug > Components: io-java-cassandra > Affects Versions: 2.5.0, 2.6.0, 2.7.0, 2.8.0, 2.9.0 > Reporter: Arun sethia > Assignee: João Cabrita > Priority: Major > Fix For: 2.7.1, 2.10.0 > > Time Spent: 6h 10m > Remaining Estimate: 0h > > While using apache beam to run dataflow job to read data from BigQuery and > Store/Write to Cassandra with following libaries: > # beam-sdks-java-io-cassandra - 2.6.0 > # beam-sdks-java-io-jdbc - 2.6.0 > # beam-sdks-java-io-google-cloud-platform - 2.6.0 > # beam-sdks-java-core - 2.6.0 > # google-cloud-dataflow-java-sdk-all - 2.5.0 > # google-api-client -1.25.0 > > I am getting following error at the time insert/save data to Cassandra. > {code:java} > [error] (run-main-0) org.apache.beam.sdk.Pipeline$PipelineExecutionException: > java.lang.NoSuchMethodError: > com.datastax.driver.mapping.Mapper.saveAsync(Ljava/lang/Object;)Lorg/apache/beam/repackaged/beam_sdks_java_io_cassandra/com/google/common/util/concurrent/ListenableFuture; > org.apache.beam.sdk.Pipeline$PipelineExecutionException: > java.lang.NoSuchMethodError: > com.datastax.driver.mapping.Mapper.saveAsync(Ljava/lang/Object;)Lorg/apache/beam/repackaged/beam_sdks_java_io_cassandra/com/google/common/util/concurrent/ListenableFuture; > at > org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:332) > at > org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:302) > at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:197) > at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:64) > at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313) > at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299){code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)