[ https://issues.apache.org/jira/browse/BEAM-5723?focusedWorklogId=182371&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-182371 ]
ASF GitHub Bot logged work on BEAM-5723: ---------------------------------------- Author: ASF GitHub Bot Created on: 08/Jan/19 13:01 Start Date: 08/Jan/19 13:01 Worklog Time Spent: 10m Work Description: iemejia commented on pull request #7237: [BEAM-5723] Changed shadow plugin configuration to avoid relocating g… URL: https://github.com/apache/beam/pull/7237#discussion_r245986891 ########## File path: sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraServiceImpl.java ########## @@ -45,6 +43,8 @@ import java.util.stream.Collectors; import javax.annotation.Nullable; import org.apache.beam.sdk.io.BoundedSource; +import org.apache.beam.vendor.guava.v20_0.com.google.common.annotations.VisibleForTesting; Review comment: Oh didn't know this was already published, I suppose this was part of the first vote. We need to document and maybe make more clear the vendored artifacts vote/release validation process, The idea is that now in all modules e.g. direct-runner include instead of all the `com.google.common.*` imports the `org.apache.beam.vendor.guava.v20_0.com.google.common.*` ones? If so we will need to do this manually or this is somehow automatized when packaging with gradle and its magic? Tell me if you need help with that I think this is important enough to work on it (at least reduce the 5 times guava in direct runner present). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 182371) Time Spent: 5h 50m (was: 5h 40m) > CassandraIO is broken because of use of bad relocation of guava > --------------------------------------------------------------- > > Key: BEAM-5723 > URL: https://issues.apache.org/jira/browse/BEAM-5723 > Project: Beam > Issue Type: Bug > Components: io-java-cassandra > Affects Versions: 2.5.0, 2.6.0, 2.7.0, 2.8.0, 2.9.0 > Reporter: Arun sethia > Assignee: João Cabrita > Priority: Major > Fix For: 2.7.1, 2.10.0 > > Time Spent: 5h 50m > Remaining Estimate: 0h > > While using apache beam to run dataflow job to read data from BigQuery and > Store/Write to Cassandra with following libaries: > # beam-sdks-java-io-cassandra - 2.6.0 > # beam-sdks-java-io-jdbc - 2.6.0 > # beam-sdks-java-io-google-cloud-platform - 2.6.0 > # beam-sdks-java-core - 2.6.0 > # google-cloud-dataflow-java-sdk-all - 2.5.0 > # google-api-client -1.25.0 > > I am getting following error at the time insert/save data to Cassandra. > {code:java} > [error] (run-main-0) org.apache.beam.sdk.Pipeline$PipelineExecutionException: > java.lang.NoSuchMethodError: > com.datastax.driver.mapping.Mapper.saveAsync(Ljava/lang/Object;)Lorg/apache/beam/repackaged/beam_sdks_java_io_cassandra/com/google/common/util/concurrent/ListenableFuture; > org.apache.beam.sdk.Pipeline$PipelineExecutionException: > java.lang.NoSuchMethodError: > com.datastax.driver.mapping.Mapper.saveAsync(Ljava/lang/Object;)Lorg/apache/beam/repackaged/beam_sdks_java_io_cassandra/com/google/common/util/concurrent/ListenableFuture; > at > org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:332) > at > org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:302) > at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:197) > at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:64) > at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313) > at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299){code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)