[
https://issues.apache.org/jira/browse/BEAM-5723?focusedWorklogId=192418&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-192418
]
ASF GitHub Bot logged work on BEAM-5723:
----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Jan/19 17:06
Start Date: 30/Jan/19 17:06
Worklog Time Spent: 10m
Work Description: iemejia commented on issue #7237: [BEAM-5723] Changed
shadow plugin configuration to avoid relocating g…
URL: https://github.com/apache/beam/pull/7237#issuecomment-459025470
I reopened [the
issue](https://issues.apache.org/jira/browse/BEAM-5723?focusedCommentId=16756332&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16756332).
It seems that guava is still relocated for all IOs that 'leak' guava through
its dependencies. I found some cases, e.g. Clickhouse, Parquet, Cassandra. I
think we must stop the guava relocation and find what breaks. Also we are lucky
that we have not found this issue yet in the other modules (probably because
they don't leak guava in the API but still things can break). If understood
well, this is [2] and it will fix this issue.
For [1] I don't know if this helps but [I worked on this a
bit](https://github.com/iemejia/beam/commit/dfded5af1e6dd9626947f3f689db76537bc074e5)
and I got checkstyle to report the direct guava imports, but I did not have
time to find the way to add exceptions, e.g. for the Cassandra case, if you add
this I think we will be ready to go.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 192418)
Time Spent: 8h 20m (was: 8h 10m)
> CassandraIO is broken because of use of bad relocation of guava
> ---------------------------------------------------------------
>
> Key: BEAM-5723
> URL: https://issues.apache.org/jira/browse/BEAM-5723
> Project: Beam
> Issue Type: Bug
> Components: io-java-cassandra
> Affects Versions: 2.5.0, 2.6.0, 2.7.0, 2.8.0, 2.9.0, 2.10.0
> Reporter: Arun sethia
> Assignee: João Cabrita
> Priority: Major
> Fix For: 2.11.0
>
> Time Spent: 8h 20m
> Remaining Estimate: 0h
>
> While using apache beam to run dataflow job to read data from BigQuery and
> Store/Write to Cassandra with following libaries:
> # beam-sdks-java-io-cassandra - 2.6.0
> # beam-sdks-java-io-jdbc - 2.6.0
> # beam-sdks-java-io-google-cloud-platform - 2.6.0
> # beam-sdks-java-core - 2.6.0
> # google-cloud-dataflow-java-sdk-all - 2.5.0
> # google-api-client -1.25.0
>
> I am getting following error at the time insert/save data to Cassandra.
> {code:java}
> [error] (run-main-0) org.apache.beam.sdk.Pipeline$PipelineExecutionException:
> java.lang.NoSuchMethodError:
> com.datastax.driver.mapping.Mapper.saveAsync(Ljava/lang/Object;)Lorg/apache/beam/repackaged/beam_sdks_java_io_cassandra/com/google/common/util/concurrent/ListenableFuture;
> org.apache.beam.sdk.Pipeline$PipelineExecutionException:
> java.lang.NoSuchMethodError:
> com.datastax.driver.mapping.Mapper.saveAsync(Ljava/lang/Object;)Lorg/apache/beam/repackaged/beam_sdks_java_io_cassandra/com/google/common/util/concurrent/ListenableFuture;
> at
> org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:332)
> at
> org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:302)
> at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:197)
> at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:64)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
