subject:"\[jira\] \[Commented\] \(BEAM\-5061\) Invisible parameter type exception in JDK 10"

[jira] [Commented] (BEAM-5061) Invisible parameter type exception in JDK 10

2019-03-29 Thread Pablo Estrada (JIRA)



[ 
https://issues.apache.org/jira/browse/BEAM-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805314#comment-16805314
 ] 

Pablo Estrada commented on BEAM-5061:
-

Is this still happening? We have SDK tests running now  with all PreCommits and 
ValidatesRunner tests...

> Invisible parameter type exception in JDK 10
> 
>
> Key: BEAM-5061
> URL: https://issues.apache.org/jira/browse/BEAM-5061
> Project: Beam
>  Issue Type: Sub-task
>  Components: sdk-java-core
>Affects Versions: 2.5.0
>Reporter: Mike Pedersen
>Priority: Major
>
> When using JDK 10, using a ParDo after a CoGroupByKey seems to create the 
> following exception when executed on local runner:
> {noformat}
> Exception in thread "main" 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.util.concurrent.UncheckedExecutionException:
>  java.lang.IllegalStateException: Invisible parameter type of Main$1 arg0 for 
> public Main$1$DoFnInvoker(Main$1)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2214)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
> ...
> Caused by: java.lang.IllegalStateException: Invisible parameter type of 
> Main$1 arg0 for public Main$1$DoFnInvoker(Main$1)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.InstrumentedType$Default.validated(InstrumentedType.java:925)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.MethodRegistry$Default.prepare(MethodRegistry.java:465)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:170)
> ...
> {noformat}
> This error disappears completely when using JDK 8. Here is a minimal example 
> to reproduce it:
> {code:java}
> import org.apache.beam.sdk.Pipeline;
> import org.apache.beam.sdk.options.PipelineOptions;
> import org.apache.beam.sdk.options.PipelineOptionsFactory;
> import org.apache.beam.sdk.transforms.Create;
> import org.apache.beam.sdk.transforms.DoFn;
> import org.apache.beam.sdk.transforms.ParDo;
> import org.apache.beam.sdk.transforms.join.CoGbkResult;
> import org.apache.beam.sdk.transforms.join.CoGroupByKey;
> import org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple;
> import org.apache.beam.sdk.values.KV;
> import org.apache.beam.sdk.values.PCollection;
> import org.apache.beam.sdk.values.TupleTag;
> import java.util.Arrays;
> import java.util.List;
> public class Main {
>     public static void main(String[] args) {
>     PipelineOptions options = PipelineOptionsFactory.create();
>     Pipeline p = Pipeline.create(options);
>     final TupleTag emailsTag = new TupleTag<>();
>     final TupleTag phonesTag = new TupleTag<>();
>     final List> emailsList =
>     Arrays.asList(
>     KV.of("amy", "a...@example.com"),
>     KV.of("carl", "c...@example.com"),
>     KV.of("julia", "ju...@example.com"),
>     KV.of("carl", "c...@email.com"));
>     final List> phonesList =
>     Arrays.asList(
>     KV.of("amy", "111-222-"),
>     KV.of("james", "222-333-"),
>     KV.of("amy", "333-444-"),
>     KV.of("carl", "444-555-"));
>     PCollection> emails = p.apply("CreateEmails", 
> Create.of(emailsList));
>     PCollection> phones = p.apply("CreatePhones", 
> Create.of(phonesList));
>     PCollection> results =
>     KeyedPCollectionTuple.of(emailsTag, emails)
>     .and(phonesTag, phones)
>     .apply(CoGroupByKey.create());
>     PCollection contactLines =
>     results.apply(
>     ParDo.of(
>     new DoFn, String>() {
>     @ProcessElement
>     public void processElement(ProcessContext 
> c) {
>     KV e = 
> c.element();
>     String name = e.getKey();
>     Iterable emailsIter = 
> e.getValue().getAll(emailsTag);
>     Iterable phonesIter = 
> e.getValue().getAll(phonesTag);
>     String formattedResult = "";
>     c.output(formattedResult);
>

[jira] [Commented] (BEAM-5061) Invisible parameter type exception in JDK 10

2018-10-30 Thread Kenneth Knowles (JIRA)



[ 
https://issues.apache.org/jira/browse/BEAM-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669552#comment-16669552
 ] 

Kenneth Knowles commented on BEAM-5061:
---

My (shallow) understanding is that a bytebuddy upgrade is needed, and it has 
some new conventions to support new and tighter aspects of Java's access model.

> Invisible parameter type exception in JDK 10
> 
>
> Key: BEAM-5061
> URL: https://issues.apache.org/jira/browse/BEAM-5061
> Project: Beam
>  Issue Type: Sub-task
>  Components: sdk-java-core
>Affects Versions: 2.5.0
>Reporter: Mike Pedersen
>Priority: Major
>
> When using JDK 10, using a ParDo after a CoGroupByKey seems to create the 
> following exception when executed on local runner:
> {noformat}
> Exception in thread "main" 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.util.concurrent.UncheckedExecutionException:
>  java.lang.IllegalStateException: Invisible parameter type of Main$1 arg0 for 
> public Main$1$DoFnInvoker(Main$1)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2214)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
> ...
> Caused by: java.lang.IllegalStateException: Invisible parameter type of 
> Main$1 arg0 for public Main$1$DoFnInvoker(Main$1)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.InstrumentedType$Default.validated(InstrumentedType.java:925)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.MethodRegistry$Default.prepare(MethodRegistry.java:465)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:170)
> ...
> {noformat}
> This error disappears completely when using JDK 8. Here is a minimal example 
> to reproduce it:
> {code:java}
> import org.apache.beam.sdk.Pipeline;
> import org.apache.beam.sdk.options.PipelineOptions;
> import org.apache.beam.sdk.options.PipelineOptionsFactory;
> import org.apache.beam.sdk.transforms.Create;
> import org.apache.beam.sdk.transforms.DoFn;
> import org.apache.beam.sdk.transforms.ParDo;
> import org.apache.beam.sdk.transforms.join.CoGbkResult;
> import org.apache.beam.sdk.transforms.join.CoGroupByKey;
> import org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple;
> import org.apache.beam.sdk.values.KV;
> import org.apache.beam.sdk.values.PCollection;
> import org.apache.beam.sdk.values.TupleTag;
> import java.util.Arrays;
> import java.util.List;
> public class Main {
>     public static void main(String[] args) {
>     PipelineOptions options = PipelineOptionsFactory.create();
>     Pipeline p = Pipeline.create(options);
>     final TupleTag emailsTag = new TupleTag<>();
>     final TupleTag phonesTag = new TupleTag<>();
>     final List> emailsList =
>     Arrays.asList(
>     KV.of("amy", "a...@example.com"),
>     KV.of("carl", "c...@example.com"),
>     KV.of("julia", "ju...@example.com"),
>     KV.of("carl", "c...@email.com"));
>     final List> phonesList =
>     Arrays.asList(
>     KV.of("amy", "111-222-"),
>     KV.of("james", "222-333-"),
>     KV.of("amy", "333-444-"),
>     KV.of("carl", "444-555-"));
>     PCollection> emails = p.apply("CreateEmails", 
> Create.of(emailsList));
>     PCollection> phones = p.apply("CreatePhones", 
> Create.of(phonesList));
>     PCollection> results =
>     KeyedPCollectionTuple.of(emailsTag, emails)
>     .and(phonesTag, phones)
>     .apply(CoGroupByKey.create());
>     PCollection contactLines =
>     results.apply(
>     ParDo.of(
>     new DoFn, String>() {
>     @ProcessElement
>     public void processElement(ProcessContext 
> c) {
>     KV e = 
> c.element();
>     String name = e.getKey();
>     Iterable emailsIter = 
> e.getValue().getAll(emailsTag);
>     Iterable phonesIter = 
> e.getValue().getAll(phonesTag);
>     String formattedResult = "";
>

[jira] [Commented] (BEAM-5061) Invisible parameter type exception in JDK 10

2018-10-23 Thread Kenneth Knowles (JIRA)



[ 
https://issues.apache.org/jira/browse/BEAM-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661273#comment-16661273
 ] 

Kenneth Knowles commented on BEAM-5061:
---

I will make this a subtask of BEAM-2530 as some folks are starting to pick 
those up.

> Invisible parameter type exception in JDK 10
> 
>
> Key: BEAM-5061
> URL: https://issues.apache.org/jira/browse/BEAM-5061
> Project: Beam
>  Issue Type: Bug
>  Components: beam-model
>Affects Versions: 2.5.0
>Reporter: Mike Pedersen
>Assignee: Kenneth Knowles
>Priority: Major
>
> When using JDK 10, using a ParDo after a CoGroupByKey seems to create the 
> following exception when executed on local runner:
> {noformat}
> Exception in thread "main" 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.util.concurrent.UncheckedExecutionException:
>  java.lang.IllegalStateException: Invisible parameter type of Main$1 arg0 for 
> public Main$1$DoFnInvoker(Main$1)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2214)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
> at 
> org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
> ...
> Caused by: java.lang.IllegalStateException: Invisible parameter type of 
> Main$1 arg0 for public Main$1$DoFnInvoker(Main$1)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.InstrumentedType$Default.validated(InstrumentedType.java:925)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.MethodRegistry$Default.prepare(MethodRegistry.java:465)
> at 
> org.apache.beam.repackaged.beam_sdks_java_core.net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:170)
> ...
> {noformat}
> This error disappears completely when using JDK 8. Here is a minimal example 
> to reproduce it:
> {code:java}
> import org.apache.beam.sdk.Pipeline;
> import org.apache.beam.sdk.options.PipelineOptions;
> import org.apache.beam.sdk.options.PipelineOptionsFactory;
> import org.apache.beam.sdk.transforms.Create;
> import org.apache.beam.sdk.transforms.DoFn;
> import org.apache.beam.sdk.transforms.ParDo;
> import org.apache.beam.sdk.transforms.join.CoGbkResult;
> import org.apache.beam.sdk.transforms.join.CoGroupByKey;
> import org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple;
> import org.apache.beam.sdk.values.KV;
> import org.apache.beam.sdk.values.PCollection;
> import org.apache.beam.sdk.values.TupleTag;
> import java.util.Arrays;
> import java.util.List;
> public class Main {
>     public static void main(String[] args) {
>     PipelineOptions options = PipelineOptionsFactory.create();
>     Pipeline p = Pipeline.create(options);
>     final TupleTag emailsTag = new TupleTag<>();
>     final TupleTag phonesTag = new TupleTag<>();
>     final List> emailsList =
>     Arrays.asList(
>     KV.of("amy", "a...@example.com"),
>     KV.of("carl", "c...@example.com"),
>     KV.of("julia", "ju...@example.com"),
>     KV.of("carl", "c...@email.com"));
>     final List> phonesList =
>     Arrays.asList(
>     KV.of("amy", "111-222-"),
>     KV.of("james", "222-333-"),
>     KV.of("amy", "333-444-"),
>     KV.of("carl", "444-555-"));
>     PCollection> emails = p.apply("CreateEmails", 
> Create.of(emailsList));
>     PCollection> phones = p.apply("CreatePhones", 
> Create.of(phonesList));
>     PCollection> results =
>     KeyedPCollectionTuple.of(emailsTag, emails)
>     .and(phonesTag, phones)
>     .apply(CoGroupByKey.create());
>     PCollection contactLines =
>     results.apply(
>     ParDo.of(
>     new DoFn, String>() {
>     @ProcessElement
>     public void processElement(ProcessContext 
> c) {
>     KV e = 
> c.element();
>     String name = e.getKey();
>     Iterable emailsIter = 
> e.getValue().getAll(emailsTag);
>     Iterable phonesIter = 
> e.getValue().getAll(phonesTag);
>     String formattedResult = "";
>

[jira] [Commented] (BEAM-5061) Invisible parameter type exception in JDK 10

[jira] [Commented] (BEAM-5061) Invisible parameter type exception in JDK 10

[jira] [Commented] (BEAM-5061) Invisible parameter type exception in JDK 10

3 matches

Site Navigation

Mail list logo

Footer information