[
https://issues.apache.org/jira/browse/BEAM-10226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17548723#comment-17548723
]
Danny McCormick commented on BEAM-10226:
----------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/20346
> BeamSQL might fail on test_distinct_bytes after migrated to Sets transform
> --------------------------------------------------------------------------
>
> Key: BEAM-10226
> URL: https://issues.apache.org/jira/browse/BEAM-10226
> Project: Beam
> Issue Type: Task
> Components: sdk-java-core
> Reporter: Rui Wang
> Priority: P3
> Labels: Clarified
>
> This query breaks Java code import. Need to diagnose the root cause and have
> a fix properly.
> {code:java}
> public void test_distinct_bytes() {
> String sql = "SELECT DISTINCT val.BYTES\n"
> + "from (select b\"1\" BYTES union all\n"
> + " select cast(NULL as bytes) union all\n"
> + " select b\"-1\" union all\n"
> + " select b\"1\" union all\n"
> + " select cast(NULL as bytes)) val";
> ZetaSQLQueryPlanner zetaSQLQueryPlanner = new ZetaSQLQueryPlanner(config);
> BeamRelNode beamRelNode = zetaSQLQueryPlanner.convertToBeamRel(sql);
> PCollection<Row> stream = BeamSqlRelUtils.toPCollection(pipeline,
> beamRelNode);
> Schema singleField = Schema.builder().addByteArrayField("field1").build();
> PAssert.that(stream)
> .containsInAnyOrder(
>
> Row.withSchema(singleField).addValues("123".getBytes(UTF_8)).build());
>
> pipeline.run().waitUntilFinish(Duration.standardMinutes(PIPELINE_EXECUTION_WAITTIME_MINUTES));
> }
> {code}
> This query will throws
> {code:java}
> Forbidden IOException when reading from InputStream
> java.lang.IllegalArgumentException: Forbidden IOException when reading from
> InputStream
> at
> org.apache.beam.sdk.util.CoderUtils.decodeFromSafeStream(CoderUtils.java:118)
> at
> org.apache.beam.sdk.util.CoderUtils.decodeFromByteArray(CoderUtils.java:98)
> at
> org.apache.beam.sdk.util.CoderUtils.decodeFromByteArray(CoderUtils.java:92)
> at org.apache.beam.sdk.util.CoderUtils.clone(CoderUtils.java:141)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
