[
https://issues.apache.org/jira/browse/BEAM-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031046#comment-17031046
]
Brian Hulette commented on BEAM-9253:
-------------------------------------
It looks like the integ_test_small_csv_test_1 schema has id as an INT64. It
also says it was last updated 2/4. Looks like this is unrelated to the linked
PR, somehow the schema just got changed?
{code}
❯ gcloud beta data-catalog entries lookup
'`datacatalog`.`entry`.`apache-beam-testing`.`us-central1`.`samples`.`integ_test_small_csv_test_1`'``
gcsFilesetSpec:
filePatterns:
- gs://apache-beam-samples/integration_test_small_csv/test.csv
linkedResource:
//datacatalog.googleapis.com/projects/apache-beam-testing/locations/us-central1/entryGroups/samples/entries/integ_test_small_csv_test_1
name:
projects/apache-beam-testing/locations/us-central1/entryGroups/samples/entries/integ_test_small_csv_test_1
schema:
columns:
- column: id
mode: NULLABLE
type: INT64
- column: name
mode: NULLABLE
type: STRING
- column: type
mode: NULLABLE
type: STRING
sourceSystemTimestamps:
createTime: '2019-08-16T01:49:06.235Z'
updateTime: '2020-02-04T17:18:17.671Z'
type: FILESET
{code}
> SQL PostCommit failure: ClassCastException: java.lang.Integer cannot be cast
> to java.lang.Long
> ----------------------------------------------------------------------------------------------
>
> Key: BEAM-9253
> URL: https://issues.apache.org/jira/browse/BEAM-9253
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Tomo Suzuki
> Assignee: Brian Hulette
> Priority: Major
> Fix For: 2.20.0
>
> Attachments: VarLongCoder_is_applied_Integer.png
>
>
> SQL Postcommit check started failing since build number 3924. The first
> failure: https://builds.apache.org/job/beam_PostCommit_SQL/3924/
> {noformat}
> org.apache.beam.sdk.extensions.sql.meta.provider.datacatalog.DataCatalogGCSIT.testReadFromGCS
> java.lang.ClassCastException: java.lang.Integer cannot be cast to
> java.lang.Long
> at org.apache.beam.sdk.coders.VarLongCoder.encode(VarLongCoder.java:35)
> at
> org.apache.beam.sdk.coders.RowCoderGenerator$EncodeInstruction.encodeDelegate(RowCoderGenerator.java:239)
> at org.apache.beam.sdk.coders.Coder$ByteBuddy$WZzHUNls.encode(Unknown
> Source)
> at org.apache.beam.sdk.coders.Coder$ByteBuddy$WZzHUNls.encode(Unknown
> Source)
> at org.apache.beam.sdk.schemas.SchemaCoder.encode(SchemaCoder.java:166)
> at
> org.apache.beam.sdk.coders.IterableLikeCoder.encode(IterableLikeCoder.java:98)
> {noformat}
> History: https://builds.apache.org/job/beam_PostCommit_SQL/
> Pull request before the failure:
> https://github.com/apache/beam/pull/10563#issuecomment-582384925
> DataCatalogGCSIT does not run locally:
> https://gist.github.com/suztomo/43de4ff1f0458e801fef1a16a28da301
> DataCatalogGCSIT reads this Google Cloud Storage object:
> {code:java}
> String gcsEntryId =
> "`datacatalog`" // this is part of the resource name in DataCatalog,
> so it has to be
> + ".`entry`" // different from the table provider name ("dc" in
> this test)
> + ".`apache-beam-testing`"
> + ".`us-central1`"
> + ".`samples`"
> + ".`integ_test_small_csv_test_1`";
> {code}
> but I cannot see the content.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
