Daniel Oliveira created BEAM-9459:
-------------------------------------
Summary: Go Postcommit failing at GBK
Key: BEAM-9459
URL: https://issues.apache.org/jira/browse/BEAM-9459
Project: Beam
Issue Type: Bug
Components: sdk-go, test-failures
Reporter: Daniel Oliveira
Assignee: Robert Burke
Example: [https://builds.apache.org/job/beam_PostCommit_Go_PR/106/]
[https://scans.gradle.com/s/es67rfaomu26m]
{noformat}
2020/03/06 00:47:41 Submitted job: 2020-03-05_16_47_40-13139296997856231782
2020/03/06 00:47:41 Submitted job: 2020-03-05_16_47_40-13139296997856231782
2020/03/06 00:47:41 Console:
https://console.cloud.google.com/dataflow/job/2020-03-05_16_47_40-13139296997856231782?project=apache-beam-testing
2020/03/06 00:47:41 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2020-03-05_16_47_40-13139296997856231782
...
2020/03/06 00:50:41 Test cogbk:cogbk failed: job
2020-03-05_16_47_40-13139296997856231782 failed{noformat}
And then in the console logs:
[https://pantheon.corp.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2020-03-05_16_47_40-13139296997856231782&minLogLevel=500&expandAll=false×tamp=2020-03-06T01:01:14.210000000Z&customFacets=&limitCustomFacetWidth=true&dateRangeStart=2020-03-06T00:01:14.460Z&dateRangeEnd=2020-03-06T01:01:14.460Z&interval=PT1H&scrollTimestamp=2020-03-06T00:49:14.413355915Z]
{noformat}
Error message from worker: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: Error received from SDK harness for instruction
-489: process bundle failed for instruction -489 using plan -446 : panic:
Unexpected coder:
CoGBK<string[string],int[varintz],int[varintz],string[string]> goroutine 87
[running]: runtime/debug.Stack(0xc0010ff970, 0xd2c5e0, 0xc00022e3d0)
/usr/lib/go-1.12/src/runtime/debug/stack.go:24 +0x9d
github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic.func1(0xc0010ffb90)
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/util.go:40
+0x60 panic(0xd2c5e0, 0xc00022e3d0) /usr/lib/go-1.12/src/runtime/panic.go:522
+0x1b5
github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.MakeElementEncoder(0xc0013dc460,
0xc0002466c0, 0xc000166000)
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/coder.go:91
+0x479
github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*PCollection).Up(0xc001313dd0,
0x10018e0, 0xc000268080, 0x0, 0xc0013f3b50)
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/pcollection.go:59
+0xfe
github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic(0x10018e0,
0xc000268080, 0xc0013f3c28, 0x0, 0x0)
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/util.go:43
+0x6c
github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0013e8000,
0x10018e0, 0xc000268080, 0xc000d14008, 0x4, 0xff0340, 0xc0002461e0, 0xff0380,
0xc0002680c0, 0xc0013f3de0, ...)
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/plan.go:93
+0xdf
github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001f4680,
0x10017a0, 0xc0001bafc0, 0xc00136d9c0, 0xc0001bafc0)
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:211
+0xa34
github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main.func2(0x10017a0,
0xc0001bafc0, 0xc00136d9c0)
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:118
+0x1cf created by
github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:131
+0x6e8
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:57)
org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.finish(RegisterAndProcessBundleOperation.java:332)
org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:85)
org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:125)
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:412)
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:381)
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:306)
org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:230)
org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:138)
Suppressed: java.lang.IllegalStateException: Already closed. at
org.apache.beam.sdk.fn.data.BeamFnDataSizeBasedBufferingOutboundObserver.close(BeamFnDataSizeBasedBufferingOutboundObserver.java:67)
at
org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:220)
at
org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:91)
...{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
