[ https://issues.apache.org/jira/browse/BEAM-9459?focusedWorklogId=398830&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-398830 ]
ASF GitHub Bot logged work on BEAM-9459: ---------------------------------------- Author: ASF GitHub Bot Created on: 06/Mar/20 01:15 Start Date: 06/Mar/20 01:15 Worklog Time Spent: 10m Work Description: lostluck commented on pull request #11061: [BEAM-9459] Revert "[BEAM-6374] Emit PCollection metrics from GoSDK" URL: https://github.com/apache/beam/pull/11061 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 398830) Remaining Estimate: 0h Time Spent: 10m > Go Postcommit failing at GBK > ---------------------------- > > Key: BEAM-9459 > URL: https://issues.apache.org/jira/browse/BEAM-9459 > Project: Beam > Issue Type: Bug > Components: sdk-go, test-failures > Reporter: Daniel Oliveira > Assignee: Robert Burke > Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Example: [https://builds.apache.org/job/beam_PostCommit_Go_PR/106/] > [https://scans.gradle.com/s/es67rfaomu26m] > > {noformat} > 2020/03/06 00:47:41 Submitted job: 2020-03-05_16_47_40-13139296997856231782 > 2020/03/06 00:47:41 Submitted job: 2020-03-05_16_47_40-13139296997856231782 > 2020/03/06 00:47:41 Console: > https://console.cloud.google.com/dataflow/job/2020-03-05_16_47_40-13139296997856231782?project=apache-beam-testing > 2020/03/06 00:47:41 Logs: > https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2020-03-05_16_47_40-13139296997856231782 > ... > 2020/03/06 00:50:41 Test cogbk:cogbk failed: job > 2020-03-05_16_47_40-13139296997856231782 failed{noformat} > And then in the console logs: > [https://pantheon.corp.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2020-03-05_16_47_40-13139296997856231782&minLogLevel=500&expandAll=false×tamp=2020-03-06T01:01:14.210000000Z&customFacets=&limitCustomFacetWidth=true&dateRangeStart=2020-03-06T00:01:14.460Z&dateRangeEnd=2020-03-06T01:01:14.460Z&interval=PT1H&scrollTimestamp=2020-03-06T00:49:14.413355915Z] > > {code:java} > exception: "java.util.concurrent.ExecutionException: > java.lang.RuntimeException: Error received from SDK harness for instruction > -165: process bundle failed for instruction -165 using plan -122 : panic: > Unexpected coder: > CoGBK<string[string],int[varintz],int[varintz],string[string]> goroutine 81 > [running]: > runtime/debug.Stack(0xc001103970, 0xd2c5e0, 0xc000bd7f40) > /usr/lib/go-1.12/src/runtime/debug/stack.go:24 +0x9d > github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic.func1(0xc001103b90) > > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/util.go:40 > +0x60 > panic(0xd2c5e0, 0xc000bd7f40) > /usr/lib/go-1.12/src/runtime/panic.go:522 +0x1b5 > github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.MakeElementEncoder(0xc000b99cc0, > 0xc000aa4930, 0xc000b64a00) > > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/coder.go:91 > +0x479 > github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*PCollection).Up(0xc000af3dd0, > 0x10018e0, 0xc000b57f80, 0x0, 0xc000346b50) > > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/pcollection.go:59 > +0xfe > github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic(0x10018e0, > 0xc000b57f80, 0xc000346c28, 0x0, 0x0) > > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/util.go:43 > +0x6c > github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002623f0, > 0x10018e0, 0xc000b57f80, 0xc0002365a0, 0x4, 0xff0340, 0xc000aa4750, > 0xff0380, 0xc000b57fc0, 0xc000346de0, ...) > > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/plan.go:93 > +0xdf > github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001f4680, > 0x10017a0, 0xc0001bafc0, 0xc000b57dc0, 0xc0001bafc0) > > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:211 > +0xa34 > github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main.func2(0x10017a0, > 0xc0001bafc0, 0xc000b57dc0) > > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:118 > +0x1cf > created by > github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main > > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:131 > +0x6e8 > at > java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) > at > java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) > at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:57) > at > org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.finish(RegisterAndProcessBundleOperation.java:332) > at > org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:85) > at > org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:125) > at > org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:412) > at > org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:381) > at > org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:306) > at > org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:230) > at > org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:138) > Suppressed: java.lang.IllegalStateException: Already closed. > at > org.apache.beam.sdk.fn.data.BeamFnDataSizeBasedBufferingOutboundObserver.close(BeamFnDataSizeBasedBufferingOutboundObserver.java:67) > at > org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:220) > at > org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:91) > ... 6 more > {code} > -- This message was sent by Atlassian Jira (v8.3.4#803005)