See <https://builds.apache.org/job/beam_PerformanceTests_Python/1056/display/redirect?page=changes>
Changes: [alex] Correct BigQuery.write JavaDoc example [ccy] Replace side inputs when applying PTransformOverrides [Pablo] Updating dataflow API protocol buffers. [altay] Convert big query writes to beam.io.WriteToBigQuery [altay] More graceful fallback when grpc is not present. ------------------------------------------ [...truncated 61.31 KB...] [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 212 resources [INFO] [INFO] --- maven-resources-plugin:3.0.2:copy-resources (copy-go-cmd-source) @ beam-sdks-go --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 6 resources [INFO] [INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go --- [INFO] Reading assembly descriptor: descriptor.xml [INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip> [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go --- [INFO] [INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go --- [INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3 [INFO] [INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go --- [INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl [INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/beam/sdks/go/target/beamctl> [INFO] [INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go --- [INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl [INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/beam/sdks/go/target/linux_amd64/beamctl> [INFO] [INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go --- [INFO] [INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go --- [INFO] Prepared command line : bin/go test ./... [INFO] [INFO] ---------Exec.Out--------- [INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files] [INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files] [INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files] [INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files] [INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.016s [INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.127s [INFO] [ERROR] [ERROR] ---------Exec.Err--------- [ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx [ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication [ERROR] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Beam :: Parent .............................. SUCCESS [ 8.356 s] [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 4.746 s] [INFO] Apache Beam :: Model ............................... SUCCESS [ 0.113 s] [INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 8.900 s] [INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 3.600 s] [INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 4.138 s] [INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.143 s] [INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 24.217 s] [INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED [INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED [INFO] Apache Beam :: Runners ............................. SKIPPED [INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED [INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED [INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED [INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED [INFO] Apache Beam :: Examples ............................ SKIPPED [INFO] Apache Beam :: Examples :: Java .................... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED [INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED [INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED [INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED [INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED [INFO] Apache Beam :: Runners :: Reference ................ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED [INFO] Apache Beam :: Runners :: Flink .................... SKIPPED [INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED [INFO] Apache Beam :: Runners :: Spark .................... SKIPPED [INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 57.520 s [INFO] Finished at: 2018-03-23T06:01:59Z [INFO] Final Memory: 84M/1196M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :beam-sdks-go STDERR: 2018-03-23 06:01:59,631 60f42ba9 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark 2018-03-23 06:01:59,639 60f42ba9 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/beam/sdks/python/target> 2018-03-23 06:01:59,640 60f42ba9 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-03-23 06:01:59,641 60f42ba9 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 754, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/beam/sdks/python/target> 2018-03-23 06:01:59,642 60f42ba9 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-03-23 06:01:59,642 60f42ba9 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-03-23 06:01:59,642 60f42ba9 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/pkb.log> 2018-03-23 06:01:59,642 60f42ba9 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/60f42ba9/completion_statuses.json> Build step 'Execute shell' marked build as failure Not sending mail to unregistered user samu...@google.com Not sending mail to unregistered user grzegorz.kolakow...@getindata.com Not sending mail to unregistered user aljoscha.kret...@gmail.com Not sending mail to unregistered user joey.bar...@gmail.com Not sending mail to unregistered user arnaudfournier...@gmail.com Not sending mail to unregistered user sdus...@google.com Not sending mail to unregistered user arost...@google.com Not sending mail to unregistered user lukasz.gaj...@polidea.com Not sending mail to unregistered user zhouha...@meituan.com Not sending mail to unregistered user wtan...@yahoo.com Not sending mail to unregistered user yifan...@yifanzou-linuxworkstation.sea.corp.google.com Not sending mail to unregistered user wi...@bounceexchange.com Not sending mail to unregistered user apill...@google.com Not sending mail to unregistered user w...@google.com Not sending mail to unregistered user k...@google.com Not sending mail to unregistered user andreas.ehrencr...@velik.it Not sending mail to unregistered user xumingmi...@gmail.com Not sending mail to unregistered user ccla...@bluewin.ch Not sending mail to unregistered user luke_...@brown.edu Not sending mail to unregistered user mott...@gmail.com Not sending mail to unregistered user kirpic...@google.com Not sending mail to unregistered user mari...@mariagh.svl.corp.google.com Not sending mail to unregistered user z...@giggles.nyc.corp.google.com Not sending mail to unregistered user g...@telligent-data.com Not sending mail to unregistered user boyu...@google.com Not sending mail to unregistered user rob...@frantil.com Not sending mail to unregistered user 1028332...@qq.com Not sending mail to unregistered user bat...@batbat-linuxworkstation.sea.corp.google.com Not sending mail to unregistered user alan.myrv...@comcast.net Not sending mail to unregistered user jiang...@gmail.com Not sending mail to unregistered user meliss...@google.com Not sending mail to unregistered user fjetum...@gmail.com Not sending mail to unregistered user ekirpic...@gmail.com Not sending mail to unregistered user git...@alasdairhodge.co.uk Not sending mail to unregistered user j...@nanthrax.net Not sending mail to unregistered user ro...@frantil.com Not sending mail to unregistered user axelm...@gmail.com Not sending mail to unregistered user pawel.pk.kaczmarc...@gmail.com Not sending mail to unregistered user mair...@google.com Not sending mail to unregistered user ni...@google.com Not sending mail to unregistered user abhyan...@gmail.com Not sending mail to unregistered user sid...@google.com Not sending mail to unregistered user aal...@gmail.com Not sending mail to unregistered user ankurgoe...@gmail.com Not sending mail to unregistered user c...@google.com Not sending mail to unregistered user dcava...@google.com Not sending mail to unregistered user dariusz.aniszew...@polidea.com Not sending mail to unregistered user samuel.waggo...@healthsparq.com Not sending mail to unregistered user sweg...@google.com Not sending mail to unregistered user amyrv...@google.com Not sending mail to unregistered user ke...@google.com Not sending mail to unregistered user arnaudfournier...@gmail.com Not sending mail to unregistered user eh...@google.com Not sending mail to unregistered user holdenka...@google.com Not sending mail to unregistered user mark...@google.com Not sending mail to unregistered user aromanenko....@gmail.com Not sending mail to unregistered user xuming...@users.noreply.github.com Not sending mail to unregistered user daniel.o.program...@gmail.com Not sending mail to unregistered user hero...@google.com Not sending mail to unregistered user mari...@google.com