See <https://builds.apache.org/job/beam_PerformanceTests_Python/1121/display/redirect?page=changes>
Changes: [relax] Rename RowType -> Schema and move to new schemas package. [relax] Add classes for SchemaRegistry and SchemaProvider. [relax] Add SchemaCoder, some more detail in SchemaProvider/Registery, and [relax] Move Schema classes into SDK package. [relax] Integrate Schemas into PCollection Coder inference. [relax] Add setSchema convenience method. [relax] Fix compilation errors, tests, and CheckStyle. [relax] Add package-info.java for new schemas package. [relax] Refactor Schema: Schema now is a fully-specified based on primitive [relax] Make sure Schema class is serializable. [relax] Add BigEndingShortCoder to encode int16s. [relax] Cleanup types in Beam Schema. Add a metadata field to TypeDescriptor, so [relax] Make all SQL fields nullable for now. [relax] Add better type validation and conversion. Introduce FloatCoder. [relax] Use Beam's built-in BooleanCoder. [relax] Add coder mapping for DECIMAL. [relax] Fix BigEndianShortCoder [relax] Fix Array inference and capture. [relax] Don't use byte[] as the key of a map - Java arrays use object equality. [relax] Add equals and hashCode methods. [relax] Remove unused code. [relax] Fix handling of null values - Row was dropping them. [relax] Allow field description to be null. [relax] Fix array verification in Row. [relax] Move BeamSQL over to use joda time. [relax] Fix full outer join test. [relax] Add more unit tests for Row, Schema, and RowCoder. Fix a few issues [relax] Revert components that we are not ready to merge yet. These will [relax] Sync ParDoTranslation to master. [relax] Add license header. [relax] Fix row size estimation. [relax] Address code-review comments. [relax] Add RowSqlTypes. [relax] Make variables final and fix unused imports. [relax] Fix RowCoderTest. [relax] Delete bogus test. [relax] Fix timezone test. ------------------------------------------ [...truncated 59.67 KB...] [INFO] --- maven-resources-plugin:3.0.2:copy-resources (copy-go-cmd-source) @ beam-sdks-go --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 6 resources [INFO] [INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go --- [INFO] Reading assembly descriptor: descriptor.xml [INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip> [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go --- [INFO] [INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go --- [INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3 [INFO] [INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go --- [INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl [INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/beam/sdks/go/target/beamctl> [INFO] [INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go --- [INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl [INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/beam/sdks/go/target/linux_amd64/beamctl> [INFO] [INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go --- [INFO] [INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go --- [INFO] Prepared command line : bin/go test ./... [INFO] [INFO] ---------Exec.Out--------- [INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files] [INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files] [INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files] [INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files] [INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.024s [INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.087s [INFO] [ERROR] [ERROR] ---------Exec.Err--------- [ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx [ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication [ERROR] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Beam :: Parent .............................. SUCCESS [ 2.746 s] [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 1.959 s] [INFO] Apache Beam :: Model ............................... SUCCESS [ 0.037 s] [INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 5.808 s] [INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 2.950 s] [INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 3.752 s] [INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.182 s] [INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 22.311 s] [INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED [INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED [INFO] Apache Beam :: Runners ............................. SKIPPED [INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED [INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED [INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED [INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED [INFO] Apache Beam :: Examples ............................ SKIPPED [INFO] Apache Beam :: Examples :: Java .................... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED [INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED [INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED [INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED [INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED [INFO] Apache Beam :: Runners :: Reference ................ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED [INFO] Apache Beam :: Runners :: Flink .................... SKIPPED [INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED [INFO] Apache Beam :: Runners :: Spark .................... SKIPPED [INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 41.254 s [INFO] Finished at: 2018-04-08T12:02:41Z [INFO] Final Memory: 83M/1092M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :beam-sdks-go STDERR: 2018-04-08 12:02:41,617 a0497ef5 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark 2018-04-08 12:02:41,624 a0497ef5 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 624, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 527, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/beam/sdks/python/target> 2018-04-08 12:02:41,625 a0497ef5 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-04-08 12:02:41,626 a0497ef5 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 758, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 624, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 527, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/beam/sdks/python/target> 2018-04-08 12:02:41,626 a0497ef5 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-04-08 12:02:41,637 a0497ef5 MainThread INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-04-08 12:02:41,637 a0497ef5 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/pkb.log> 2018-04-08 12:02:41,637 a0497ef5 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a0497ef5/completion_statuses.json> Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected]
