See <https://builds.apache.org/job/beam_PerformanceTests_Python/1187/display/redirect?page=changes>
Changes: [Pablo] Python Metrics now rely on StateSampler state. [robertwb] [BEAM-4097] Set environment for Python sdk function specs. [robertwb] Logging around default docker image environment. ------------------------------------------ [...truncated 251.72 KB...] [INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @ beam-sdks-java-io-elasticsearch-tests-5 --- [INFO] Tests are skipped. [INFO] [INFO] --- build-helper-maven-plugin:3.0.0:regex-properties (render-artifact-id) @ beam-sdks-java-io-elasticsearch-tests-5 --- [INFO] [INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ beam-sdks-java-io-elasticsearch-tests-5 --- [INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/java/io/elasticsearch-tests/elasticsearch-tests-5/target/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT.jar> [INFO] [INFO] --- maven-site-plugin:3.7:attach-descriptor (attach-descriptor) @ beam-sdks-java-io-elasticsearch-tests-5 --- [INFO] Skipping because packaging 'jar' is not pom. [INFO] [INFO] --- maven-jar-plugin:3.0.2:test-jar (default-test-jar) @ beam-sdks-java-io-elasticsearch-tests-5 --- [INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/java/io/elasticsearch-tests/elasticsearch-tests-5/target/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT-tests.jar> [INFO] [INFO] --- maven-shade-plugin:3.1.0:shade (bundle-and-repackage) @ beam-sdks-java-io-elasticsearch-tests-5 --- [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/java/io/elasticsearch-tests/elasticsearch-tests-5/target/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/java/io/elasticsearch-tests/elasticsearch-tests-5/target/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT-shaded.jar> [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/java/io/elasticsearch-tests/elasticsearch-tests-5/target/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT-tests.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/java/io/elasticsearch-tests/elasticsearch-tests-5/target/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT-shaded-tests.jar> [INFO] [INFO] --- maven-dependency-plugin:3.0.2:analyze-only (default) @ beam-sdks-java-io-elasticsearch-tests-5 --- [INFO] No dependency problems found [INFO] [INFO] --- maven-install-plugin:2.5.2:install (default-install) @ beam-sdks-java-io-elasticsearch-tests-5 --- [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/java/io/elasticsearch-tests/elasticsearch-tests-5/target/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-io-elasticsearch-tests-5/2.5.0-SNAPSHOT/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT.jar [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/java/io/elasticsearch-tests/elasticsearch-tests-5/pom.xml> to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-io-elasticsearch-tests-5/2.5.0-SNAPSHOT/beam-sdks-java-io-elasticsearch-tests-5-2.5.0-SNAPSHOT.pom [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Beam :: Parent .............................. SUCCESS [ 9.881 s] [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 6.198 s] [INFO] Apache Beam :: Model ............................... SUCCESS [ 0.165 s] [INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 18.446 s] [INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 7.539 s] [INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 8.611 s] [INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.370 s] [INFO] Apache Beam :: SDKs :: Go .......................... SUCCESS [ 54.686 s] [INFO] Apache Beam :: SDKs :: Go :: Container ............. SUCCESS [ 31.697 s] [INFO] Apache Beam :: SDKs :: Java ........................ SUCCESS [ 0.116 s] [INFO] Apache Beam :: SDKs :: Java :: Core ................ SUCCESS [ 34.721 s] [INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 3.633 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.039 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 3.716 s] [INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.067 s] [INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 5.166 s] [INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 5.855 s] [INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 8.574 s] [INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 7.763 s] [INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.052 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.947 s] [INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.585 s] [INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 10.820 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 2.789 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.747 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.584 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 2.112 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.849 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.611 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 1.850 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x FAILURE [ 3.342 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED [INFO] Apache Beam :: Examples ............................ SKIPPED [INFO] Apache Beam :: Examples :: Java .................... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED [INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED [INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED [INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED [INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED [INFO] Apache Beam :: Runners :: Reference ................ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED [INFO] Apache Beam :: Runners :: Flink .................... SKIPPED [INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED [INFO] Apache Beam :: Runners :: Spark .................... SKIPPED [INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED [INFO] Apache Beam :: Runners :: Extensions Java .......... SKIPPED [INFO] Apache Beam :: Runners :: Extensions Java :: Metrics SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 04:03 min [INFO] Finished at: 2018-04-24T12:05:16Z [INFO] Final Memory: 157M/1485M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-install-plugin:2.5.2:install (default-install) on project beam-sdks-java-io-elasticsearch-tests-5: Failed to install metadata org.apache.beam:beam-sdks-java-io-elasticsearch-tests-5/maven-metadata.xml: Could not parse metadata /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-io-elasticsearch-tests-5/maven-metadata-local.xml: in epilog non whitespace content is not allowed but got s (position: END_TAG seen ...</metadata>\ns... @12:2) -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :beam-sdks-java-io-elasticsearch-tests-5 STDERR: 2018-04-24 12:05:17,060 1d4cacfd MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark 2018-04-24 12:05:17,079 1d4cacfd MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 646, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/python/target> 2018-04-24 12:05:17,080 1d4cacfd MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-04-24 12:05:17,082 1d4cacfd MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 780, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 646, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/beam/sdks/python/target> 2018-04-24 12:05:17,082 1d4cacfd MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-04-24 12:05:17,126 1d4cacfd MainThread INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-04-24 12:05:17,127 1d4cacfd MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/pkb.log> 2018-04-24 12:05:17,128 1d4cacfd MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1d4cacfd/completion_statuses.json> Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected]
