See <https://builds.apache.org/job/beam_PerformanceTests_JDBC/178/display/redirect>
------------------------------------------ [...truncated 25.39 KB...] [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/target/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/target/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-shaded.jar> [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/target/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-tests.jar> with <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/target/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-shaded-tests.jar> [INFO] Dependency-reduced POM written at: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/dependency-reduced-pom.xml> [INFO] [INFO] --- maven-failsafe-plugin:2.20:integration-test (integration-test) @ beam-runners-google-cloud-dataflow-java --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-dependency-plugin:3.0.1:analyze-only (default) @ beam-runners-google-cloud-dataflow-java --- [INFO] No dependency problems found [INFO] [INFO] --- maven-failsafe-plugin:2.20:verify (integration-test) @ beam-runners-google-cloud-dataflow-java --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-install-plugin:2.5.2:install (default-install) @ beam-runners-google-cloud-dataflow-java --- [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/target/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-runners-google-cloud-dataflow-java/2.2.0-SNAPSHOT/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT.jar [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/dependency-reduced-pom.xml> to /home/jenkins/.m2/repository/org/apache/beam/beam-runners-google-cloud-dataflow-java/2.2.0-SNAPSHOT/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT.pom [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/target/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-tests.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-runners-google-cloud-dataflow-java/2.2.0-SNAPSHOT/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-tests.jar [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/target/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-tests.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-runners-google-cloud-dataflow-java/2.2.0-SNAPSHOT/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-tests.jar [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 26.321 s [INFO] Finished at: 2017-08-07T18:00:40Z [INFO] Final Memory: 89M/1411M [INFO] ------------------------------------------------------------------------ [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins2744017141073883742.sh + /home/jenkins/tools/maven/latest/bin/mvn -B -e verify -pl sdks/java/io/jdbc -Dio-it-suite -DpkbLocation=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/pkb.py> -DmvnBinary=/home/jenkins/tools/maven/latest/bin/mvn '-DintegrationTestPipelineOptions=[ "--project=apache-beam-testing", "--tempRoot=gs://temp-storage-for-end-to-end-tests" ]' [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [INFO] ------------------------------------------------------------------------ [INFO] Detecting the operating system and CPU architecture [INFO] ------------------------------------------------------------------------ [INFO] os.detected.name: linux [INFO] os.detected.arch: x86_64 [INFO] os.detected.version: 3.19 [INFO] os.detected.version.major: 3 [INFO] os.detected.version.minor: 19 [INFO] os.detected.release: ubuntu [INFO] os.detected.release.version: 14.04 [INFO] os.detected.release.like.ubuntu: true [INFO] os.detected.release.like.debian: true [INFO] os.detected.classifier: linux-x86_64 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Beam :: SDKs :: Java :: IO :: JDBC 2.2.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- groovy-maven-plugin:2.0:execute (find-supported-python-for-compile) @ beam-sdks-java-io-jdbc --- [INFO] Using python interpreter binary 'python2.7' with pip 'pip2.7' [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @ beam-sdks-java-io-jdbc --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/src/main/resources> [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.6.2:compile (default-compile) @ beam-sdks-java-io-jdbc --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 2 source files to <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/classes> [WARNING] bootstrap class path not set in conjunction with -source 1.7 [INFO] [INFO] --- maven-resources-plugin:3.0.2:testResources (default-testResources) @ beam-sdks-java-io-jdbc --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/src/test/resources> [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.6.2:testCompile (default-testCompile) @ beam-sdks-java-io-jdbc --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/test-classes> [INFO] [INFO] --- maven-checkstyle-plugin:2.17:check (default) @ beam-sdks-java-io-jdbc --- [INFO] Starting audit... Audit done. [INFO] [INFO] --- maven-surefire-plugin:2.20:test (default-test) @ beam-sdks-java-io-jdbc --- [INFO] Tests are skipped. [INFO] [INFO] --- build-helper-maven-plugin:3.0.0:regex-properties (render-artifact-id) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ beam-sdks-java-io-jdbc --- [INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT.jar> [INFO] [INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- maven-jar-plugin:3.0.2:test-jar (default-test-jar) @ beam-sdks-java-io-jdbc --- [INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT-tests.jar> [INFO] [INFO] --- maven-shade-plugin:3.0.0:shade (bundle-and-repackage) @ beam-sdks-java-io-jdbc --- [INFO] Excluding org.apache.beam:beam-sdks-java-core:jar:2.2.0-SNAPSHOT from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.8.9 from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.8.9 from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.8.9 from the shaded jar. [INFO] Excluding org.apache.avro:avro:jar:1.8.2 from the shaded jar. [INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar. [INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 from the shaded jar. [INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.7 from the shaded jar. [INFO] Excluding org.apache.commons:commons-compress:jar:1.14 from the shaded jar. [INFO] Excluding org.tukaani:xz:jar:1.5 from the shaded jar. [INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.4-M3 from the shaded jar. [INFO] Excluding joda-time:joda-time:jar:2.4 from the shaded jar. [INFO] Including com.google.guava:guava:jar:20.0 in the shaded jar. [INFO] Excluding com.google.code.findbugs:jsr305:jar:3.0.1 from the shaded jar. [INFO] Excluding org.apache.commons:commons-dbcp2:jar:2.1.1 from the shaded jar. [INFO] Excluding org.apache.commons:commons-pool2:jar:2.4.2 from the shaded jar. [INFO] Excluding commons-logging:commons-logging:jar:1.2 from the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT-shaded.jar> [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT-tests.jar> with <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT-shaded-tests.jar> [INFO] Dependency-reduced POM written at: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/dependency-reduced-pom.xml> [INFO] [INFO] --- maven-dependency-plugin:3.0.1:analyze-only (default) @ beam-sdks-java-io-jdbc --- [INFO] No dependency problems found [INFO] [INFO] --- exec-maven-plugin:1.6.0:exec (default) @ beam-sdks-java-io-jdbc --- WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory. 2017-08-07 18:01:07,753 b53b98d9 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b53b98d9/pkb.log 2017-08-07 18:01:07,754 b53b98d9 MainThread INFO PerfKitBenchmarker version: v1.12.0-94-g8c7b5a4 2017-08-07 18:01:07,754 b53b98d9 MainThread INFO Flag values: --beam_it_class=org.apache.beam.sdk.io.jdbc.JdbcIOIT --beam_sdk=java --beam_it_options=[ "--project=apache-beam-testing", "--tempRoot=gs://temp-storage-for-end-to-end-tests" ] --beam_prebuilt --kubeconfig=/home/jenkins/.kube/config --kubectl=kubectl --beam_kubernetes_scripts=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.test-infra/kubernetes/postgres/postgres.yml> --beam_it_module=sdks/java/io/jdbc --beam_options_config_file=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.test-infra/kubernetes/postgres/pkb-config.yml> --beam_location=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/> --beam_it_profile=io-it --benchmarks=beam_integration_benchmark 2017-08-07 18:01:07,962 b53b98d9 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo. 2017-08-07 18:01:08,060 b53b98d9 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark 2017-08-07 18:01:08,063 b53b98d9 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark 2017-08-07 18:01:08,063 b53b98d9 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=/home/jenkins/.kube/config create -f <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.test-infra/kubernetes/postgres/postgres.yml> 2017-08-07 18:01:08,069 b53b98d9 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 555, in RunBenchmark DoPreparePhase(spec, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 450, in DoPreparePhase spec.BenchmarkPrepare(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 109, in Prepare kubernetes_helper.CreateAllFiles(getKubernetesScripts()) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/kubernetes_helper.py",> line 54, in CreateAllFiles CreateFromFile(file) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/kubernetes_helper.py",> line 37, in CreateFromFile return vm_util.IssueCommand(create_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 294, in IssueCommand stderr=tf_err, cwd=cwd) File "/usr/lib/python2.7/subprocess.py", line 710, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory 2017-08-07 18:01:08,070 b53b98d9 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2017-08-07 18:01:08,070 b53b98d9 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=/home/jenkins/.kube/config delete -f <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.test-infra/kubernetes/postgres/postgres.yml> 2017-08-07 18:01:08,075 b53b98d9 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2017-08-07 18:01:08,100 b53b98d9 MainThread INFO Benchmark run statuses: --------------------------------------------------------------- Name UID Status --------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------- Success rate: 0.00% (0/1) 2017-08-07 18:01:08,101 b53b98d9 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b53b98d9/pkb.log 2017-08-07 18:01:08,101 b53b98d9 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/b53b98d9/completion_statuses.json [ERROR] Command execution failed. org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:804) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:751) at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:313) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:993) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:345) at org.apache.maven.cli.MavenCli.main(MavenCli.java:191) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 17.337 s [INFO] Finished at: 2017-08-07T18:01:08Z [INFO] Final Memory: 76M/1159M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:exec (default) on project beam-sdks-java-io-jdbc: Command execution failed. Process exited with an error: 1 (Exit value: 1) -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:exec (default) on project beam-sdks-java-io-jdbc: Command execution failed. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:993) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:345) at org.apache.maven.cli.MavenCli.main(MavenCli.java:191) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed. at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:326) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) ... 20 more Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:804) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:751) at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:313) ... 22 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException Build step 'Execute shell' marked build as failure