See
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/76/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-3104] Set up state interfaces, wire into SDK harness client.
------------------------------------------
[...truncated 829.23 KB...]
Try downloading the file manually from the project website.
Then, install it using the command:
mvn install:install-file -DgroupId=cascading -DartifactId=cascading-hadoop
-Dversion=2.6.3 -Dpackaging=jar -Dfile=/path/to/file
Alternatively, if you host your own repository you can deploy the file there:
mvn deploy:deploy-file -DgroupId=cascading -DartifactId=cascading-hadoop
-Dversion=2.6.3 -Dpackaging=jar -Dfile=/path/to/file -Durl=[url]
-DrepositoryId=[id]
Path to dependency:
1)
org.apache.beam:beam-sdks-java-io-hadoop-input-format:jar:2.5.0-SNAPSHOT
2) org.elasticsearch:elasticsearch-hadoop:jar:5.0.0
3) cascading:cascading-hadoop:jar:2.6.3
cascading:cascading-hadoop:jar:2.6.3
from the specified remote repositories:
Nexus (http://repository.apache.org/snapshots, releases=false,
snapshots=true),
central (https://repo.maven.apache.org/maven2, releases=true, snapshots=false)
Downloading from central:
https://repo.maven.apache.org/maven2/cascading/cascading-local/2.6.3/cascading-local-2.6.3.jar
[WARNING] Could not find artifact cascading:cascading-local:jar:2.6.3 in
central (https://repo.maven.apache.org/maven2)
Try downloading the file manually from the project website.
Then, install it using the command:
mvn install:install-file -DgroupId=cascading -DartifactId=cascading-local
-Dversion=2.6.3 -Dpackaging=jar -Dfile=/path/to/file
Alternatively, if you host your own repository you can deploy the file there:
mvn deploy:deploy-file -DgroupId=cascading -DartifactId=cascading-local
-Dversion=2.6.3 -Dpackaging=jar -Dfile=/path/to/file -Durl=[url]
-DrepositoryId=[id]
Path to dependency:
1)
org.apache.beam:beam-sdks-java-io-hadoop-input-format:jar:2.5.0-SNAPSHOT
2) org.elasticsearch:elasticsearch-hadoop:jar:5.0.0
3) cascading:cascading-local:jar:2.6.3
cascading:cascading-local:jar:2.6.3
from the specified remote repositories:
Nexus (http://repository.apache.org/snapshots, releases=false,
snapshots=true),
central (https://repo.maven.apache.org/maven2, releases=true, snapshots=false)
[INFO] Adding ignore: module-info
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies)
@ beam-sdks-java-io-hadoop-input-format ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles)
@ beam-sdks-java-io-hadoop-input-format ---
[INFO]
[INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/src/main/resources>
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/classes>
[INFO]
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/src/main/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIO.java>:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/src/main/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIO.java>
uses unchecked or unsafe operations.
[INFO]
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/src/main/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIO.java>:
Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:3.0.2:testResources (default-testResources) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 13 source files to
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/test-classes>
[INFO]
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/src/test/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIOIT.java>:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/src/test/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIOIT.java>
uses or overrides a deprecated API.
[INFO]
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/src/test/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIOIT.java>:
Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @
beam-sdks-java-io-hadoop-input-format ---
Downloading from Nexus:
http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/maven-metadata.xml
Progress (1): 1.4 kB Downloaded from Nexus:
http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/maven-metadata.xml
(1.4 kB at 9.0 kB/s)
Downloading from Nexus:
http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/beam-sdks-java-build-tools-2.5.0-20180328.070237-25.pom
Progress (1): 2.3 kB Downloaded from Nexus:
http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/beam-sdks-java-build-tools-2.5.0-20180328.070237-25.pom
(2.3 kB at 14 kB/s)
Downloading from Nexus:
http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/beam-sdks-java-build-tools-2.5.0-20180328.070237-25.jar
Progress (1): 4.1/24 kBProgress (1): 7.8/24 kBProgress (1): 12/24 kB Progress
(1): 12/24 kBProgress (1): 17/24 kBProgress (1): 21/24 kBProgress (1): 24 kB
Downloaded from Nexus:
http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/beam-sdks-java-build-tools-2.5.0-20180328.070237-25.jar
(24 kB at 135 kB/s)
[INFO] Starting audit...
Audit done.
[INFO]
[INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- build-helper-maven-plugin:3.0.0:regex-properties
(render-artifact-id) @ beam-sdks-java-io-hadoop-input-format ---
[INFO]
[INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Building jar:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT.jar>
[INFO]
[INFO] --- maven-site-plugin:3.7:attach-descriptor (attach-descriptor) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Skipping because packaging 'jar' is not pom.
[INFO]
[INFO] --- maven-jar-plugin:3.0.2:test-jar (default-test-jar) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Building jar:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT-tests.jar>
[INFO]
[INFO] --- maven-shade-plugin:3.1.0:shade (bundle-and-repackage) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Excluding org.apache.beam:beam-sdks-java-core:jar:2.5.0-SNAPSHOT from
the shaded jar.
[INFO] Excluding com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1
from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.8.9 from the
shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.8.9 from
the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.8.9 from the
shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.8.2 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.7 from the shaded
jar.
[INFO] Excluding org.tukaani:xz:jar:1.5 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.4 from the shaded jar.
[INFO] Excluding joda-time:joda-time:jar:2.4 from the shaded jar.
[INFO] Including com.google.guava:guava:jar:19.0 in the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.25 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:3.0.1 from the shaded jar.
[INFO] Excluding
org.apache.beam:beam-sdks-java-io-hadoop-common:jar:2.5.0-SNAPSHOT from the
shaded jar.
[INFO] Excluding commons-logging:commons-logging:jar:1.1.3 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded
jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded
jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the
shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 from the
shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:3.2.0 from the shaded
jar.
[INFO] Excluding com.google.code.gson:gson:jar:2.2.4 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.16.1 from the shaded
jar.
[INFO] Excluding io.netty:netty-codec:jar:4.1.5.Final from the shaded jar.
[INFO] Excluding io.netty:netty-codec-http:jar:4.1.5.Final from the shaded jar.
[INFO] Excluding io.netty:netty-handler:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-transport:jar:4.1.5.Final from the shaded jar.
[INFO] Excluding io.dropwizard.metrics:metrics-core:jar:3.1.0 from the shaded
jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.0 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding
org.apache.beam:beam-runners-google-cloud-dataflow-java:jar:2.5.0-SNAPSHOT from
the shaded jar.
[INFO] Excluding
org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:jar:2.5.0-SNAPSHOT
from the shaded jar.
[INFO] Excluding com.google.cloud.bigdataoss:gcsio:jar:1.4.5 from the shaded
jar.
[INFO] Excluding
com.google.apis:google-api-services-cloudresourcemanager:jar:v1-rev6-1.22.0
from the shaded jar.
[INFO] Excluding
org.apache.beam:beam-sdks-java-io-google-cloud-platform:jar:2.5.0-SNAPSHOT from
the shaded jar.
[INFO] Excluding
org.apache.beam:beam-sdks-java-extensions-protobuf:jar:2.5.0-SNAPSHOT from the
shaded jar.
[INFO] Excluding io.grpc:grpc-core:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.errorprone:error_prone_annotations:jar:2.0.15 from
the shaded jar.
[INFO] Excluding io.grpc:grpc-context:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.instrumentation:instrumentation-api:jar:0.3.0 from
the shaded jar.
[INFO] Excluding
com.google.apis:google-api-services-bigquery:jar:v2-rev374-1.22.0 from the
shaded jar.
[INFO] Excluding com.google.api:gax-grpc:jar:0.20.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.api:api-common:jar:1.0.0-rc2 from the shaded jar.
[INFO] Excluding com.google.api:gax:jar:1.3.1 from the shaded jar.
[INFO] Excluding org.threeten:threetenbp:jar:1.3.3 from the shaded jar.
[INFO] Excluding com.google.cloud:google-cloud-core-grpc:jar:1.2.0 from the
shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java-util:jar:3.2.0 from the
shaded jar.
[INFO] Excluding com.google.apis:google-api-services-pubsub:jar:v1-rev10-1.22.0
from the shaded jar.
[INFO] Excluding com.google.api.grpc:grpc-google-cloud-pubsub-v1:jar:0.1.18
from the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-cloud-pubsub-v1:jar:0.1.18
from the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-iam-v1:jar:0.1.18 from the
shaded jar.
[INFO] Excluding com.google.cloud.datastore:datastore-v1-proto-client:jar:1.4.0
from the shaded jar.
[INFO] Excluding com.google.http-client:google-http-client-protobuf:jar:1.22.0
from the shaded jar.
[INFO] Excluding com.google.http-client:google-http-client-jackson:jar:1.22.0
from the shaded jar.
[INFO] Excluding com.google.cloud.datastore:datastore-v1-protos:jar:1.3.0 from
the shaded jar.
[INFO] Excluding com.google.api.grpc:grpc-google-common-protos:jar:0.1.9 from
the shaded jar.
[INFO] Excluding io.grpc:grpc-auth:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-netty:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.netty:netty-codec-http2:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-handler-proxy:jar:4.1.8.Final from the shaded
jar.
[INFO] Excluding io.netty:netty-codec-socks:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.grpc:grpc-stub:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-all:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-okhttp:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.squareup.okhttp:okhttp:jar:2.5.0 from the shaded jar.
[INFO] Excluding com.squareup.okio:okio:jar:1.6.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf-lite:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf-nano:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.protobuf.nano:protobuf-javanano:jar:3.0.0-alpha-5
from the shaded jar.
[INFO] Excluding com.google.cloud:google-cloud-core:jar:1.0.2 from the shaded
jar.
[INFO] Excluding org.json:json:jar:20160810 from the shaded jar.
[INFO] Excluding com.google.cloud:google-cloud-spanner:jar:0.20.0b-beta from
the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-cloud-spanner-v1:jar:0.1.11b
from the shaded jar.
[INFO] Excluding
com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:jar:0.1.11
from the shaded jar.
[INFO] Excluding com.google.api.grpc:grpc-google-cloud-spanner-v1:jar:0.1.11b
from the shaded jar.
[INFO] Excluding
com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:jar:0.1.11 from
the shaded jar.
[INFO] Excluding
com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:jar:0.1.11 from
the shaded jar.
[INFO] Excluding com.google.api.grpc:grpc-google-longrunning-v1:jar:0.1.11 from
the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-longrunning-v1:jar:0.1.11
from the shaded jar.
[INFO] Excluding com.google.cloud.bigtable:bigtable-protos:jar:1.0.0-pre3 from
the shaded jar.
[INFO] Excluding com.google.cloud.bigtable:bigtable-client-core:jar:1.0.0 from
the shaded jar.
[INFO] Excluding com.google.auth:google-auth-library-appengine:jar:0.7.0 from
the shaded jar.
[INFO] Excluding io.opencensus:opencensus-contrib-grpc-util:jar:0.7.0 from the
shaded jar.
[INFO] Excluding io.opencensus:opencensus-api:jar:0.7.0 from the shaded jar.
[INFO] Excluding io.netty:netty-tcnative-boringssl-static:jar:1.1.33.Fork26
from the shaded jar.
[INFO] Excluding
com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:jar:0.1.9 from
the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-common-protos:jar:0.1.9 from
the shaded jar.
[INFO] Excluding com.google.api-client:google-api-client:jar:1.22.0 from the
shaded jar.
[INFO] Excluding com.google.oauth-client:google-oauth-client:jar:1.22.0 from
the shaded jar.
[INFO] Excluding com.google.http-client:google-http-client:jar:1.22.0 from the
shaded jar.
[INFO] Excluding com.google.http-client:google-http-client-jackson2:jar:1.22.0
from the shaded jar.
[INFO] Excluding
com.google.apis:google-api-services-dataflow:jar:v1b3-rev221-1.22.0 from the
shaded jar.
[INFO] Excluding
com.google.apis:google-api-services-clouddebugger:jar:v2-rev8-1.22.0 from the
shaded jar.
[INFO] Excluding
com.google.apis:google-api-services-storage:jar:v1-rev71-1.22.0 from the shaded
jar.
[INFO] Excluding com.google.auth:google-auth-library-credentials:jar:0.7.1 from
the shaded jar.
[INFO] Excluding com.google.auth:google-auth-library-oauth2-http:jar:0.7.1 from
the shaded jar.
[INFO] Excluding com.google.cloud.bigdataoss:util:jar:1.4.5 from the shaded jar.
[INFO] Excluding com.google.api-client:google-api-client-java6:jar:1.22.0 from
the shaded jar.
[INFO] Excluding com.google.api-client:google-api-client-jackson2:jar:1.22.0
from the shaded jar.
[INFO] Excluding com.google.oauth-client:google-oauth-client-java6:jar:1.22.0
from the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT.jar>
with
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT-shaded.jar>
[INFO] Replacing original test artifact with shaded test artifact.
[INFO] Replacing
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT-tests.jar>
with
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT-shaded-tests.jar>
[INFO] Dependency-reduced POM written at:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/dependency-reduced-pom.xml>
[INFO]
[INFO] --- maven-failsafe-plugin:2.21.0:integration-test (default) @
beam-sdks-java-io-hadoop-input-format ---
[INFO] Failsafe report directory:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/beam/sdks/java/io/hadoop-input-format/target/failsafe-reports>
[INFO] parallel='all', perCoreThreadCount=true, threadCount=4,
useUnlimitedThreads=false, threadCountSuites=0, threadCountClasses=0,
threadCountMethods=0, parallelOptimized=true
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
STDERR:
2018-03-29 06:22:57,918 d6ac8476 MainThread beam_integration_benchmark(1/1)
ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 159, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-03-29 06:22:57,928 d6ac8476 MainThread beam_integration_benchmark(1/1)
INFO Cleaning up benchmark beam_integration_benchmark
2018-03-29 06:22:57,933 d6ac8476 MainThread beam_integration_benchmark(1/1)
INFO Running: kubectl
--kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-hadoopinputformatioit-1522300306871>
delete -f
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml>
2018-03-29 06:23:00,557 d6ac8476 MainThread beam_integration_benchmark(1/1)
ERROR Exception running benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 758, in RunBenchmarkTask
RunBenchmark(spec, collector)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 159, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-03-29 06:23:00,558 d6ac8476 MainThread beam_integration_benchmark(1/1)
ERROR Benchmark 1/1 beam_integration_benchmark (UID:
beam_integration_benchmark0) failed. Execution will continue.
2018-03-29 06:23:00,559 d6ac8476 MainThread beam_integration_benchmark(1/1)
INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed
Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-03-29 06:23:00,560 d6ac8476 MainThread beam_integration_benchmark(1/1)
INFO Complete logs can be found at:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/pkb.log>
2018-03-29 06:23:00,560 d6ac8476 MainThread beam_integration_benchmark(1/1)
INFO Completion statuses can be found at:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/d6ac8476/completion_statuses.json>
Build step 'Execute shell' marked build as failure
