See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/1788/display/redirect>
------------------------------------------ [...truncated 589.31 KB...] File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing test_undeclared_side_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/coders/typecoders.py>:132: UserWarning: Using fallback coder for typehint: List[Any]. warnings.warn('Using fallback coder for typehint: %r.' % typehint) <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/coders/typecoders.py>:132: UserWarning: Using fallback coder for typehint: Union[]. warnings.warn('Using fallback coder for typehint: %r.' % typehint) DEPRECATION: pip install --download has been deprecated and will be removed in the future. Pip now has a download command that should be used instead. Collecting pyhamcrest (from -r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.9.0.tar.gz Collecting mock (from -r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz Collecting setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/setuptools-34.4.0.zip Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing test_as_list_and_as_dict_side_inputs (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok DEPRECATION: pip install --download has been deprecated and will be removed in the future. Pip now has a download command that should be used instead. Collecting pyhamcrest (from -r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.9.0.tar.gz Collecting mock (from -r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz Collecting setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/setuptools-34.4.0.zip Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing test_as_list_twice (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_as_dict_twice (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok DEPRECATION: pip install --download has been deprecated and will be removed in the future. Pip now has a download command that should be used instead. DEPRECATION: pip install --download has been deprecated and will be removed in the future. Pip now has a download command that should be used instead. Collecting pyhamcrest (from -r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.9.0.tar.gz Collecting pyhamcrest (from -r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.9.0.tar.gz Collecting mock (from -r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz Collecting mock (from -r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz Collecting setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) Collecting setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/setuptools-34.4.0.zip File was already downloaded /tmp/dataflow-requirements-cache/setuptools-34.4.0.zip Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing test_as_singleton_with_different_defaults (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok DEPRECATION: pip install --download has been deprecated and will be removed in the future. Pip now has a download command that should be used instead. Collecting pyhamcrest (from -r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.9.0.tar.gz Collecting mock (from -r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz Collecting setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/setuptools-34.4.0.zip Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing test_empty_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok DEPRECATION: pip install --download has been deprecated and will be removed in the future. Pip now has a download command that should be used instead. Collecting pyhamcrest (from -r postcommit_requirements.txt (line 1)) <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py>:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning. SNIMissingWarning <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py>:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning. InsecurePlatformWarning File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.9.0.tar.gz Collecting mock (from -r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz Collecting setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/setuptools-34.4.0.zip Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cache/pbr-2.0.0.tar.gz Collecting packaging>=16.8 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/packaging-16.8.tar.gz Collecting appdirs>=1.4.0 (from setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/appdirs-1.4.3.tar.gz Collecting pyparsing (from packaging>=16.8->setuptools->pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded /tmp/dataflow-requirements-cache/pyparsing-2.2.0.tar.gz Successfully downloaded pyhamcrest mock setuptools six funcsigs pbr packaging appdirs pyparsing test_as_singleton_without_unique_labels (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_default_value_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_flattened_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_iterable_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok ---------------------------------------------------------------------- Ran 13 tests in 1270.633s OK Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_10_32-709509665509559858?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_15_39-618571055530633499?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_20_55-6295064732076851448?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_25_51-12551615397845423667?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_10_31-3131284499963341315?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_15_38-7550590478461249246?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_20_39-10872609982457584223?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_10_32-14070507756605612244?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_16_08-9311130690192050586?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_21_49-1495083383017694121?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_10_31-8255085050852155121?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_15_44-17968173629738639572?project=apache-beam-testing Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_20_55-6714392606310153174?project=apache-beam-testing # Run integration tests on the Google Cloud Dataflow service # and validate that jobs finish successfully. echo ">>> RUNNING TEST DATAFLOW RUNNER it tests" >>> RUNNING TEST DATAFLOW RUNNER it tests python setup.py nosetests \ --attr IT \ --nocapture \ --processes=4 \ --process-timeout=600 \ --test-pipeline-options=" \ --runner=TestDataflowRunner \ --project=$PROJECT \ --staging_location=$GCS_LOCATION/staging-it \ --temp_location=$GCS_LOCATION/temp-it \ --output=$GCS_LOCATION/py-it-cloud/output \ --sdk_location=$SDK_LOCATION \ --num_workers=1 \ --sleep_secs=20" <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/local/lib/python2.7/site-packages/setuptools/dist.py>:334: UserWarning: Normalizing '0.7.0.dev' to '0.7.0.dev0' normalized_version, running nosetests running egg_info writing requirements to apache_beam.egg-info/requires.txt writing apache_beam.egg-info/PKG-INFO writing top-level names to apache_beam.egg-info/top_level.txt writing dependency_links to apache_beam.egg-info/dependency_links.txt writing entry points to apache_beam.egg-info/entry_points.txt reading manifest file 'apache_beam.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' writing manifest file 'apache_beam.egg-info/SOURCES.txt' <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/coders/typecoders.py>:132: UserWarning: Using fallback coder for typehint: Any. warnings.warn('Using fallback coder for typehint: %r.' % typehint) <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/coders/typecoders.py>:132: UserWarning: Using fallback coder for typehint: Dict[Any, Any]. warnings.warn('Using fallback coder for typehint: %r.' % typehint) <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/coders/typecoders.py>:132: UserWarning: Using fallback coder for typehint: Any. warnings.warn('Using fallback coder for typehint: %r.' % typehint) <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/io/gcp/gcsio.py>:110: DeprecationWarning: object() takes no parameters super(GcsIO, cls).__new__(cls, storage_client)) <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/runners/dataflow/dataflow_metrics.py>:109: UserWarning: Distribution metrics will be ignored in the MetricsResult.querymethod. You can see them in the Dataflow User Interface. warn('Distribution metrics will be ignored in the MetricsResult.query' test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_31_29-3165794589301880638?project=apache-beam-testing test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ERROR ====================================================================== ERROR: test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py",> line 812, in run test(orig) File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/nose-1.3.7-py2.7.egg/nose/case.py",> line 45, in __call__ return self.run(*arg, **kwarg) File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/nose-1.3.7-py2.7.egg/nose/case.py",> line 133, in run self.runTest(result) File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/nose-1.3.7-py2.7.egg/nose/case.py",> line 151, in runTest test(result) File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__ return self.run(*args, **kwds) File "/usr/lib/python2.7/unittest/case.py", line 331, in run testMethod() File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py",> line 61, in test_bigquery_tornadoes_it test_pipeline.get_full_options_as_args(**extra_opts)) File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes.py",> line 94, in run p.run().wait_until_finish() File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/pipeline.py",> line 169, in run return self.runner.run(self) File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 48, in run self.result.wait_until_finish() File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 714, in wait_until_finish time.sleep(5.0) File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py",> line 276, in signalhandler raise TimedOutException() TimedOutException: 'test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT)' ---------------------------------------------------------------------- Ran 2 tests in 600.788s FAILED (errors=1) Found: https://console.cloud.google.com/dataflow/job/2017-04-08_02_31_30-2553102809186096930?project=apache-beam-testing Build step 'Execute shell' marked build as failure