See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/2610/display/redirect>
Changes: ------------------------------------------ [...truncated 334.93 KB...] #9 84.73 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.5/2.5 MB 4.2 MB/s eta 0:00:00 #9 84.78 Downloading soupsieve-2.5-py3-none-any.whl (36 kB) #9 84.83 Downloading SQLAlchemy-1.4.51-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB) #9 85.22 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 4.3 MB/s eta 0:00:00 #9 85.26 Downloading tenacity-8.2.3-py3-none-any.whl (24 kB) #9 85.32 Downloading threadpoolctl-3.2.0-py3-none-any.whl (15 kB) #9 85.37 Downloading tqdm-4.66.1-py3-none-any.whl (78 kB) #9 85.39 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.3/78.3 kB 3.9 MB/s eta 0:00:00 #9 85.44 Downloading typing_extensions-4.9.0-py3-none-any.whl (32 kB) #9 85.49 Downloading tzdata-2023.4-py2.py3-none-any.whl (346 kB) #9 85.58 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 346.6/346.6 kB 4.1 MB/s eta 0:00:00 #9 85.62 Downloading tzlocal-5.2-py3-none-any.whl (17 kB) #9 85.68 Downloading urllib3-2.1.0-py3-none-any.whl (104 kB) #9 85.71 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 kB 3.8 MB/s eta 0:00:00 #9 85.75 Downloading wrapt-1.16.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (83 kB) #9 85.78 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.4/83.4 kB 2.9 MB/s eta 0:00:00 #9 85.83 Downloading zipp-3.17.0-py3-none-any.whl (7.4 kB) #9 85.88 Downloading zstandard-0.22.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) #9 87.06 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 4.6 MB/s eta 0:00:00 #9 87.78 Building wheels for collected packages: bs4, crcmod, dill, docopt, future, google-apitools, google-cloud-profiler, hdfs, pyjsparser #9 87.78 Building wheel for bs4 (setup.py): started #9 88.16 Building wheel for bs4 (setup.py): finished with status 'done' #9 88.16 Created wheel for bs4: filename=bs4-0.0.1-py3-none-any.whl size=1256 sha256=c0a1ab4b7fa46d2173f64732a752231c0a760f7dc6bbaa7f1ecb4f16267e56b4 #9 88.16 Stored in directory: /root/.cache/pip/wheels/75/78/21/68b124549c9bdc94f822c02fb9aa3578a669843f9767776bca #9 88.16 Building wheel for crcmod (setup.py): started #9 88.94 Building wheel for crcmod (setup.py): finished with status 'done' #9 88.94 Created wheel for crcmod: filename=crcmod-1.7-cp38-cp38-linux_x86_64.whl size=30354 sha256=f8ebce4115426539716f7de476fd59b397afeabe96c10ba8d88b949abd086e2c #9 88.94 Stored in directory: /root/.cache/pip/wheels/ca/5a/02/f3acf982a026f3319fb3e798a8dca2d48fafee7761788562e9 #9 88.95 Building wheel for dill (setup.py): started #9 89.33 Building wheel for dill (setup.py): finished with status 'done' #9 89.33 Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl size=78540 sha256=6f1ce5e5adfcae6f749eaf825830c893b12cf127fd4db058017b829434f68fc9 #9 89.33 Stored in directory: /root/.cache/pip/wheels/07/35/78/e9004fa30578734db7f10e7a211605f3f0778d2bdde38a239d #9 89.34 Building wheel for docopt (setup.py): started #9 89.68 Building wheel for docopt (setup.py): finished with status 'done' #9 89.68 Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13706 sha256=bc0d6b50fd8ac0b1b578d9ac506054381f8771a1d973f1092fcf2879657888d3 #9 89.68 Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c #9 89.69 Building wheel for future (setup.py): started #9 90.39 Building wheel for future (setup.py): finished with status 'done' #9 90.40 Created wheel for future: filename=future-0.18.3-py3-none-any.whl size=492024 sha256=96fddb3fce1f7d8a871a4a9d86f160824eac9c417e3e1e7fa3bcacf1cb2a469b #9 90.40 Stored in directory: /root/.cache/pip/wheels/a0/0b/ee/e6994fadb42c1354dcccb139b0bf2795271bddfe6253ccdf11 #9 90.41 Building wheel for google-apitools (setup.py): started #9 90.83 Building wheel for google-apitools (setup.py): finished with status 'done' #9 90.83 Created wheel for google-apitools: filename=google_apitools-0.5.31-py3-none-any.whl size=131015 sha256=d154090b3bd16a19578cc8d785bf5da40a9849eb781835089f2f4cf0c41a1c1f #9 90.83 Stored in directory: /root/.cache/pip/wheels/d7/54/79/85de1824f2f4175fb4960c72afb10045d86700c3941dc73685 #9 90.84 Building wheel for google-cloud-profiler (setup.py): started #9 95.96 Building wheel for google-cloud-profiler (setup.py): finished with status 'done' #9 95.96 Created wheel for google-cloud-profiler: filename=google_cloud_profiler-4.1.0-cp38-cp38-linux_x86_64.whl size=757604 sha256=5cfde2c9a7b1778dea248f169c2315023191c2640ef553e16b07b4f5c4f9e327 #9 95.96 Stored in directory: /root/.cache/pip/wheels/d8/ea/24/cc27c8bac7ab0d8bf54c06eed3a4849cefc4c17cf8e6570ec4 #9 95.97 Building wheel for hdfs (setup.py): started #9 96.33 Building wheel for hdfs (setup.py): finished with status 'done' #9 96.33 Created wheel for hdfs: filename=hdfs-2.7.3-py3-none-any.whl size=34325 sha256=9f8fc23775f16002c5ff5f14cfdc52caffb3fa9ad7cdef3bee9413dbb1deca7a #9 96.33 Stored in directory: /root/.cache/pip/wheels/68/dd/29/c1a590238f9ebbe4f7ee9b3583f5185d0b9577e23f05c990eb #9 96.33 Building wheel for pyjsparser (setup.py): started #9 96.68 Building wheel for pyjsparser (setup.py): finished with status 'done' #9 96.68 Created wheel for pyjsparser: filename=pyjsparser-2.7.1-py3-none-any.whl size=25984 sha256=e6e93898fa8b9713ab4c8c6e8a5d7eed5e709921f3b14d7e30211471843a61dd #9 96.68 Stored in directory: /root/.cache/pip/wheels/d5/88/34/ccb5bb40eb3178a134eb293e6c363928c5bcfba0b91031db76 #9 96.69 Successfully built bs4 crcmod dill docopt future google-apitools google-cloud-profiler hdfs pyjsparser #9 96.69 Installing collected packages: sortedcontainers, requests-mock, pytz, python-snappy, pyjsparser, oauth2client, nose, mmh3, Js2Py, hdfs, google-cloud-profiler, google-auth-httplib2, docopt, deprecation, crcmod, bs4, zstandard, zipp, wrapt, urllib3, uritemplate, tzlocal, tzdata, typing_extensions, tqdm, tomli, threadpoolctl, testcontainers, tenacity, sqlparse, SQLAlchemy, soupsieve, six, shapely, scipy, scikit-learn, rsa, rpds-py, requests, regex, referencing, PyYAML, python-dateutil, pytest-xdist, pytest-timeout, pytest, pyproject_hooks, pyparsing, PyMySQL, pymongo, PyHamcrest, pydot, pycparser, pyasn1-modules, pyasn1, pyarrow-hotfix, pyarrow, psycopg2-binary, protobuf, proto-plus, pluggy, pkgutil_resolve_name, parameterized, pandas, packaging, overrides, orjson, objsize, numpy, nltk, mock, jsonschema-specifications, jsonschema, jsonpickle, joblib, iniconfig, importlib-resources, importlib-metadata, idna, hypothesis, httplib2, guppy3, grpcio-status, grpcio, grpc-google-iam-v1, greenlet, googleapis-common-protos, google-resumable-media, google-crc32c, google-cloud-vision, google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-aiplatform, google-auth, google-apitools, google-api-python-client, google-api-core, future, freezegun, fasteners, fastavro, execnet, exceptiongroup, docstring-parser, docker, dnspython, dill, Cython, cryptography, cloudpickle, click, charset-normalizer, cffi, certifi, cachetools, build, beautifulsoup4, backports.zoneinfo, attrs #9 136.1 Successfully installed Cython-0.29.37 Js2Py-0.74 PyHamcrest-2.1.0 PyMySQL-1.1.0 PyYAML-6.0.1 SQLAlchemy-1.4.51 attrs-23.2.0 backports.zoneinfo-0.2.1 beautifulsoup4-4.12.2 bs4-0.0.1 build-1.0.3 cachetools-5.3.2 certifi-2023.11.17 cffi-1.16.0 charset-normalizer-3.3.2 click-8.1.7 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.7 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-7.0.0 docopt-0.6.2 docstring-parser-0.15 exceptiongroup-1.2.0 execnet-2.0.2 fastavro-1.9.3 fasteners-0.19 freezegun-1.4.0 future-0.18.3 google-api-core-2.15.0 google-api-python-client-2.113.0 google-apitools-0.5.31 google-auth-2.26.1 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.39.0 google-cloud-bigquery-3.15.0 google-cloud-bigquery-storage-2.24.0 google-cloud-bigtable-2.22.0 google-cloud-core-2.4.1 google-cloud-datastore-2.19.0 google-cloud-dlp-3.14.0 google-cloud-language-2.12.0 google-cloud-profiler-4.1.0 google-cloud-pubsub-2.19.0 google-cloud-pubsublite-1.9.0 google-cloud-recommendations-ai-0.10.6 google-cloud-resource-manager-1.11.0 google-cloud-spanner-3.40.1 google-cloud-storage-2.14.0 google-cloud-videointelligence-2.12.0 google-cloud-vision-3.5.0 google-crc32c-1.5.0 google-resumable-media-2.7.0 googleapis-common-protos-1.62.0 greenlet-3.0.3 grpc-google-iam-v1-0.13.0 grpcio-1.60.0 grpcio-status-1.60.0 guppy3-3.1.4.post1 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.92.7 idna-3.6 importlib-metadata-7.0.1 importlib-resources-6.1.1 iniconfig-2.0.0 joblib-1.3.2 jsonpickle-3.0.2 jsonschema-4.20.0 jsonschema-specifications-2023.12.1 mmh3-4.1.0 mock-5.1.0 nltk-3.8.1 nose-1.3.7 numpy-1.24.4 oauth2client-4.1.3 objsize-0.7.0 orjson-3.9.10 overrides-7.4.0 packaging-23.2 pandas-2.0.3 parameterized-0.9.0 pkgutil_resolve_name-1.3.10 pluggy-1.3.0 proto-plus-1.23.0 protobuf-4.25.1 psycopg2-binary-2.9.9 pyarrow-14.0.2 pyarrow-hotfix-0.6 pyasn1-0.5.1 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyjsparser-2.7.1 pymongo-4.6.1 pyparsing-3.1.1 pyproject_hooks-1.0.0 pytest-7.4.4 pytest-timeout-2.2.0 pytest-xdist-3.5.0 python-dateutil-2.8.2 python-snappy-0.6.1 pytz-2023.3.post1 referencing-0.32.1 regex-2023.12.25 requests-2.31.0 requests-mock-1.11.0 rpds-py-0.16.2 rsa-4.9 scikit-learn-1.3.2 scipy-1.10.1 shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 soupsieve-2.5 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 tomli-2.0.1 tqdm-4.66.1 typing_extensions-4.9.0 tzdata-2023.4 tzlocal-5.2 uritemplate-4.1.1 urllib3-2.1.0 wrapt-1.16.0 zipp-3.17.0 zstandard-0.22.0 #9 136.1 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #9 140.0 [nltk_data] Downloading package stopwords to /root/nltk_data... #9 140.0 [nltk_data] Unzipping corpora/stopwords.zip. #9 140.3 Verified fast protobuf used. #9 142.8 Welcome to the Google Cloud CLI! #9 142.9 WARNING: You appear to be running this script as root. This may cause #9 142.9 the installation to be inaccessible to users other than the root user. #9 145.4 Beginning update. This process may take several minutes. #9 145.6 #9 145.6 #9 145.6 Your current Google Cloud CLI version is: 460.0.0 #9 145.6 Installing components from version: 460.0.0 #9 145.6 #9 145.6 ┌─────────────────────────────────────────────────────────────────────────────┐ #9 145.6 │ These components will be installed. │ #9 145.6 ├─────────────────────────────────────────────────────┬────────────┬──────────┤ #9 145.6 │ Name │ Version │ Size │ #9 145.6 ├─────────────────────────────────────────────────────┼────────────┼──────────┤ #9 145.6 │ BigQuery Command Line Tool │ 2.0.101 │ 1.6 MiB │ #9 145.6 │ BigQuery Command Line Tool (Platform Specific) │ 2.0.101 │ < 1 MiB │ #9 145.6 │ Bundled Python 3.11 │ 3.11.6 │ 73.8 MiB │ #9 145.6 │ Cloud Storage Command Line Tool │ 5.27 │ 11.3 MiB │ #9 145.6 │ Cloud Storage Command Line Tool (Platform Specific) │ 5.27 │ < 1 MiB │ #9 145.6 │ Google Cloud CLI Core Libraries (Platform Specific) │ 2024.01.06 │ < 1 MiB │ #9 145.6 │ Google Cloud CRC32C Hash Tool │ 1.0.0 │ 1.2 MiB │ #9 145.6 │ anthoscli │ 0.2.47 │ 68.9 MiB │ #9 145.6 │ gcloud cli dependencies │ 2021.04.16 │ < 1 MiB │ #9 145.6 └─────────────────────────────────────────────────────┴────────────┴──────────┘ #9 145.6 #9 145.8 For the latest full release notes, please visit: #9 145.8 https://cloud.google.com/sdk/release_notes #9 145.8 #9 145.8 ╔════════════════════════════════════════════════════════════╗ #9 145.8 ╠═ Creating update staging area ═╣ #9 145.8 ╚════════════════════════════════════════════════════════════╝ #9 150.3 ╔════════════════════════════════════════════════════════════╗ #9 150.3 ╠═ Installing: BigQuery Command Line Tool ═╣ #9 150.3 ╚════════════════════════════════════════════════════════════╝ #9 150.7 ╔════════════════════════════════════════════════════════════╗ #9 150.7 ╠═ Installing: BigQuery Command Line Tool (Platform Spec... ═╣ #9 150.7 ╚════════════════════════════════════════════════════════════╝ #9 150.8 ╔════════════════════════════════════════════════════════════╗ #9 150.8 ╠═ Installing: Bundled Python 3.11 ═╣ #9 150.8 ╚════════════════════════════════════════════════════════════╝ #9 150.9 ╔════════════════════════════════════════════════════════════╗ #9 150.9 ╠═ Installing: Bundled Python 3.11 ═╣ #9 150.9 ╚════════════════════════════════════════════════════════════╝ #9 156.3 ╔════════════════════════════════════════════════════════════╗ #9 156.3 ╠═ Installing: Cloud Storage Command Line Tool ═╣ #9 156.3 ╚════════════════════════════════════════════════════════════╝ #9 158.2 ╔════════════════════════════════════════════════════════════╗ #9 158.2 ╠═ Installing: Cloud Storage Command Line Tool (Platform... ═╣ #9 158.2 ╚════════════════════════════════════════════════════════════╝ #9 158.3 ╔════════════════════════════════════════════════════════════╗ #9 158.3 ╠═ Installing: Default set of gcloud commands ═╣ #9 158.3 ╚════════════════════════════════════════════════════════════╝ #9 158.3 ╔════════════════════════════════════════════════════════════╗ #9 158.3 ╠═ Installing: Google Cloud CLI Core Libraries (Platform... ═╣ #9 158.3 ╚════════════════════════════════════════════════════════════╝ #9 158.5 ╔════════════════════════════════════════════════════════════╗ #9 158.5 ╠═ Installing: Google Cloud CRC32C Hash Tool ═╣ #9 158.5 ╚════════════════════════════════════════════════════════════╝ #9 158.5 ╔════════════════════════════════════════════════════════════╗ #9 158.5 ╠═ Installing: Google Cloud CRC32C Hash Tool ═╣ #9 158.5 ╚════════════════════════════════════════════════════════════╝ #9 158.7 ╔════════════════════════════════════════════════════════════╗ #9 158.7 ╠═ Installing: anthoscli ═╣ #9 158.7 ╚════════════════════════════════════════════════════════════╝ #9 160.6 #9 160.6 To help improve the quality of this product, we collect anonymized usage data #9 160.6 and anonymized stacktraces when crashes are encountered; additional information #9 160.6 is available at <https://cloud.google.com/sdk/usage-statistics>. This data is #9 160.6 handled in accordance with our privacy policy #9 160.6 <https://cloud.google.com/terms/cloud-privacy-notice>. You may choose to opt in this #9 160.6 collection now (by choosing 'Y' at the below prompt), or at any time in the #9 160.6 future by running the following command: #9 160.6 #9 160.6 gcloud config set disable_usage_reporting false #9 160.6 #9 160.6 #9 160.6 This will install all the core command line tools necessary for working with #9 160.6 the Google Cloud Platform. #9 160.6 #9 160.6 Traceback (most recent call last): #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/bin/bootstrapping/install.py", line 372, in <module> #9 160.6 main() #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/bin/bootstrapping/install.py", line 345, in main #9 160.6 Install( #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/bin/bootstrapping/install.py", line 205, in Install #9 160.6 InstallOrUpdateComponents(to_install, compile_python, update=update) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/bin/bootstrapping/install.py", line 256, in InstallOrUpdateComponents #9 160.6 _CLI.Execute( #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/calliope/cli.py", line 1024, in Execute #9 160.6 self._HandleAllErrors(exc, command_path_string, specified_arg_names) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/calliope/cli.py", line 1061, in _HandleAllErrors #9 160.6 exceptions.HandleError(exc, command_path_string, self.__known_error_handler) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/calliope/exceptions.py", line 557, in HandleError #9 160.6 core_exceptions.reraise(exc) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/exceptions.py", line 146, in reraise #9 160.6 six.reraise(type(exc_value), exc_value, tb) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/third_party/six/__init__.py", line 719, in reraise #9 160.6 raise value #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/calliope/cli.py", line 998, in Execute #9 160.6 resources = calliope_command.Run(cli=self, args=args) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/calliope/backend.py", line 815, in Run #9 160.6 resources = command_instance.Run(args) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/surface/components/update.py", line 125, in Run #9 160.6 update_manager.Update( #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/updater/update_manager.py", line 1119, in Update #9 160.6 self._UpdateWithProgressBar(components_to_install, 'Installing', #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/updater/update_manager.py", line 927, in _UpdateWithProgressBar #9 160.6 action_func(component.id, progress_callback=pb.SetProgress) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/updater/update_manager.py", line 932, in Inner #9 160.6 return install_state.Install(diff.latest, component_id, #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/updater/local_state.py", line 104, in _TryFunc #9 160.6 return func(*args, **kwargs) #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/updater/local_state.py", line 529, in Install #9 160.6 files = self._GetInstaller(snapshot).Install( #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/updater/installers.py", line 322, in Install #9 160.6 return self._InstallTar(component, progress_callback=progress_callback, #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/updater/installers.py", line 362, in _InstallTar #9 160.6 return DownloadAndExtractTar( #9 160.6 File "/usr/local/gcloud/google-cloud-sdk/lib/googlecloudsdk/core/updater/installers.py", line 241, in DownloadAndExtractTar #9 160.6 members = tar.getmembers() #9 160.6 File "/usr/local/lib/python3.8/tarfile.py", line 1971, in getmembers #9 160.6 self._load() # all members, we first have to #9 160.6 File "/usr/local/lib/python3.8/tarfile.py", line 2656, in _load #9 160.6 tarinfo = self.next() #9 160.6 File "/usr/local/lib/python3.8/tarfile.py", line 2570, in next #9 160.6 self.fileobj.seek(self.offset - 1) #9 160.6 File "/usr/local/lib/python3.8/gzip.py", line 384, in seek #9 160.6 return self._buffer.seek(offset, whence) #9 160.6 File "/usr/local/lib/python3.8/_compression.py", line 143, in seek #9 160.6 data = self.read(min(io.DEFAULT_BUFFER_SIZE, offset)) #9 160.6 File "/usr/local/lib/python3.8/gzip.py", line 498, in read #9 160.6 raise EOFError("Compressed file ended before the " #9 160.6 EOFError: Compressed file ended before the end-of-stream marker was reached #9 160.9 Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate #9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install --upgrade pip setuptools wheel && pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._implementation_type == 'upb'; print ('Verified fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc && ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false && pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip freeze --all && rm -rf /root/.cache/pip]: exit code: 1 ------ > [beam 5/5] RUN apt-get update && apt-get install -y > libsnappy-dev libyaml-dev ccache libgeos-dev && > rm -rf /var/lib/apt/lists/* && pip install --upgrade pip setuptools > wheel && pip install --no-deps -r /tmp/base_image_requirements.txt && > rm -rf /tmp/base_image_requirements.txt && python -c "import nltk; > nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip > && python -c "from google.protobuf.internal import api_implementation; > assert api_implementation._implementation_type == 'upb'; print ('Verified > fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd > /usr/local/gcloud && curl -s -O > https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar > -xf google-cloud-sdk.tar.gz && > /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf > /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm > google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc && > ccache --set-config=sloppiness=file_macro && ccache > --set-config=hash_dir=false && pip install --no-deps -v > /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo > "Container does not include required Beam dependencies or has conflicting > dependencies. If Beam dependencies have changed, you need to regenerate > base_image_requirements.txt files. See: > https://s.apache.org/beam-python-requirements-generate"; && exit 1) && > pip freeze --all && rm -rf /root/.cache/pip: #9 160.6 File "/usr/local/lib/python3.8/tarfile.py", line 2570, in next #9 160.6 self.fileobj.seek(self.offset - 1) #9 160.6 File "/usr/local/lib/python3.8/gzip.py", line 384, in seek #9 160.6 return self._buffer.seek(offset, whence) #9 160.6 File "/usr/local/lib/python3.8/_compression.py", line 143, in seek #9 160.6 data = self.read(min(io.DEFAULT_BUFFER_SIZE, offset)) #9 160.6 File "/usr/local/lib/python3.8/gzip.py", line 498, in read #9 160.6 raise EOFError("Compressed file ended before the " #9 160.6 EOFError: Compressed file ended before the end-of-stream marker was reached #9 160.9 Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate ------ ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install --upgrade pip setuptools wheel && pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._implementation_type == 'upb'; print ('Verified fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc && ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false && pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip freeze --all && rm -rf /root/.cache/pip]: exit code: 1 > Task :sdks:python:container:py38:docker FAILED > Task :sdks:python:installGcpTest Building wheel for apache-beam (pyproject.toml): still running... Building wheel for apache-beam (pyproject.toml): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.54.0.dev0-cp38-cp38-linux_x86_64.whl size=16248977 sha256=a8122a309723432236bef22dad2b5fdcbe59b9f9148ab2a0b1f66d5d4c578b38 Stored in directory: /home/jenkins/.cache/pip/wheels/1b/37/69/4219bfde2e691653eca943d057b6f1c5517c23c43f6dfd603b Successfully built apache-beam Installing collected packages: sortedcontainers, pytz, pyjsparser, docopt, crcmod, zstandard, wrapt, urllib3, tzdata, typing-extensions, threadpoolctl, tenacity, sqlparse, six, rpds-py, regex, pyyaml, pyparsing, pymysql, PyJWT, pyhamcrest, pycparser, pyasn1, pyarrow-hotfix, psycopg2-binary, protobuf, portalocker, pkgutil-resolve-name, parameterized, overrides, orjson, objsize, numpy, mock, jsonpickle, joblib, jmespath, iniconfig, importlib-resources, idna, grpcio, greenlet, google-crc32c, fasteners, fastavro, execnet, exceptiongroup, docstring-parser, dnspython, dill, deprecation, cloudpickle, charset-normalizer, certifi, backports.zoneinfo, attrs, tzlocal, sqlalchemy, shapely, scipy, rsa, requests, referencing, python-dateutil, pytest, pymongo, pydot, pyasn1-modules, pyarrow, proto-plus, isodate, hypothesis, httplib2, googleapis-common-protos, google-resumable-media, deprecated, cffi, scikit-learn, requests-mock, pytest-xdist, pytest-timeout, pandas, oauth2client, jsonschema-specifications, js2py, hdfs, grpcio-status, google-auth, freezegun, docker, cryptography, botocore, azure-core, testcontainers, s3transfer, jsonschema, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, azure-storage-blob, msal, google-cloud-core, boto3, apache-beam, msal-extensions, google-cloud-vision, google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-pubsublite, google-cloud-aiplatform, azure-identity Successfully installed PyJWT-2.8.0 apache-beam-2.54.0.dev0 attrs-23.2.0 azure-core-1.29.7 azure-identity-1.15.0 azure-storage-blob-12.19.0 backports.zoneinfo-0.2.1 boto3-1.34.22 botocore-1.34.22 certifi-2023.11.17 cffi-1.16.0 charset-normalizer-3.3.2 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.7 deprecated-1.2.14 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.5.0rc1 docker-7.0.0 docopt-0.6.2 docstring-parser-0.15 exceptiongroup-1.2.0 execnet-2.0.2 fastavro-1.9.3 fasteners-0.19 freezegun-1.4.0 google-api-core-2.16.0rc0 google-apitools-0.5.31 google-auth-2.26.2 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.39.0 google-cloud-bigquery-3.16.0 google-cloud-bigquery-storage-2.24.0 google-cloud-bigtable-2.22.0 google-cloud-core-2.4.1 google-cloud-datastore-2.19.0 google-cloud-dlp-3.14.0 google-cloud-language-2.12.0 google-cloud-pubsub-2.19.0 google-cloud-pubsublite-1.9.0 google-cloud-recommendations-ai-0.10.6 google-cloud-resource-manager-1.11.0 google-cloud-spanner-3.41.0 google-cloud-storage-2.14.0 google-cloud-videointelligence-2.12.0 google-cloud-vision-3.5.0 google-crc32c-1.5.0 google-resumable-media-2.7.0 googleapis-common-protos-1.62.0 greenlet-3.0.3 grpc-google-iam-v1-0.13.0 grpcio-1.60.0 grpcio-status-1.60.0 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.96.1 idna-3.6 importlib-resources-6.1.1 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 jsonpickle-3.0.2 jsonschema-4.21.0 jsonschema-specifications-2023.12.1 mock-5.1.0 msal-1.27.0b2 msal-extensions-1.1.0 numpy-1.24.4 oauth2client-4.1.3 objsize-0.7.0 orjson-3.9.12 overrides-7.4.0 pandas-2.0.3 parameterized-0.9.0 pkgutil-resolve-name-1.3.10 portalocker-2.8.2 proto-plus-1.23.0 protobuf-4.25.2 psycopg2-binary-2.9.9 pyarrow-14.0.2 pyarrow-hotfix-0.6 pyasn1-0.5.1 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.1.0 pyjsparser-2.7.1 pymongo-4.6.1 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.4 pytest-timeout-2.2.0 pytest-xdist-3.5.0 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 referencing-0.32.1 regex-2023.12.25 requests-2.31.0 requests-mock-1.11.0 rpds-py-0.17.1 rsa-4.9 s3transfer-0.10.0 scikit-learn-1.3.2 scipy-1.10.1 shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.51 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.9.0 tzdata-2023.4 tzlocal-5.2 urllib3-1.26.18 wrapt-1.16.0 zstandard-0.22.0 FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py38:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 6m 58s 233 actionable tasks: 152 executed, 71 from cache, 10 up-to-date Publishing build scan... https://ge.apache.org/s/e2tefk2h63pq6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org
