[ https://issues.apache.org/jira/browse/BEAM-6158?focusedWorklogId=201534&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-201534 ]
ASF GitHub Bot logged work on BEAM-6158: ---------------------------------------- Author: ASF GitHub Bot Created on: 20/Feb/19 19:10 Start Date: 20/Feb/19 19:10 Worklog Time Spent: 10m Work Description: tvalentyn commented on pull request #7888: [BEAM-6158] Remove test_wordcount_without_save_main_session URL: https://github.com/apache/beam/pull/7888#discussion_r258634142 ########## File path: sdks/python/container/run_validatescontainer_py3.sh ########## @@ -82,7 +83,7 @@ SDK_LOCATION=$(find dist/apache-beam-*.tar.gz) # Run ValidatesRunner tests on Google Cloud Dataflow service echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST" python setup.py nosetests \ - --attr Py3IT \ + --attr ValidatesContainer \ Review comment: Ok, I totally missed this change in the earlier revision, now it is clear what keeps WordCount running, thanks. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 201534) Time Spent: 2h 50m (was: 2h 40m) > Enable support for save_main_session in Python 3 > ------------------------------------------------ > > Key: BEAM-6158 > URL: https://issues.apache.org/jira/browse/BEAM-6158 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-harness > Reporter: Mark Liu > Assignee: Valentyn Tymofieiev > Priority: Major > Labels: triaged > Time Spent: 2h 50m > Remaining Estimate: 0h > > This happened when I run wordcount example with portable Dataflow runner in > Python 3.5. The failure shows in worker log (unfortunately unformatted) of > [this > job|https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-29_11_47_38-6731484595556255542?project=google.com:clouddfe]: > {code:java} > Could not load main session: Traceback (most recent call last): File > "/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py", > line 125, in main _load_main_session(semi_persistent_directory) File > "/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py", > line 201, in _load_main_session pickler.load_session(session_file) File > "/usr/local/lib/python3.5/site-packages/apache_beam/internal/pickler.py", > line 269, in load_session return dill.load_session(file_path) File > "/usr/local/lib/python3.5/site-packages/dill/_dill.py", line 402, in > load_session module = unpickler.load() File > "/usr/local/lib/python3.5/site-packages/dill/_dill.py", line 465, in > find_class return StockUnpickler.find_class(self, module, name) > AttributeError: Can't get attribute 'WordExtractingDoFn' on <module > 'apache_beam.runners.worker.sdk_worker_main' from > '/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py'> > Traceback (most recent call last): File > "/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py", > line 125, in main _load_main_session(semi_persistent_directory) File > "/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py", > line 201, in _load_main_session pickler.load_session(session_file) File > "/usr/local/lib/python3.5/site-packages/apache_beam/internal/pickler.py", > line 269, in load_session return dill.load_session(file_path) File > "/usr/local/lib/python3.5/site-packages/dill/_dill.py", line 402, in > load_session module = unpickler.load() File > "/usr/local/lib/python3.5/site-packages/dill/_dill.py", line 465, in > find_class return StockUnpickler.find_class(self, module, name) > AttributeError: Can't get attribute 'WordExtractingDoFn' on <module > 'apache_beam.runners.worker.sdk_worker_main' from > '/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py'> > {code} > Looks like saved main session didn't work properly in Python 3. > +cc: [~tvalentyn] [~robertwb] [~altay] -- This message was sent by Atlassian JIRA (v7.6.3#76005)