tarun-google commented on issue #33074: URL: https://github.com/apache/beam/issues/33074#issuecomment-3304740621
Cross language pipeline options are not picked up inside DoFns as expansion service do not exist at runtime. When users provide temp_location, during the pipeline construction expansion service creates PipelineOptions with(tempLocation). But when we directly access at runtime, it exists as temp_Location, as expansion service is not doing cross language re-naming. The usage of pipeline options inside DoFn is not considered as legal pattern. So, I will be making a fix localized to BigQueryIO to access temp_Location. This will allow ManagedIO upgrade not to break existing BQ python/yaml pipelines. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
