[
https://issues.apache.org/jira/browse/BEAM-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17440705#comment-17440705
]
Kenneth Knowles commented on BEAM-13194:
----------------------------------------
This may be a new feature request rather than a bug in expected feature set.
But the error message does not seem to be what you would expect if stored
procedures are not supported. So at least we should confirm that the what error
message says is actually the problem.
> Call the stored procedure in dataflow pipeline
> ----------------------------------------------
>
> Key: BEAM-13194
> URL: https://issues.apache.org/jira/browse/BEAM-13194
> Project: Beam
> Issue Type: Bug
> Components: io-py-gcp
> Reporter: ahalya
> Priority: P2
>
> https://stackoverflow.com/questions/69863008/call-the-bigquery-stored-procedure-in-dataflow-pipeline
> I have written a stored procedure in Bigquery and trying to call it within a
> dataflow pipeline. This works for the {{SELECT}} queries but not for the
> stored procedure:
> {code:python}
> pipeLine = beam.Pipeline(options=options)
> rawdata = ( pipeLine
> | beam.io.ReadFromBigQuery(
> query="CALL my_dataset.create_customer()",
> use_standard_sql=True)
> )
> pipeLine.run().wait_until_finish()
> {code}
> Stored procedure:
> {code:sql}
> CREATE OR REPLACE PROCEDURE my_dataset.create_customer()
> BEGIN
> SELECT *
> FROM `project_name.my_dataset.my_table`
> WHERE customer_name LIKE "%John%"
> ORDER BY created_time
> LIMIT 5;
> END;
> {code}
> I am able to create the stored procedure and call it within the Bigquery
> console. But, in the dataflow pipeline, it throws an error:
> {quote}"code": 400,
> "message": "configuration.query.destinationEncryptionConfiguration cannot be
> set for scripts",
> "message": "configuration.query.destinationEncryptionConfiguration cannot be
> set for scripts", "domain": "global",
> "reason": "invalid"
> "status": "INVALID_ARGUMENT"
> {quote}
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
