Hi Beam devs,
I'd like to change the Python ReadFromBigQuery IO to submit queries
with batch priority by default to 1) enable queries to not count
toward the BQ concurrent rate limit and 2) allow queries to wait for
available idle resources. This was the default behavior when using the
now depreca
es only
>> supported)
>> * a bunch of documentation and trivial plumbing issues
>>
>> On Fri, May 14, 2021 at 5:33 PM Ahmet Altay wrote:
>>>
>>> +Valentyn Tymofieiev might have an idea.
>>>
>>> On Mon, May 3, 2021 at 4:12 PM Chuck
Hi Beam devs,
I saw there has been some previous discussion [1][2] around removing
the deprecated oauth2client dependency and using the supported
google-auth dependency instead. A portion of this work seems to
involve migrating off of google-apitools since this call [3] is not
supported by credent
Hi Beam devs,
Could I have reviews on the following two PRs?
* [BEAM-11884] Pass destination as str rather than TableReference
within BigQueryBatchFileLoads #14112 [1]
* [BEAM-11277] Respect schemaUpdateOptions during BigQuery load with
temporary tables #14113 [2]
The first PR fixes a bug I enco
Hi Devs,
I was able to get around to working on Avro file loads to BigQuery in
Python SDK and now have a PR available at
https://github.com/apache/beam/pull/10979 . Comments appreciated :)
Thanks,
Chuck
On Wed, Nov 27, 2019 at 10:10 AM Chuck Yang wrote:
>
> I would love to fix this, b
I would love to fix this, but not sure if I have the bandwidth at the
moment. Anyway, created the jira here:
https://jira.apache.org/jira/browse/BEAM-8841
Thanks!
Chuck
--
*Confidentiality Note:* We care about protecting our proprietary
information, confidential material, and trade secrets. T
Has anyone looked into implementing this for the Python SDK? It would
be nice to have it if only for the ability to write float values with
NaN and infinity values. I didn't see anything in Jira, happy to
create a ticket, but wanted to ask around first.
On Thu, Oct 17, 2019 at 12:53 PM Reuven Lax
Hello Beam developers,
This is Chun from Cruise. I would like to make some contributions to
the Python SDK for Beam. Can someone add me as a contributor in the
Beam Jira? My username is cccyang.
Thanks!
Chun
--
*Confidentiality Note:* We care about protecting our proprietary
information, con
IMO returning the input PCollection in a PTransform should be a valid
albeit trivial use case. I have put a suggested fix for supporting
these kinds of transforms in the interactive runner here:
https://github.com/apache/beam/pull/9865 . I'm also new to beam dev so
if there's something I'm missing