Did you create a jira about that already ?I will do the improvement on JdbcIO. Regards JBThanksRegards JBLe dim. 31 mai 2020 ? 11:25, Willem Pienaar a ?crit :Hi Reuven,To be clear, we already have this solved for BigQueryIO. I am hoping there is a similar solution for JdbcIO.Regards,WillemOn Sun,
It doesn't look to me like JdbcIO currently supports dynamic destinations.
I think it wouldn't be too hard to add this functionality. If you wanted to
help contribute this change to JdbcIO.java, I'm sure that we would be happy
to help guide you.
Reuven
On Sun, May 31, 2020 at 2:26 AM Willem Piena
Hi Reuven,
To be clear, we already have this solved for BigQueryIO. I am hoping there is a
similar solution for JdbcIO.
Regards,
Willem
On Sun, May 31, 2020, at 12:42 PM, Reuven Lax wrote:
> This should be possible using the Beam programmatic API. You can pass
> BigQueryIO a function that dete
This should be possible using the Beam programmatic API. You can pass
BigQueryIO a function that determines the BigQuery table based on the input
element.
On Sat, May 30, 2020 at 9:20 PM Willem Pienaar wrote:
> Hi JB,
>
> Apologies for resurrecting this thread, but I have a related question.
>
>
Hi JB,
Apologies for resurrecting this thread, but I have a related question.
We've built a feature store Feast (https://github.com/feast-dev/feast)
primarily on Beam. We have been very happy with our decision to use Beam thus
far. Beam is mostly used as the ingestion layer that writes data int
Hi
You have the setPrepareStatement() method where you define the target tables.
However, it’s in the same database (datasource) per pipeline.
You can define several datasources and use a different datasource in each
JdbcIO write. Meaning that you can divide in sub pipelines.
Regards
JB
> Le 2
Hey folks,
Can we use JdbcIO for writing data to multiple Schemas(For Postgres Database)
dynamically using Apache beam Java Framework? Currently, I can't find any
property that I could set to JdbcIO transform for providing schema or maybe I
am missing something.
Thanks
