i am writing to bigquery On Fri, Jun 21, 2019 at 7:12 PM Alexey Romanenko <aromanenko....@gmail.com> wrote: > > I see that similar questions happen quite often in the last time, so, > probably, it would make sense to add this “Wait.on()”-pattern to > corresponding website documentation page [1]. > > [1] https://beam.apache.org/documentation/patterns/file-processing-patterns/ > > On 20 Jun 2019, at 23:00, Eugene Kirpichov <kirpic...@google.com> wrote: > > If you're writing to files, you can already do this: FileIO.write() returns > WriteFilesResult that you can use in combination with Wait.on() and > JdbcIO.write() to write something to a database afterwards. > Something like: > > PCollection<..> writeResult = data.apply(FileIO.write()...); > Create.of("dummy").apply(Wait.on(writeResult)).apply(JdbcIO.write(...write to > database...)) > > > > On Wed, Jun 19, 2019 at 11:49 PM Chaim Turkel <ch...@behalf.com> wrote: >> >> is it something you can do, or point me in the right direction? >> chaim >> >> On Wed, Jun 19, 2019 at 8:36 PM Kenneth Knowles <k...@apache.org> wrote: >> > >> > This sounds like a fairly simply and useful change to the IO to output >> > information about where it has written. It seems generally useful to >> > always output something like this, instead of PDone. >> > >> > Kenn >> > >> > On Wed, Jun 19, 2019 at 5:42 AM Chaim Turkel <ch...@behalf.com> wrote: >> >> >> >> Hi, >> >> I would like to write a status at the end of my pipline. I had >> >> written about this in the past, and wanted to know if there are any >> >> new ideas. >> >> The problem is the end of the pipeline return PDone, and i can't do >> >> anything with this. >> >> So my senario is after i export data from mongo to google storage i >> >> want to write to a db that the job was done with some extra >> >> information. >> >> >> >> Chaim Turkel >> >> >> >> -- >> >> >> >> >> >> Loans are funded by >> >> FinWise Bank, a Utah-chartered bank located in Sandy, >> >> Utah, member FDIC, Equal >> >> Opportunity Lender. Merchant Cash Advances are >> >> made by Behalf. For more >> >> information on ECOA, click here >> >> <https://www.behalf.com/legal/ecoa/>. For important information about >> >> opening a new >> >> account, review Patriot Act procedures here >> >> <https://www.behalf.com/legal/patriot/>. >> >> Visit Legal >> >> <https://www.behalf.com/legal/> to >> >> review our comprehensive program terms, >> >> conditions, and disclosures. >> >> -- >> >> >> Loans are funded by >> FinWise Bank, a Utah-chartered bank located in Sandy, >> Utah, member FDIC, Equal >> Opportunity Lender. Merchant Cash Advances are >> made by Behalf. For more >> information on ECOA, click here >> <https://www.behalf.com/legal/ecoa/>. For important information about >> opening a new >> account, review Patriot Act procedures here >> <https://www.behalf.com/legal/patriot/>. >> Visit Legal >> <https://www.behalf.com/legal/> to >> review our comprehensive program terms, >> conditions, and disclosures. > >
-- Loans are funded by FinWise Bank, a Utah-chartered bank located in Sandy, Utah, member FDIC, Equal Opportunity Lender. Merchant Cash Advances are made by Behalf. For more information on ECOA, click here <https://www.behalf.com/legal/ecoa/>. For important information about opening a new account, review Patriot Act procedures here <https://www.behalf.com/legal/patriot/>. Visit Legal <https://www.behalf.com/legal/> to review our comprehensive program terms, conditions, and disclosures.
