Re: pubsub -> IO

2019-07-15 Thread Rui Wang
+user@beam.apache.org -Rui On Mon, Jul 15, 2019 at 6:55 AM Chaim Turkel wrote: > Hi, > I am looking to write a pipeline that read from a mongo collection. > I would like to listen to a pubsub that will have a object that will > tell me which collection and which time frame. > Is there a

Re: [python] ReadFromPubSub broken in Flink

2019-07-15 Thread Robert Bradshaw
On Mon, Jul 15, 2019 at 5:42 AM Chamikara Jayalath wrote: > > On Sat, Jul 13, 2019 at 7:41 PM Chad Dombrova wrote: >> >> Hi Chamikara, why not make this part of the pipeline options? does it really need to vary from transform to transform? >>> >>> It's possible for the same pipel

Re: [python SDK] Returning Pub/Sub message_id and timestamp

2019-07-15 Thread Matthew Darwin
Hi Valentyn, Thank you for your reply. I'm already using the with_attributes=True option, however this returns the attributes property of the JSON, i.e :- { "attributes": { "source": "python" } My pipeline currently looks like this (id_label is commented out when running d