RE: Inputs needed on File Writer

Thank you Sandesh. Regards, Surya Vamshi From: Sandesh Hegde [mailto:sand...@datatorrent.com] Sent: 2016, July, 12 11:24 AM To: users@apex.apache.org Subject: Re: Inputs needed on File Writer When you launch the application using Apex cli, it returns the application id. Here is the sample

Re: Inputs needed on File Writer

> Thank you ram, this is really helpful. > > > > Regards, > > Surya Vamshi > > *From:* Munagala Ramanath [mailto:r...@datatorrent.com] > *Sent:* 2016, July, 12 10:30 AM > > > *To:* users@apex.apache.org > *Subject:* Re: Inputs needed on File Writer > &

RE: Inputs needed on File Writer

Thank you ram, this is really helpful. Regards, Surya Vamshi From: Munagala Ramanath [mailto:r...@datatorrent.com] Sent: 2016, July, 12 10:30 AM To: users@apex.apache.org Subject: Re: Inputs needed on File Writer Please take a look at the Python script under https://github.com/DataTorrent

Re: Inputs needed on File Writer

l the application may be after an hour after launch in > the oozie scheduler. > > Regards, > Surya Vamshi > > -Original Message- > From: Tushar Gosavi [mailto:tus...@datatorrent.com] > Sent: 2016, July, 12 5:47 AM > To: users@apex.apache.org > Subject: Re: I

RE: Inputs needed on File Writer

. Regards, Surya Vamshi -Original Message- From: Tushar Gosavi [mailto:tus...@datatorrent.com] Sent: 2016, July, 12 5:47 AM To: users@apex.apache.org Subject: Re: Inputs needed on File Writer Hi Surya, Launching Apex application. 1) Using apex cli, you can write a script to launch an

Re: Inputs needed on File Writer

some light on this. > > > > Regards, > > Surya Vamshi > > From: Priyanka Gugale [mailto:priya...@datatorrent.com] > Sent: 2016, July, 11 7:11 AM > > > To: users@apex.apache.org > Subject: Re: Inputs needed on File Writer > > > > Hi, > > > > Che

RE: Inputs needed on File Writer

...@datatorrent.com] Sent: 2016, July, 11 7:11 AM To: users@apex.apache.org Subject: Re: Inputs needed on File Writer Hi, Check app: https://github.com/apache/apex-malhar/tree/master/apps/filecopy This is for HDFS to HDFS copy but I could use same app to copy from HDFS to FTP as HDFS api supports ftp as

Re: Inputs needed on File Writer

Gugale [mailto:priya...@datatorrent.com] >> *Sent:* 2016, July, 08 10:48 AM >> *To:* users@apex.apache.org >> *Subject:* RE: Inputs needed on File Writer >> >> >> >> Yes, ftp is supported but not sftp. >> >> -Priyanka >> >>

RE: Inputs needed on File Writer

gt; > Regards, > > Surya Vamshi > > > > *From:* Priyanka Gugale [mailto:priya...@datatorrent.com] > *Sent:* 2016, July, 08 10:48 AM > *To:* users@apex.apache.org > *Subject:* RE: Inputs needed on File Writer > > > > Yes, ftp is supported but not sftp. > &g

RE: Inputs needed on File Writer

Thank you Priyanka. Do you have any example that uses this Operator for FTP? Regards, Surya Vamshi From: Priyanka Gugale [mailto:priya...@datatorrent.com] Sent: 2016, July, 08 10:48 AM To: users@apex.apache.org Subject: RE: Inputs needed on File Writer Yes, ftp is supported but not sftp

RE: Inputs needed on File Writer

atatorrent.com] > *Sent:* 2016, July, 08 12:07 AM > *To:* users@apex.apache.org > *Subject:* Re: Inputs needed on File Writer > > > > Hi, > > > > The file will be available after window is committed, you can overwrite > committed call and start your thread after s

RE: Inputs needed on File Writer

[mailto:priya...@datatorrent.com] Sent: 2016, July, 08 12:07 AM To: users@apex.apache.org Subject: Re: Inputs needed on File Writer Hi, The file will be available after window is committed, you can overwrite committed call and start your thread after super.commit is called. You might want to double

Re: Inputs needed on File Writer

Hi, The file will be available after window is committed, you can overwrite committed call and start your thread after super.commit is called. You might want to double check if file is actually finalized before starting your thread.. For your usecase I would suggest you to use AbstractFileOutputO

Inputs needed on File Writer

Hi , Can you please let me know what happen when the requestFinalize() method is called as per below ? Once the output files are written to HDFS, I would like to initiate a thread that reads the HDFS files and copies to FTP location. So I am trying to understand when can I trigger the thread.