Re: spark - reading hfds files every 5 minutes

@mayur_rustagi https://twitter.com/mayur_rustagi On Wed, Aug 20, 2014 at 1:01 AM, salemi alireza.sal...@udo.edu wrote: Thank you but how do you convert the stream to parquet file? Ali -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Re-spark-reading-hfds-files

Re: spark - reading hfds files every 5 minutes

) read the files and process them. is there a good example out there how to implement this? How do I know what part of the data I have already processed? Thanks, Ali -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-reading-hfds-files-every-5-minutes

Re: spark - reading hfds files every 5 minutes

Thank you but how do you convert the stream to parquet file? Ali -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Re-spark-reading-hfds-files-every-5-minutes-tp12359p12401.html Sent from the Apache Spark User List mailing list archive at Nabble.com

spark - reading hfds files every 5 minutes

of the data I have already processed? Thanks, Ali -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-reading-hfds-files-every-5-minutes-tp12325.html Sent from the Apache Spark User List mailing list archive at Nabble.com