You can put the files from any where it just the streaming application only
picks the file having a timestamp greater than the batch was started.
No you dont need to set any properties for this to work. This is the
default behaviour of the spark streaming.
On Fri, Mar 13, 2015 at 9:38 AM,
Streaming takes only new files into consideration. Add the file after
starting the job.
On Thu, Mar 12, 2015 at 2:26 PM, CH.KMVPRASAD [via Apache Spark User List]
ml-node+s1001560n2201...@n3.nabble.com wrote:
yes !
for testing purpose i defined single file in the specified directory
Are the files already present in HDFS before you are starting your
application ?
On Thu, Mar 12, 2015 at 11:11 AM, CH.KMVPRASAD [via Apache Spark User List]
ml-node+s1001560n22008...@n3.nabble.com wrote:
Hi am successfully executed sparkPi example on yarn mode but i cant able
to read files
