Definitely not a spark task.
Moving files within the same filesystem is merely a linking exercise, you
don't have to actually move any data. Write a shell script creating hard
links in the new location, once you're satisfied, remove the old links,
profit.
--
Sent from: http://apache-spark-user
Hello ,
I know this might not be a valid use case for spark. But I have millions of
files in a single folder. file names are having a pattern. based on pattern
I want to move it to different directory.
Can you pls suggest what can be done?
Thanks
rajat
