The situation is completely different than what you are thinking. Ok,
thanks for your time. From now I'll figure this out myself. Thank you again!
On Sat, 9 Jun 2018, 13:27 Jörn Franke, wrote:
> Why don’t you write the final name from the start?
> Ie save as the file it should be named.
>
> On
Why don’t you write the final name from the start?
Ie save as the file it should be named.
> On 9. Jun 2018, at 09:44, Abhijeet Kumar wrote:
>
> I need to rename the file. I can write a separate program for this, I think.
>
> Thanks,
> Abhijeet Kumar
>> On 09-Jun-2018, at 1:10 PM, Jörn Franke
I need to rename the file. I can write a separate program for this, I think.
Thanks,
Abhijeet Kumar
> On 09-Jun-2018, at 1:10 PM, Jörn Franke wrote:
>
> That would be an anti pattern and would lead to bad software.
> Please don’t do it for the sake of the people that use your software.
> What
That would be an anti pattern and would lead to bad software.
Please don’t do it for the sake of the people that use your software.
What do you exactly want to achieve with the information if the file exists or
not?
> On 9. Jun 2018, at 08:34, Abhijeet Kumar wrote:
>
> Can you please tell the
Can you please tell the estimated time. So, that my program will wait for that
time period.
Thanks,
Abhijeet Kumar
> On 09-Jun-2018, at 12:01 PM, Jörn Franke wrote:
>
> You need some time until the information of the file creation is propagated.
>
> On 9. Jun 2018, at 08:07, Abhijeet Kumar
You need some time until the information of the file creation is propagated.
> On 9. Jun 2018, at 08:07, Abhijeet Kumar wrote:
>
> I'm modifying a CSV file which is inside HDFS and finally putting it back to
> HDFS in Spark.
> val fs=FileSystem.get(spark.sparkContext.hadoopConfiguration)
>
I'm modifying a CSV file which is inside HDFS and finally putting it back to
HDFS in Spark.
val fs=FileSystem.get(spark.sparkContext.hadoopConfiguration)
csv_file.coalesce(1).write
.format("csv”)
.mode("overwrite”)
.save("hdfs://localhost:8020/data/temp_insight”)
Thread.sleep(15000)
