PS this is the real fix to this issue:
https://issues.apache.org/jira/browse/SPARK-5795
I'd like to merge it as I don't think it breaks the API; it actually
fixes it to work as intended.
On Mon, Feb 16, 2015 at 3:25 AM, Bahubali Jain wrote:
> I used the latest assembly jar and the below as sugg
I used the latest assembly jar and the below as suggested by Akhil to fix
this problem...
temp.saveAsHadoopFiles("DailyCSV",".txt", String.class, String.class,
*(Class)* TextOutputFormat.class);
Thanks All for the help !
On Wed, Feb 11, 2015 at 1:38 PM, Sean Owen wrote:
> That kinda dodges the
That kinda dodges the problem by ignoring generic types. But it may be
simpler than the 'real' solution, which is a bit ugly.
(But first, to double check, are you importing the correct
TextOutputFormat? there are two versions. You use .mapred. with the
old API and .mapreduce. with the new API.)
H
Did you try :
temp.saveAsHadoopFiles("DailyCSV",".txt", String.class, String.class,
*(Class)* TextOutputFormat.class);
Thanks
Best Regards
On Wed, Feb 11, 2015 at 9:40 AM, Bahubali Jain wrote:
> Hi,
> I am facing issues while writing data from a streaming rdd to hdfs..
>
> JavaPairDstream temp
Hi,
I am facing issues while writing data from a streaming rdd to hdfs..
JavaPairDstream temp;
...
...
temp.saveAsHadoopFiles("DailyCSV",".txt", String.class,
String.class,TextOutputFormat.class);
I see compilation issues as below...
The method saveAsHadoopFiles(String, String, Class, Class, Cla
