Re: Discourse: A proposed alternative to the Spark User list

2015-01-22 Thread pierred
Love it! There is a reason why SO is so effective and popular. Search is excellent, you can quickly find very thoughtful answers about sometimes thorny problems, and it is easy to contribute, format code, etc. Perhaps the most useful feature is that the best answers naturally bubble up to the

Re: wholeTextFiles not working with HDFS

2014-08-22 Thread pierred
I had the same issue with spark-1.0.2-bin-hadoop*1*, and indeed the issue seems related to Hadoop1. When switching to using spark-1.0.2-bin-hadoop*2*, the issue disappears. -- View this message in context:

Development environment issues

2014-08-21 Thread pierred
Hello all, I am trying to get productive with Spark and Scala but I haven't figured out a good development environment yet. Coming from the eclipse/java/ant/ivy/hadoop world, I understand that I have a steep learning curve ahead of me, but still I would expect to be able to relatively quickly