Re: a vague question, but perhaps it might ring a bell

2015-01-05 Thread Michael Albert
Greeting! Thank you very much for taking the time to respond. My apologies, but at the moment I don't have an example that I feel comfortable posting.  Frankly, I've been struggling with variantsof this for the last two weeks and probably won't be able to work on this particular issue for a few

a vague question, but perhaps it might ring a bell

2015-01-04 Thread Michael Albert
Greetings! So, I think I have data saved so that each partition (part-r-0, etc)is exactly what I wan to translate into an output file of a format not related to  hadoop. I believe I've figured out how to tell Spark to read the data set without re-partitioning (in another post I mentioned

Re: a vague question, but perhaps it might ring a bell

2015-01-04 Thread Akhil Das
What are you trying to do? Can you paste the whole code? I used to see this sort of Exception when i close the fs object inside map/mapPartition etc. Thanks Best Regards On Mon, Jan 5, 2015 at 6:43 AM, Michael Albert m_albert...@yahoo.com.invalid wrote: Greetings! So, I think I have data