Re: s3 checkpointing issue

2016-05-06 Thread Ufuk Celebi
OK, thanks for reporting back. Thanks to Igor as well. I just updated the docs with a note about this. On Thu, May 5, 2016 at 3:16 AM, Chen Qin wrote: > Uruk & Igor, > > Thanks for helping out! Yup, it fixed my issue. > > Chen > > > > On Wed, May 4, 2016 at 12:57 PM, Igor

Re: s3 checkpointing issue

2016-05-04 Thread Chen Qin
Uruk & Igor, Thanks for helping out! Yup, it fixed my issue. Chen On Wed, May 4, 2016 at 12:57 PM, Igor Berman wrote: > I think I've had this issue too and fixed it as Ufuk suggested > in core-site.xml > > something like > > fs.s3a.buffer.dir > /tmp > > > > On 4

Re: s3 checkpointing issue

2016-05-04 Thread Igor Berman
I think I've had this issue too and fixed it as Ufuk suggested in core-site.xml something like fs.s3a.buffer.dir /tmp On 4 May 2016 at 11:10, Ufuk Celebi wrote: > Hey Chen Qin, > > this seems to be an issue with the S3 file system. The root cause is: > > Caused by:

Re: s3 checkpointing issue

2016-05-04 Thread Ufuk Celebi
Hey Chen Qin, this seems to be an issue with the S3 file system. The root cause is: Caused by: java.lang.NullPointerException at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:268) at