On Tue, Oct 8, 2013 at 6:35 AM, Adrian Sandulescu < [email protected]> wrote:
> Imports work great, but only when using the s3n:// protocol (which means > and HFile limit of 5GB). > Are you using Apache Hadoop or an EMR build? From what I recall, EMR ships a customized s3n implementation that uses multi-part upload feature of S3 to chunk files and bypass the old 5GB limitation. You might give that shot.
