Re: hive error when trying to write data to s3n

2015-08-04 Thread Pun Intended
Yes, the explain plan definitely only has Move Operators (no Copy Operators). With that though, this definitely looks like a hive bug? Does anyone know if there is corresponding HIVE ticket or a workaround for the issue? Thanks! Stage: Stage-3 Move Operator files: hdfs direct

Re: hive error when trying to write data to s3n

2015-08-04 Thread Gopal Vijayaraghavan
> Moving data to: >s3n://:@my_bucket/a/b/2015-07-30/.hive-staging_hiv >e_2015-08-04_18-38-47_649_1476668515119011800-1/-ext-1 > Failed with exception Wrong FS: >s3n://:@my_bucket/a/b/2015-07-30/.hive-staging_hiv >e_2015-08-04_18-38-47_649_1476668515119011800-1/-ext-10002, expected: >hdfs://s

hive error when trying to write data to s3n

2015-08-04 Thread Pun Intended
Hello, I have a query that used to work fine previously. I am testing on hive 1.1 now and it is failing. The AWS access and secret key have permissions to read and write data to this directory. The directory exists. hive -e " insert overwrite directory 's3n://:@my_bucket/a/b/2015-07-30' SELECT *