Re: [Question] ORC - EMRFS Problem

2015-09-13 Thread Cazen Lee
unds exception? I don't > remember an array out of bounds problem off the top of my head. A stack trace > will tell me a lot, obviously. > > If you are using Spark 1.4 that implies Hive 0.13, which is pretty old. It > may be a problem that we fixed a while ago. > > Tha

[Question] ORC - EMRFS Problem

2015-09-12 Thread Cazen Lee
Good Day! I think there are some problems between ORC and AWS EMRFS. When I was trying to read "upper 150M" ORC files from S3, ArrayOutOfIndex Exception occured. I'm sure that it's AWS side issue because there was no exception when trying from HDFS or S3NativeFileSystem. Parquet runs