martin goodson created PIG-2992: ----------------------------------- Summary: Bug in FileLocalizer revealed by using org.apache.pig.piggybank.storage.AllLoader Key: PIG-2992 URL: https://issues.apache.org/jira/browse/PIG-2992 Project: Pig Issue Type: Bug Components: piggybank Affects Versions: 0.10.0 Environment: hive-0.9.0 pig-0.10.0 hadoop-0.20 Ubuntu 10.10 Reporter: martin goodson
I am trying to load some text files in hive partitions on S3 using the AllLoader function with no success. I get an error which indicates that AllLoader is expecting the files to be on hdfs: a = LOAD 's3n://xxxxx/yyyyy/zzz' using org.apache.pig.piggybank.storage.AllLoader(); grunt> 2012-10-12 14:51:26,229 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected internal error. Wrong FS: s3n://xxxxx/yyyyy/zzz, expected: hdfs:// namenode.hadoop.companyname.com Reading the files with pig storage works fine. a = LOAD 's3n://xxxxx/yyyyy/zzzZ' using PigStorage(); See http://mail-archives.apache.org/mod_mbox/pig-user/201210.mbox/%3CCAPPWfGGDXiXpZuGiVJX85b8V5ecb+3yEkXxsdf1oxKy=bov...@mail.gmail.com%3E Was suggested to be a bug in FileLocalizer by Dmitriy Ryaboy -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira