>> grunt> A = LOAD '/region.parquet' USING parquet.pig.ParquetLoader AS (R_REGIONKEY:int,R_NAME:chararray,R_COMMENT:chararray);
It should be just "ParquetLoad" since its fully qualified name is org.apache.pig.builtin.ParquetLader- http://pig.apache.org/docs/r0.12.0/api/org/apache/pig/builtin/ParquetLoader.html Your job is failing because it cannot find "parquet.pig.ParquetLoader" in the default import lists- org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve parquet.pig.ParquetLoader using imports: [, java.lang.,org.apache.pig.builtin., org.apache.pig.impl.builtin.] On Mon, Mar 3, 2014 at 6:00 PM, Suhas Satish <suhas.sat...@gmail.com> wrote: > Shouldn't the jar containing parquetLoader and parquetStorer classes > be directly on pig's classpath by default in pig0.12? > > When I try using parquet load: > > grunt> A = LOAD '/region.parquet' USING parquet.pig.ParquetLoader AS > (R_REGIONKEY:int,R_NAME:chararray,R_COMMENT:chararray); > 2014-03-03 13:42:44,799 [main] ERROR org.apache.pig.tools.grunt.Grunt - > ERROR > 1070: Could not resolve parquet.pig.ParquetLoader using imports: [, > java.lang., > org.apache.pig.builtin., org.apache.pig.impl.builtin.] > Details at logfile: > /home/MAPRTECH/qa/chun/parquet-jars/pig_1393882961333.log > > ERROR 1070: Could not resolve parquet.pig.ParquetLoader using imports: [, > java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.] > > Failed to parse: Pig script failed to parse: > <line 1, column 33> pig script failed to validate: > org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not > resolve parquet.pig.ParquetLoader using imports: [, java.lang., > org.apache.pig.builtin., org.apache.pig.impl.builtin.] > at > org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:196) > at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1648) > at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1621) > at org.apache.pig.PigServer.registerQuery(PigServer.java:575) > at > org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1093) > at > > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501) > at > > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198) > at > > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173) > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69) > at org.apache.pig.Main.run(Main.java:541) > at org.apache.pig.Main.main(Main.java:156) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:197) > Caused by: > <line 1, column 33> pig script failed to validate: > org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not > resolve parquet.pig.ParquetLoader using imports: [, java.lang., > org.apache.pig.builtin., org.apache.pig.impl.builtin.] > at > > org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1260) > at > > org.apache.pig.parser.LogicalPlanBuilder.buildFuncSpec(LogicalPlanBuilder.java:1245) > at > > org.apache.pig.parser.LogicalPlanGenerator.func_clause(LogicalPlanGenerator.java:4989) > at > > org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3426) > at > > org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1536) > at > > org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1013) > at > > org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:553) > at > > org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421) > at > org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:188) > ... 15 more > Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR > 1070: > Could not resolve parquet.pig.ParquetLoader using imports: [, java.lang., > org.apache.pig.builtin., org.apache.pig.impl.builtin.] > at org.apache.pig.impl.PigContext.resolveClassName(PigContext.java:653) > at > > org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1257) > ... 23 more > > > Once I add the parquet jars it does seem to go beyond this stage. >
